Jul 09 14:54:50.330195 ip-10-0-137-94 systemd[1]: Starting Kubernetes Kubelet...
Jul 09 14:54:50.816426 ip-10-0-137-94 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 14:54:50.816426 ip-10-0-137-94 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 09 14:54:50.816426 ip-10-0-137-94 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 14:54:50.816426 ip-10-0-137-94 kubenswrapper[2575]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 09 14:54:50.816426 ip-10-0-137-94 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 14:54:50.816426 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.808637    2575 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 09 14:54:50.816426 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.812744    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 14:54:50.816426 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.812756    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 14:54:50.816426 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.812760    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 14:54:50.816426 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.812764    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 14:54:50.816426 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.812767    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 14:54:50.816426 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.812770    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 14:54:50.816426 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.812774    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 14:54:50.816426 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.812783    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 14:54:50.820442 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.812787    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 14:54:50.820442 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.812790    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 14:54:50.820442 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.812793    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 14:54:50.820442 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.812795    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 14:54:50.820442 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.812798    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 14:54:50.820442 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.812800    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 14:54:50.820442 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.812803    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 14:54:50.820442 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.812806    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 14:54:50.820442 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.812809    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 14:54:50.820442 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.812811    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 14:54:50.820442 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.812814    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 14:54:50.820442 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.812816    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 14:54:50.820442 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.812819    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 14:54:50.820442 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.812831    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 14:54:50.820442 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.812835    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 14:54:50.820442 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.812837    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 14:54:50.820442 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.812840    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 14:54:50.820442 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.812843    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 14:54:50.820442 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.812845    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 14:54:50.820442 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.812849    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 14:54:50.823295 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.812851    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 14:54:50.823295 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.812854    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 14:54:50.823295 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.812856    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 14:54:50.823295 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.812859    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 14:54:50.823295 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.812863    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 14:54:50.823295 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.812867    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 14:54:50.823295 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.812870    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 14:54:50.823295 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.812873    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 14:54:50.823295 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.812876    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 14:54:50.823295 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.812879    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 14:54:50.823295 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.812882    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 14:54:50.823295 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.812885    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 14:54:50.823295 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.812888    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 14:54:50.823295 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.812890    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 14:54:50.823295 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.812908    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 14:54:50.823295 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.812911    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 14:54:50.823295 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.812913    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 14:54:50.823295 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.812916    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 14:54:50.823295 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.812919    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 14:54:50.823295 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.812922    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 14:54:50.826738 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.812924    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 14:54:50.826738 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.812927    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 14:54:50.826738 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.812930    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 14:54:50.826738 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.812932    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 14:54:50.826738 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.812936    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 14:54:50.826738 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.812940    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 14:54:50.826738 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.812943    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 14:54:50.826738 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.812946    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 14:54:50.826738 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.812950    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 14:54:50.826738 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.812953    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 14:54:50.826738 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.812955    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 14:54:50.826738 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.812958    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 14:54:50.826738 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.812961    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 14:54:50.826738 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.812963    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 14:54:50.826738 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.812966    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 14:54:50.826738 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.812968    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 14:54:50.826738 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.812971    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 14:54:50.826738 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.812973    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 14:54:50.826738 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.812976    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 14:54:50.837884 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.812979    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 14:54:50.837884 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.812981    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 14:54:50.837884 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.812984    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 14:54:50.837884 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.812987    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 14:54:50.837884 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.812989    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 14:54:50.837884 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.812992    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 14:54:50.837884 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.812994    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 14:54:50.837884 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.812997    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 14:54:50.837884 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813000    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 14:54:50.837884 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813002    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 14:54:50.837884 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813005    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 14:54:50.837884 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813009    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 14:54:50.837884 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813011    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 14:54:50.837884 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813014    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 14:54:50.837884 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813016    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 14:54:50.837884 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813019    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 14:54:50.837884 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813021    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 14:54:50.837884 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813024    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 14:54:50.837884 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813027    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 14:54:50.837884 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813029    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 14:54:50.841204 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813032    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 14:54:50.841204 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813035    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 14:54:50.841204 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813038    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 14:54:50.841204 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813040    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 14:54:50.841204 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813043    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 14:54:50.841204 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813046    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 14:54:50.841204 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813049    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 14:54:50.841204 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813053    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 14:54:50.841204 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813056    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 14:54:50.841204 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813059    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 14:54:50.841204 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813062    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 14:54:50.841204 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813064    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 14:54:50.841204 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813775    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 14:54:50.841204 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813782    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 14:54:50.841204 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813785    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 14:54:50.841204 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813788    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 14:54:50.841204 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813791    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 14:54:50.841204 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813794    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 14:54:50.841204 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813797    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 14:54:50.844225 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813799    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 14:54:50.844225 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813802    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 14:54:50.844225 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813805    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 14:54:50.844225 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813808    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 14:54:50.844225 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813811    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 14:54:50.844225 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813813    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 14:54:50.844225 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813816    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 14:54:50.844225 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813818    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 14:54:50.844225 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813821    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 14:54:50.844225 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813823    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 14:54:50.844225 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813826    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 14:54:50.844225 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813828    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 14:54:50.844225 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813831    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 14:54:50.844225 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813834    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 14:54:50.844225 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813836    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 14:54:50.844225 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813838    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 14:54:50.844225 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813843    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 14:54:50.844225 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813846    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 14:54:50.844225 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813851    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 14:54:50.848711 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813855    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 14:54:50.848711 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813858    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 14:54:50.848711 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813861    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 14:54:50.848711 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813864    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 14:54:50.848711 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813867    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 14:54:50.848711 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813871    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 14:54:50.848711 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813874    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 14:54:50.848711 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813877    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 14:54:50.848711 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813880    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 14:54:50.848711 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813882    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 14:54:50.848711 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813885    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 14:54:50.848711 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813888    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 14:54:50.848711 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813891    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 14:54:50.848711 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813893    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 14:54:50.848711 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813909    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 14:54:50.848711 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813912    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 14:54:50.848711 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813915    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 14:54:50.848711 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813918    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 14:54:50.848711 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813920    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 14:54:50.848711 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813923    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 14:54:50.855820 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813926    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 14:54:50.855820 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813928    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 14:54:50.855820 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813930    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 14:54:50.855820 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813933    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 14:54:50.855820 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813935    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 14:54:50.855820 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813938    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 14:54:50.855820 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813940    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 14:54:50.855820 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813943    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 14:54:50.855820 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813945    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 14:54:50.855820 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813948    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 14:54:50.855820 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813951    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 14:54:50.855820 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813954    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 14:54:50.855820 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813956    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 14:54:50.855820 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813959    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 14:54:50.855820 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813962    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 14:54:50.855820 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813965    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 14:54:50.855820 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813968    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 14:54:50.855820 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813971    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 14:54:50.855820 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813973    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 14:54:50.855820 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813976    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 14:54:50.855820 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813978    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 14:54:50.860453 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813981    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 14:54:50.860453 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813983    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 14:54:50.860453 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813986    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 14:54:50.860453 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813989    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 14:54:50.860453 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813992    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 14:54:50.860453 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813994    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 14:54:50.860453 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813997    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 14:54:50.860453 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.813999    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 14:54:50.860453 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814002    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 14:54:50.860453 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814004    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 14:54:50.860453 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814006    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 14:54:50.860453 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814009    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 14:54:50.860453 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814011    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 14:54:50.860453 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814014    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 14:54:50.860453 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814018    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 14:54:50.860453 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814022    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 14:54:50.860453 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814025    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 14:54:50.860453 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814028    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 14:54:50.860453 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814031    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 14:54:50.867057 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814033    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 14:54:50.867057 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814036    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 14:54:50.867057 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814039    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 14:54:50.867057 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814042    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 14:54:50.867057 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814044    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 14:54:50.867057 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814047    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 14:54:50.867057 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814049    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 14:54:50.867057 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814051    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 14:54:50.867057 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814054    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 14:54:50.867057 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814056    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 14:54:50.867057 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814059    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 14:54:50.867057 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814061    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 14:54:50.867057 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814064    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 14:54:50.867057 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814431    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 14:54:50.867057 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814435    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 14:54:50.867057 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814438    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 14:54:50.867057 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814440    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 14:54:50.867057 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814444    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 14:54:50.867057 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814446    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 14:54:50.867057 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814449    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 14:54:50.871373 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814451    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 14:54:50.871373 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814454    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 14:54:50.871373 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814457    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 14:54:50.871373 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814459    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 14:54:50.871373 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814462    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 14:54:50.871373 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814464    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 14:54:50.871373 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814467    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 14:54:50.871373 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814469    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 14:54:50.871373 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814472    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 14:54:50.871373 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814474    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 14:54:50.871373 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814477    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 14:54:50.871373 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814480    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 14:54:50.871373 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814482    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 14:54:50.871373 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814485    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 14:54:50.871373 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814488    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 14:54:50.871373 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814490    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 14:54:50.871373 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814493    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 14:54:50.871373 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814495    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 14:54:50.871373 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814498    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 14:54:50.871373 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814500    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 14:54:50.878019 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814503    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 14:54:50.878019 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814506    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 14:54:50.878019 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814508    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 14:54:50.878019 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814510    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 14:54:50.878019 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814515    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 14:54:50.878019 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814519    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 14:54:50.878019 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814523    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 14:54:50.878019 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814526    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 14:54:50.878019 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814529    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 14:54:50.878019 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814532    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 14:54:50.878019 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814535    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 14:54:50.878019 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814538    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 14:54:50.878019 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814541    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 14:54:50.878019 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814544    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 14:54:50.878019 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814547    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 14:54:50.878019 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814550    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 14:54:50.878019 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814552    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 14:54:50.878019 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814555    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 14:54:50.878019 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814557    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 14:54:50.882481 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814560    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 14:54:50.882481 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814563    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 14:54:50.882481 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814565    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 14:54:50.882481 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814567    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 14:54:50.882481 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814570    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 14:54:50.882481 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814572    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 14:54:50.882481 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814575    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 14:54:50.882481 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814578    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 14:54:50.882481 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814581    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 14:54:50.882481 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814583    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 14:54:50.882481 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814586    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 14:54:50.882481 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814588    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 14:54:50.882481 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814591    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 14:54:50.882481 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814593    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 14:54:50.882481 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814601    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 14:54:50.882481 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814604    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 14:54:50.882481 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814606    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 14:54:50.882481 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814609    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 14:54:50.882481 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814611    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 14:54:50.888359 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814616    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 14:54:50.888359 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814619    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 14:54:50.888359 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814622    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 14:54:50.888359 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814625    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 14:54:50.888359 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814628    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 14:54:50.888359 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814632    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 14:54:50.888359 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814636    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 14:54:50.888359 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814639    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 14:54:50.888359 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814642    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 14:54:50.888359 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814644    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 14:54:50.888359 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814647    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 14:54:50.888359 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814650    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 14:54:50.888359 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814652    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 14:54:50.888359 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814655    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 14:54:50.888359 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814657    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 14:54:50.888359 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814661    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 14:54:50.888359 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814663    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 14:54:50.888359 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814666    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 14:54:50.888359 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814668    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 14:54:50.888036 ip-10-0-137-94 systemd[1]: Started Kubernetes Kubelet.
Jul 09 14:54:50.892566 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814671    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 14:54:50.892566 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814673    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 14:54:50.892566 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814676    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 14:54:50.892566 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814678    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 14:54:50.892566 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814681    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 14:54:50.892566 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814683    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 14:54:50.892566 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814686    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 14:54:50.892566 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814688    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 14:54:50.892566 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814692    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 14:54:50.892566 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814694    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 14:54:50.892566 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814697    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 14:54:50.892566 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814699    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 14:54:50.892566 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814701    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 14:54:50.892566 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814704    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 14:54:50.892566 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.814706    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 14:54:50.892566 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.814774    2575 flags.go:64] FLAG: --address="0.0.0.0"
Jul 09 14:54:50.892566 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.814781    2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 09 14:54:50.892566 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.814787    2575 flags.go:64] FLAG: --anonymous-auth="true"
Jul 09 14:54:50.892566 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.814792    2575 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 09 14:54:50.892566 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.814808    2575 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 09 14:54:50.892566 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.814811    2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 09 14:54:50.906266 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.814816    2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 09 14:54:50.906266 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.814820    2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 09 14:54:50.906266 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.814823    2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 09 14:54:50.906266 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.814826    2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 09 14:54:50.906266 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.814829    2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 09 14:54:50.906266 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.814833    2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 09 14:54:50.906266 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.814836    2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 09 14:54:50.906266 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.814839    2575 flags.go:64] FLAG: --cgroup-root=""
Jul 09 14:54:50.906266 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.814841    2575 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 09 14:54:50.906266 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.814845    2575 flags.go:64] FLAG: --client-ca-file=""
Jul 09 14:54:50.906266 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.814847    2575 flags.go:64] FLAG: --cloud-provider="external"
Jul 09 14:54:50.906266 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.814850    2575 flags.go:64] FLAG: --cluster-dns="[]"
Jul 09 14:54:50.906266 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.814855    2575 flags.go:64] FLAG: --cluster-domain=""
Jul 09 14:54:50.906266 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.814858    2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 09 14:54:50.906266 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.814861    2575 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 09 14:54:50.906266 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.814864    2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 09 14:54:50.906266 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.814867    2575 flags.go:64] FLAG: --container-log-max-files="5"
Jul 09 14:54:50.906266 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.814871    2575 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 09 14:54:50.906266 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.814874    2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 09 14:54:50.906266 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.814878    2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 09 14:54:50.906266 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.814881    2575 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 09 14:54:50.906266 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.814884    2575 flags.go:64] FLAG: --contention-profiling="false"
Jul 09 14:54:50.906266 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.814887    2575 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 09 14:54:50.906266 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.814890    2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 09 14:54:50.911423 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.814907    2575 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 09 14:54:50.911423 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.814912    2575 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 09 14:54:50.911423 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.814918    2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 09 14:54:50.911423 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.814923    2575 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 09 14:54:50.911423 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.814926    2575 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 09 14:54:50.911423 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.814929    2575 flags.go:64] FLAG: --enable-load-reader="false"
Jul 09 14:54:50.911423 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.814933    2575 flags.go:64] FLAG: --enable-server="true"
Jul 09 14:54:50.911423 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.814937    2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 09 14:54:50.911423 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.814942    2575 flags.go:64] FLAG: --event-burst="100"
Jul 09 14:54:50.911423 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.814945    2575 flags.go:64] FLAG: --event-qps="50"
Jul 09 14:54:50.911423 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.814948    2575 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 09 14:54:50.911423 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.814951    2575 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 09 14:54:50.911423 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.814954    2575 flags.go:64] FLAG: --eviction-hard=""
Jul 09 14:54:50.911423 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.814958    2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 09 14:54:50.911423 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.814960    2575 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 09 14:54:50.911423 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.814963    2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 09 14:54:50.911423 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.814966    2575 flags.go:64] FLAG: --eviction-soft=""
Jul 09 14:54:50.911423 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.814969    2575 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 09 14:54:50.911423 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.814972    2575 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 09 14:54:50.911423 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.814975    2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 09 14:54:50.911423 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.814978    2575 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 09 14:54:50.911423 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.814980    2575 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 09 14:54:50.911423 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.814984    2575 flags.go:64] FLAG: --fail-swap-on="true"
Jul 09 14:54:50.911423 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.814987    2575 flags.go:64] FLAG: --feature-gates=""
Jul 09 14:54:50.911423 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.814990    2575 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 09 14:54:51.081043 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.814993    2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 09 14:54:51.081043 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.814996    2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 09 14:54:51.081043 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815001    2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 09 14:54:51.081043 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815004    2575 flags.go:64] FLAG: --healthz-port="10248"
Jul 09 14:54:51.081043 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815007    2575 flags.go:64] FLAG: --help="false"
Jul 09 14:54:51.081043 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815010    2575 flags.go:64] FLAG: --hostname-override="ip-10-0-137-94.ec2.internal"
Jul 09 14:54:51.081043 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815013    2575 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 09 14:54:51.081043 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815016    2575 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 09 14:54:51.081043 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815019    2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 09 14:54:51.081043 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815022    2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 09 14:54:51.081043 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815025    2575 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 09 14:54:51.081043 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815028    2575 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 09 14:54:51.081043 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815031    2575 flags.go:64] FLAG: --image-service-endpoint=""
Jul 09 14:54:51.081043 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815035    2575 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 09 14:54:51.081043 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815038    2575 flags.go:64] FLAG: --kube-api-burst="100"
Jul 09 14:54:51.081043 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815041    2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 09 14:54:51.081043 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815044    2575 flags.go:64] FLAG: --kube-api-qps="50"
Jul 09 14:54:51.081043 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815047    2575 flags.go:64] FLAG: --kube-reserved=""
Jul 09 14:54:51.081043 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815050    2575 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 09 14:54:51.081043 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815053    2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 09 14:54:51.081043 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815056    2575 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 09 14:54:51.081043 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815059    2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 09 14:54:51.081043 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815061    2575 flags.go:64] FLAG: --lock-file=""
Jul 09 14:54:51.081043 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815064    2575 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 09 14:54:51.084997 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815067    2575 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 09 14:54:51.084997 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815070    2575 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 09 14:54:51.084997 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815075    2575 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 09 14:54:51.084997 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815078    2575 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 09 14:54:51.084997 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815080    2575 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 09 14:54:51.084997 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815083    2575 flags.go:64] FLAG: --logging-format="text"
Jul 09 14:54:51.084997 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815086    2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 09 14:54:51.084997 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815089    2575 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 09 14:54:51.084997 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815092    2575 flags.go:64] FLAG: --manifest-url=""
Jul 09 14:54:51.084997 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815095    2575 flags.go:64] FLAG: --manifest-url-header=""
Jul 09 14:54:51.084997 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815101    2575 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 09 14:54:51.084997 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815103    2575 flags.go:64] FLAG: --max-open-files="1000000"
Jul 09 14:54:51.084997 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815107    2575 flags.go:64] FLAG: --max-pods="110"
Jul 09 14:54:51.084997 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815111    2575 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 09 14:54:51.084997 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815114    2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 09 14:54:51.084997 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815116    2575 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 09 14:54:51.084997 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815119    2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 09 14:54:51.084997 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815122    2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 09 14:54:51.084997 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815125    2575 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 09 14:54:51.084997 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815128    2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 09 14:54:51.084997 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815135    2575 flags.go:64] FLAG: --node-status-max-images="50"
Jul 09 14:54:51.084997 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815139    2575 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 09 14:54:51.084997 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815142    2575 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 09 14:54:51.084997 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815145    2575 flags.go:64] FLAG: --pod-cidr=""
Jul 09 14:54:51.089457 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815148    2575 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 09 14:54:51.089457 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815153    2575 flags.go:64] FLAG: --pod-manifest-path=""
Jul 09 14:54:51.089457 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815156    2575 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 09 14:54:51.089457 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815159    2575 flags.go:64] FLAG: --pods-per-core="0"
Jul 09 14:54:51.089457 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815162    2575 flags.go:64] FLAG: --port="10250"
Jul 09 14:54:51.089457 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815165    2575 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 09 14:54:51.089457 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815168    2575 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-010f93e58c56a5a8e"
Jul 09 14:54:51.089457 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815172    2575 flags.go:64] FLAG: --qos-reserved=""
Jul 09 14:54:51.089457 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815174    2575 flags.go:64] FLAG: --read-only-port="10255"
Jul 09 14:54:51.089457 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815177    2575 flags.go:64] FLAG: --register-node="true"
Jul 09 14:54:51.089457 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815180    2575 flags.go:64] FLAG: --register-with-taints=""
Jul 09 14:54:51.089457 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815184    2575 flags.go:64] FLAG: --registry-burst="10"
Jul 09 14:54:51.089457 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815186    2575 flags.go:64] FLAG: --registry-qps="5"
Jul 09 14:54:51.089457 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815189    2575 flags.go:64] FLAG: --reserved-cpus=""
Jul 09 14:54:51.089457 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815192    2575 flags.go:64] FLAG: --reserved-memory=""
Jul 09 14:54:51.089457 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815195    2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 09 14:54:51.089457 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815198    2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 09 14:54:51.089457 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815201    2575 flags.go:64] FLAG: --rotate-certificates="false"
Jul 09 14:54:51.089457 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815205    2575 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 09 14:54:51.089457 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815208    2575 flags.go:64] FLAG: --runonce="false"
Jul 09 14:54:51.089457 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815211    2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 09 14:54:51.089457 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815214    2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 09 14:54:51.089457 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815217    2575 flags.go:64] FLAG: --seccomp-default="false"
Jul 09 14:54:51.089457 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815219    2575 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 09 14:54:51.089457 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815222    2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 09 14:54:51.111958 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815225    2575 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 09 14:54:51.111958 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815228    2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 09 14:54:51.111958 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815231    2575 flags.go:64] FLAG: --storage-driver-password="root"
Jul 09 14:54:51.111958 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815233    2575 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 09 14:54:51.111958 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815236    2575 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 09 14:54:51.111958 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815240    2575 flags.go:64] FLAG: --storage-driver-user="root"
Jul 09 14:54:51.111958 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815243    2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 09 14:54:51.111958 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815246    2575 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 09 14:54:51.111958 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815250    2575 flags.go:64] FLAG: --system-cgroups=""
Jul 09 14:54:51.111958 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815253    2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 09 14:54:51.111958 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815258    2575 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 09 14:54:51.111958 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815261    2575 flags.go:64] FLAG: --tls-cert-file=""
Jul 09 14:54:51.111958 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815264    2575 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 09 14:54:51.111958 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815268    2575 flags.go:64] FLAG: --tls-min-version=""
Jul 09 14:54:51.111958 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815270    2575 flags.go:64] FLAG: --tls-private-key-file=""
Jul 09 14:54:51.111958 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815273    2575 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 09 14:54:51.111958 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815276    2575 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 09 14:54:51.111958 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815279    2575 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 09 14:54:51.111958 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815281    2575 flags.go:64] FLAG: --v="2"
Jul 09 14:54:51.111958 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815285    2575 flags.go:64] FLAG: --version="false"
Jul 09 14:54:51.111958 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815289    2575 flags.go:64] FLAG: --vmodule=""
Jul 09 14:54:51.111958 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815293    2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 09 14:54:51.111958 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815296    2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 09 14:54:51.111958 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815405    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 14:54:51.111958 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815409    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 14:54:51.113633 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815413    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 14:54:51.113633 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815416    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 14:54:51.113633 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815419    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 14:54:51.113633 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815422    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 14:54:51.113633 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815424    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 14:54:51.113633 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815427    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 14:54:51.113633 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815429    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 14:54:51.113633 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815432    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 14:54:51.113633 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815435    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 14:54:51.113633 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815437    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 14:54:51.113633 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815440    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 14:54:51.113633 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815442    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 14:54:51.113633 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815446    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 14:54:51.113633 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815449    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 14:54:51.113633 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815451    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 14:54:51.113633 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815454    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 14:54:51.113633 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815457    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 14:54:51.113633 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815460    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 14:54:51.113633 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815463    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 14:54:51.114449 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815465    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 14:54:51.114449 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815468    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 14:54:51.114449 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815471    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 14:54:51.114449 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815473    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 14:54:51.114449 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815476    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 14:54:51.114449 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815479    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 14:54:51.114449 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815482    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 14:54:51.114449 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815486    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 14:54:51.114449 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815489    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 14:54:51.114449 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815492    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 14:54:51.114449 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815495    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 14:54:51.114449 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815497    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 14:54:51.114449 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815500    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 14:54:51.114449 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815504    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 14:54:51.114449 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815507    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 14:54:51.114449 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815510    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 14:54:51.114449 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815513    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 14:54:51.114449 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815515    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 14:54:51.114449 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815518    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 14:54:51.114449 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815521    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 14:54:51.116081 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815524    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 14:54:51.116081 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815527    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 14:54:51.116081 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815529    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 14:54:51.116081 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815532    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 14:54:51.116081 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815535    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 14:54:51.116081 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815540    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 14:54:51.116081 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815543    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 14:54:51.116081 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815545    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 14:54:51.116081 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815548    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 14:54:51.116081 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815550    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 14:54:51.116081 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815554    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 14:54:51.116081 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815558    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 14:54:51.116081 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815560    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 14:54:51.116081 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815563    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 14:54:51.116081 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815566    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 14:54:51.116081 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815569    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 14:54:51.116081 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815572    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 14:54:51.116081 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815574    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 14:54:51.116081 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815576    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 14:54:51.116081 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815579    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 14:54:51.116887 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815582    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 14:54:51.116887 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815584    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 14:54:51.116887 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815587    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 14:54:51.116887 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815589    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 14:54:51.116887 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815591    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 14:54:51.116887 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815597    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 14:54:51.116887 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815600    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 14:54:51.116887 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815604    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 14:54:51.116887 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815606    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 14:54:51.116887 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815608    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 14:54:51.116887 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815611    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 14:54:51.116887 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815613    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 14:54:51.116887 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815616    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 14:54:51.116887 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815618    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 14:54:51.116887 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815621    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 14:54:51.116887 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815623    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 14:54:51.116887 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815625    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 14:54:51.116887 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815629    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 14:54:51.116887 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815632    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 14:54:51.116887 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815635    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 14:54:51.118545 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815637    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 14:54:51.118545 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815640    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 14:54:51.118545 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815642    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 14:54:51.118545 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815645    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 14:54:51.118545 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815647    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 14:54:51.118545 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815650    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 14:54:51.118545 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815653    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 14:54:51.118545 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815655    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 14:54:51.118545 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815658    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 14:54:51.118545 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815660    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 14:54:51.118545 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815663    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 14:54:51.118545 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815665    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 14:54:51.118545 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815668    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 14:54:51.118545 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815670    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 14:54:51.118545 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815673    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 14:54:51.118545 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815675    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 14:54:51.118545 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815677    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 14:54:51.118545 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.815682    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 14:54:51.119354 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.815687    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 14:54:51.119354 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.823450    2575 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 09 14:54:51.119354 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.823466    2575 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 09 14:54:51.119354 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.824414    2575 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 09 14:54:51.119354 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.824421    2575 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 09 14:54:51.119354 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824479    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 14:54:51.119354 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824484    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 14:54:51.119354 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824487    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 14:54:51.119354 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824490    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 14:54:51.119354 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824495    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 14:54:51.119354 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824499    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 14:54:51.119354 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824502    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 14:54:51.119354 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824505    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 14:54:51.119354 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824508    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 14:54:51.120562 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824511    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 14:54:51.120562 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824514    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 14:54:51.120562 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824516    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 14:54:51.120562 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824519    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 14:54:51.120562 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824522    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 14:54:51.120562 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824525    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 14:54:51.120562 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824528    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 14:54:51.120562 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824530    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 14:54:51.120562 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824533    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 14:54:51.120562 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824536    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 14:54:51.120562 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824539    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 14:54:51.120562 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824542    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 14:54:51.120562 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824545    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 14:54:51.120562 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824549    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 14:54:51.120562 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824552    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 14:54:51.120562 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824557    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 14:54:51.120562 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824560    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 14:54:51.120562 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824563    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 14:54:51.120562 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824565    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 14:54:51.120562 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824568    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 14:54:51.121384 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824571    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 14:54:51.121384 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824574    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 14:54:51.121384 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824592    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 14:54:51.121384 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824595    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 14:54:51.121384 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824599    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 14:54:51.121384 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824602    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 14:54:51.121384 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824605    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 14:54:51.121384 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824607    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 14:54:51.121384 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824611    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 14:54:51.121384 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824615    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 14:54:51.121384 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824618    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 14:54:51.121384 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824621    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 14:54:51.121384 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824624    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 14:54:51.121384 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824627    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 14:54:51.121384 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824629    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 14:54:51.121384 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824632    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 14:54:51.121384 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824636    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 14:54:51.121384 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824639    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 14:54:51.121384 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824641    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 14:54:51.123038 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824644    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 14:54:51.123038 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824646    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 14:54:51.123038 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824649    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 14:54:51.123038 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824652    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 14:54:51.123038 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824655    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 14:54:51.123038 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824658    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 14:54:51.123038 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824660    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 14:54:51.123038 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824663    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 14:54:51.123038 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824668    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 14:54:51.123038 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824670    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 14:54:51.123038 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824673    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 14:54:51.123038 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824675    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 14:54:51.123038 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824678    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 14:54:51.123038 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824681    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 14:54:51.123038 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824683    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 14:54:51.123038 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824686    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 14:54:51.123038 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824688    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 14:54:51.123038 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824691    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 14:54:51.123038 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824693    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 14:54:51.123038 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824696    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 14:54:51.123851 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824699    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 14:54:51.123851 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824701    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 14:54:51.123851 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824703    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 14:54:51.123851 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824706    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 14:54:51.123851 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824709    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 14:54:51.123851 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824712    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 14:54:51.123851 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824715    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 14:54:51.123851 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824718    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 14:54:51.123851 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824721    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 14:54:51.123851 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824724    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 14:54:51.123851 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824727    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 14:54:51.123851 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824730    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 14:54:51.123851 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824733    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 14:54:51.123851 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824736    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 14:54:51.123851 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824738    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 14:54:51.123851 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824741    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 14:54:51.123851 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824744    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 14:54:51.123851 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824747    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 14:54:51.123851 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824749    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 14:54:51.123851 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824752    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 14:54:51.125094 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824755    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 14:54:51.125094 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824758    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 14:54:51.125094 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824761    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 14:54:51.125094 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824763    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 14:54:51.125094 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824766    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 14:54:51.125094 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824769    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 14:54:51.125094 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824771    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 14:54:51.125094 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824774    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 14:54:51.125094 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824776    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 14:54:51.125094 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824779    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 14:54:51.125094 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824782    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 14:54:51.125094 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.824786    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 14:54:51.125094 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824919    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 14:54:51.125094 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824924    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 14:54:51.125094 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824928    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 14:54:51.125874 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824931    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 14:54:51.125874 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824935    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 14:54:51.125874 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824939    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 14:54:51.125874 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824942    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 14:54:51.125874 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824945    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 14:54:51.125874 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824948    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 14:54:51.125874 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824951    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 14:54:51.125874 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824953    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 14:54:51.125874 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824957    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 14:54:51.125874 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824960    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 14:54:51.125874 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824962    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 14:54:51.125874 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824965    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 14:54:51.125874 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824967    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 14:54:51.125874 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824971    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 14:54:51.125874 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824973    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 14:54:51.125874 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824976    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 14:54:51.125874 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824978    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 14:54:51.125874 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824981    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 14:54:51.125874 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824985    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 14:54:51.126702 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824987    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 14:54:51.126702 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824990    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 14:54:51.126702 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824992    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 14:54:51.126702 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824995    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 14:54:51.126702 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.824997    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 14:54:51.126702 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.825001    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 14:54:51.126702 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.825005    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 14:54:51.126702 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.825010    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 14:54:51.126702 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.825012    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 14:54:51.126702 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.825015    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 14:54:51.126702 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.825018    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 14:54:51.126702 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.825021    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 14:54:51.126702 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.825024    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 14:54:51.126702 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.825027    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 14:54:51.126702 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.825029    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 14:54:51.126702 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.825032    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 14:54:51.126702 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.825035    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 14:54:51.126702 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.825038    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 14:54:51.126702 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.825040    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 14:54:51.127501 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.825043    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 14:54:51.127501 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.825045    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 14:54:51.127501 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.825048    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 14:54:51.127501 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.825051    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 14:54:51.127501 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.825053    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 14:54:51.127501 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.825056    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 14:54:51.127501 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.825058    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 14:54:51.127501 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.825061    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 14:54:51.127501 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.825063    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 14:54:51.127501 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.825066    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 14:54:51.127501 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.825069    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 14:54:51.127501 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.825071    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 14:54:51.127501 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.825074    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 14:54:51.127501 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.825077    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 14:54:51.127501 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.825080    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 14:54:51.127501 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.825082    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 14:54:51.127501 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.825084    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 14:54:51.127501 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.825087    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 14:54:51.127501 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.825089    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 14:54:51.127501 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.825092    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 14:54:51.128336 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.825096    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 14:54:51.128336 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.825099    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 14:54:51.128336 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.825101    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 14:54:51.128336 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.825104    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 14:54:51.128336 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.825107    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 14:54:51.128336 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.825109    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 14:54:51.128336 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.825111    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 14:54:51.128336 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.825114    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 14:54:51.128336 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.825117    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 14:54:51.128336 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.825119    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 14:54:51.128336 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.825122    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 14:54:51.128336 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.825124    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 14:54:51.128336 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.825126    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 14:54:51.128336 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.825129    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 14:54:51.128336 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.825131    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 14:54:51.128336 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.825134    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 14:54:51.128336 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.825137    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 14:54:51.128336 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.825139    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 14:54:51.128336 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.825142    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 14:54:51.128336 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.825144    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 14:54:51.129166 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.825147    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 14:54:51.129166 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.825149    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 14:54:51.129166 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.825152    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 14:54:51.129166 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.825154    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 14:54:51.129166 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.825158    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 14:54:51.129166 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.825161    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 14:54:51.129166 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.825163    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 14:54:51.129166 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.825166    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 14:54:51.129166 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.825168    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 14:54:51.129166 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.825170    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 14:54:51.129166 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.825174    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 14:54:51.129166 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.825177    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 14:54:51.129166 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.825181    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 14:54:51.129166 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.825184    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 14:54:51.129166 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.825186    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 14:54:51.129166 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.825189    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 14:54:51.129166 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.825192    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 14:54:51.129166 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:50.825195    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 14:54:51.130417 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.825200    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 14:54:51.130417 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.825299    2575 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 09 14:54:51.130417 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.827752    2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 09 14:54:51.130417 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.829509    2575 server.go:1019] "Starting client certificate rotation"
Jul 09 14:54:51.130417 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.829682    2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 09 14:54:51.130417 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.829720    2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 09 14:54:51.130417 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.832256    2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 09 14:54:51.130417 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.833395    2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 09 14:54:51.130417 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.854288    2575 log.go:25] "Validated CRI v1 runtime API"
Jul 09 14:54:51.130417 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.856665    2575 log.go:25] "Validated CRI v1 image API"
Jul 09 14:54:51.130417 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.857422    2575 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 09 14:54:51.130417 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.860549    2575 fs.go:135] Filesystem UUIDs: map[0bcbf974-9eff-4512-8afb-d6c9907aabbd:/dev/nvme0n1p4 43bcd67a-bae6-499a-b938-697d6bb450f3:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Jul 09 14:54:51.130841 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.860563    2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 09 14:54:51.134599 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.865766    2575 manager.go:216] Machine: {Timestamp:2026-07-09 14:54:50.865295025 +0000 UTC m=+0.389638214 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3096706 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d2362e1e01f45645e816fbfce9695 SystemUUID:ec2d2362-e1e0-1f45-645e-816fbfce9695 BootID:86475a3e-d0ea-4219-a613-2b5e12e9b5ed Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:e7:a7:34:44:c5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:e7:a7:34:44:c5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:5e:bb:bc:68:e5:72 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 09 14:54:51.134599 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.865871    2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 09 14:54:51.134599 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.866027    2575 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 09 14:54:51.134599 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.866161    2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 09 14:54:51.134599 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.869516    2575 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 09 14:54:51.134599 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.869544    2575 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-94.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 09 14:54:51.134599 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.870372    2575 topology_manager.go:138] "Creating topology manager with none policy"
Jul 09 14:54:51.135026 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.870382    2575 container_manager_linux.go:309] "Creating device plugin manager"
Jul 09 14:54:51.135026 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.870390    2575 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 09 14:54:51.135026 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.870400    2575 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 09 14:54:51.135026 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.872355    2575 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 09 14:54:51.135026 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.877066    2575 state_mem.go:36] "Initialized new in-memory state store"
Jul 09 14:54:51.135026 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.877183    2575 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 09 14:54:51.135026 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.877211    2575 kubelet.go:486] "Attempting to sync node with API server"
Jul 09 14:54:51.135026 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.877230    2575 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 09 14:54:51.135026 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.877248    2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 09 14:54:51.135026 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.877261    2575 kubelet.go:398] "Adding apiserver pod source"
Jul 09 14:54:51.135026 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.877272    2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 09 14:54:51.135026 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.877654    2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 09 14:54:51.135026 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.877668    2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 09 14:54:51.135026 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.879982    2575 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 09 14:54:51.135026 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.882449    2575 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 09 14:54:51.135026 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.882476    2575 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 09 14:54:51.135026 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.882614    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 09 14:54:51.135026 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.882626    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 09 14:54:51.135026 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.882632    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 09 14:54:51.135026 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.882637    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 09 14:54:51.135026 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.882645    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 09 14:54:51.135026 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.882651    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 09 14:54:51.135026 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.883289    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 09 14:54:51.135026 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.883295    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 09 14:54:51.135026 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.883302    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 09 14:54:51.135026 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.883307    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 09 14:54:51.135026 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.883321    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 09 14:54:51.135026 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.883328    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 09 14:54:51.135026 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.884188    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 09 14:54:51.135026 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.884217    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 09 14:54:51.135026 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.887319    2575 server.go:1268] "Started kubelet"
Jul 09 14:54:51.135026 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.887696    2575 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 09 14:54:51.135026 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.887679    2575 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 09 14:54:51.135026 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.902715    2575 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 09 14:54:51.135026 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.906574    2575 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 09 14:54:51.135026 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.906950    2575 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-94.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 09 14:54:51.135026 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:54:50.907115    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-94.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 09 14:54:51.135026 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:54:50.907230    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 09 14:54:51.135026 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.907514    2575 server.go:310] "Adding debug handlers to kubelet server"
Jul 09 14:54:51.136328 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:54:50.916401    2575 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 09 14:54:51.136328 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.917363    2575 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 09 14:54:51.136328 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.917407    2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 09 14:54:51.136328 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:54:50.917554    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-94.ec2.internal\" not found"
Jul 09 14:54:51.136328 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.918091    2575 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 09 14:54:51.136328 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.918125    2575 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 09 14:54:51.136328 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.918133    2575 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 09 14:54:51.136328 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.918236    2575 reconstruct.go:97] "Volume reconstruction finished"
Jul 09 14:54:51.136328 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.918245    2575 reconciler.go:29] "Reconciler: start to sync state"
Jul 09 14:54:51.136328 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.918314    2575 factory.go:55] Registering systemd factory
Jul 09 14:54:51.136328 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.918370    2575 factory.go:223] Registration of the systemd container factory successfully
Jul 09 14:54:51.136328 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.918644    2575 factory.go:153] Registering CRI-O factory
Jul 09 14:54:51.136328 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.918660    2575 factory.go:223] Registration of the crio container factory successfully
Jul 09 14:54:51.136328 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.918714    2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 09 14:54:51.136328 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.918738    2575 factory.go:103] Registering Raw factory
Jul 09 14:54:51.136328 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.918754    2575 manager.go:1196] Started watching for new ooms in manager
Jul 09 14:54:51.136328 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.919213    2575 manager.go:349] Starting recovery of all containers
Jul 09 14:54:51.136328 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:54:50.918156    2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-94.ec2.internal.18c0a6d61790e1fd  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-94.ec2.internal,UID:ip-10-0-137-94.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-94.ec2.internal,},FirstTimestamp:2026-07-09 14:54:50.887299581 +0000 UTC m=+0.411642770,LastTimestamp:2026-07-09 14:54:50.887299581 +0000 UTC m=+0.411642770,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-94.ec2.internal,}"
Jul 09 14:54:51.136328 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.926456    2575 manager.go:354] Recovery completed
Jul 09 14:54:51.136328 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.928733    2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jrjqw"
Jul 09 14:54:51.136328 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:54:50.929291    2575 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-94.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 09 14:54:51.136328 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:54:50.929665    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 09 14:54:51.136328 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.930560    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 14:54:51.136328 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.932436    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-94.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 14:54:51.136328 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.932462    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-94.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 14:54:51.136328 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.932471    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-94.ec2.internal" event="NodeHasSufficientPID"
Jul 09 14:54:51.136328 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.933008    2575 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 09 14:54:51.136328 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.933016    2575 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 09 14:54:51.136328 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.933030    2575 state_mem.go:36] "Initialized new in-memory state store"
Jul 09 14:54:51.136328 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.933076    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 14:54:51.136328 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.934154    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-94.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 14:54:51.136328 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.934180    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-94.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 14:54:51.138365 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.934195    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-94.ec2.internal" event="NodeHasSufficientPID"
Jul 09 14:54:51.138365 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:54:50.934713    2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-94.ec2.internal.18c0a6d61a41cc1a  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-94.ec2.internal,UID:ip-10-0-137-94.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-94.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-94.ec2.internal,},FirstTimestamp:2026-07-09 14:54:50.932448282 +0000 UTC m=+0.456791470,LastTimestamp:2026-07-09 14:54:50.932448282 +0000 UTC m=+0.456791470,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-94.ec2.internal,}"
Jul 09 14:54:51.138365 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:50.936044    2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jrjqw"
Jul 09 14:54:51.138365 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:54:50.946172    2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-94.ec2.internal.18c0a6d61a4210d8  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-94.ec2.internal,UID:ip-10-0-137-94.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-137-94.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-137-94.ec2.internal,},FirstTimestamp:2026-07-09 14:54:50.93246588 +0000 UTC m=+0.456809069,LastTimestamp:2026-07-09 14:54:50.93246588 +0000 UTC m=+0.456809069,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-94.ec2.internal,}"
Jul 09 14:54:51.138365 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:54:50.958028    2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-94.ec2.internal.18c0a6d61a423621  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-94.ec2.internal,UID:ip-10-0-137-94.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-137-94.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-137-94.ec2.internal,},FirstTimestamp:2026-07-09 14:54:50.932475425 +0000 UTC m=+0.456818614,LastTimestamp:2026-07-09 14:54:50.932475425 +0000 UTC m=+0.456818614,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-94.ec2.internal,}"
Jul 09 14:54:51.138365 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:54:50.969222    2575 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-137-94.ec2.internal.18c0a6d61a41cc1a\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-94.ec2.internal.18c0a6d61a41cc1a  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-94.ec2.internal,UID:ip-10-0-137-94.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-94.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-94.ec2.internal,},FirstTimestamp:2026-07-09 14:54:50.932448282 +0000 UTC m=+0.456791470,LastTimestamp:2026-07-09 14:54:50.934165775 +0000 UTC m=+0.458508966,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-94.ec2.internal,}"
Jul 09 14:54:51.138766 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:54:50.978891    2575 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-137-94.ec2.internal.18c0a6d61a4210d8\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-94.ec2.internal.18c0a6d61a4210d8  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-94.ec2.internal,UID:ip-10-0-137-94.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-137-94.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-137-94.ec2.internal,},FirstTimestamp:2026-07-09 14:54:50.93246588 +0000 UTC m=+0.456809069,LastTimestamp:2026-07-09 14:54:50.93418722 +0000 UTC m=+0.458530413,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-94.ec2.internal,}"
Jul 09 14:54:51.138766 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:54:50.992012    2575 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-137-94.ec2.internal.18c0a6d61a423621\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-94.ec2.internal.18c0a6d61a423621  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-94.ec2.internal,UID:ip-10-0-137-94.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-137-94.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-137-94.ec2.internal,},FirstTimestamp:2026-07-09 14:54:50.932475425 +0000 UTC m=+0.456818614,LastTimestamp:2026-07-09 14:54:50.934200177 +0000 UTC m=+0.458543371,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-94.ec2.internal,}"
Jul 09 14:54:51.138766 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:54:51.018136    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-94.ec2.internal\" not found"
Jul 09 14:54:51.138766 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:51.080359    2575 policy_none.go:49] "None policy: Start"
Jul 09 14:54:51.138766 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:51.080382    2575 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 09 14:54:51.138766 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:51.080395    2575 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 09 14:54:51.138766 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:51.083043    2575 policy_none.go:47] "Start"
Jul 09 14:54:51.138766 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:54:51.118830    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-94.ec2.internal\" not found"
Jul 09 14:54:51.145868 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:54:51.145428    2575 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-137-94.ec2.internal\" not found" node="ip-10-0-137-94.ec2.internal"
Jul 09 14:54:51.245743 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:54:51.219756    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-94.ec2.internal\" not found"
Jul 09 14:54:51.369558 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:54:51.320222    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-94.ec2.internal\" not found"
Jul 09 14:54:51.495464 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:54:51.420922    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-94.ec2.internal\" not found"
Jul 09 14:54:51.620511 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:54:51.521299    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-94.ec2.internal\" not found"
Jul 09 14:54:51.622370 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:54:51.621684    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-94.ec2.internal\" not found"
Jul 09 14:54:53.412871 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:51.625638    2575 manager.go:337] "Starting Device Plugin manager"
Jul 09 14:54:53.412871 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:54:51.625668    2575 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 09 14:54:53.412871 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:51.625677    2575 server.go:87] "Starting device plugin registration server"
Jul 09 14:54:53.412871 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:51.625946    2575 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 09 14:54:53.412871 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:51.625959    2575 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 09 14:54:53.412871 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:51.626081    2575 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 09 14:54:53.412871 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:51.626161    2575 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 09 14:54:53.412871 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:51.626168    2575 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 09 14:54:53.412871 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:54:51.626648    2575 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 09 14:54:53.412871 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:54:51.626703    2575 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-94.ec2.internal\" not found"
Jul 09 14:54:53.412871 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:51.627019    2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 09 14:54:53.412871 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:51.628252    2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 09 14:54:53.412871 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:51.628286    2575 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 09 14:54:53.412871 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:51.628317    2575 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 09 14:54:53.412871 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:54:51.628350    2575 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 09 14:54:53.412871 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:51.630828    2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 14:54:53.412871 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:53.408272    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 14:54:53.412871 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:53.409404    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-94.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 14:54:53.412871 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:53.409438    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-94.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 14:54:53.412871 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:53.409449    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-94.ec2.internal" event="NodeHasSufficientPID"
Jul 09 14:54:53.412871 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:53.409472    2575 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-94.ec2.internal"
Jul 09 14:54:53.412871 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:53.410608    2575 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-94.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-94.ec2.internal"]
Jul 09 14:54:53.412871 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:53.410670    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 14:54:53.419084 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:53.418817    2575 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-94.ec2.internal"
Jul 09 14:54:53.419084 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:54:53.418834    2575 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-94.ec2.internal\": node \"ip-10-0-137-94.ec2.internal\" not found"
Jul 09 14:54:53.521961 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:53.420963    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-94.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 14:54:53.521961 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:53.420985    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-94.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 14:54:53.521961 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:53.420999    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-94.ec2.internal" event="NodeHasSufficientPID"
Jul 09 14:54:53.521961 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:53.423216    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 14:54:53.521961 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:53.423335    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-94.ec2.internal"
Jul 09 14:54:53.521961 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:53.423368    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 14:54:53.521961 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:53.424011    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-94.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 14:54:53.521961 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:53.424033    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-94.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 14:54:53.521961 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:53.424044    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-94.ec2.internal" event="NodeHasSufficientPID"
Jul 09 14:54:53.521961 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:53.425027    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-94.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 14:54:53.521961 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:53.425046    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-94.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 14:54:53.521961 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:53.425056    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-94.ec2.internal" event="NodeHasSufficientPID"
Jul 09 14:54:53.521961 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:53.426244    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-94.ec2.internal"
Jul 09 14:54:53.521961 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:53.426265    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 14:54:53.521961 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:53.426868    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-94.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 14:54:53.521961 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:53.426896    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-94.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 14:54:53.521961 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:53.426910    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-94.ec2.internal" event="NodeHasSufficientPID"
Jul 09 14:54:53.521961 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:54:53.439904    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-94.ec2.internal\" not found"
Jul 09 14:54:53.521961 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:53.505262    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e768764d27b505cd33de9c3393775e16-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-94.ec2.internal\" (UID: \"e768764d27b505cd33de9c3393775e16\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-94.ec2.internal"
Jul 09 14:54:53.521961 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:53.505299    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e768764d27b505cd33de9c3393775e16-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-94.ec2.internal\" (UID: \"e768764d27b505cd33de9c3393775e16\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-94.ec2.internal"
Jul 09 14:54:53.521961 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:53.505327    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/842163ee6bc7db204a9ad24049bf1028-config\") pod \"kube-apiserver-proxy-ip-10-0-137-94.ec2.internal\" (UID: \"842163ee6bc7db204a9ad24049bf1028\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-94.ec2.internal"
Jul 09 14:54:53.521961 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:53.512063    2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 09 14:54:53.521961 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:53.512225    2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 09 14:54:53.524476 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:54:53.512196    2575 event.go:368] "Unable to write event (may retry after sleeping)" err="Patch \"https://ab502220c9c0e459989e9bfd2c3be551-621cc0f8499fa912.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/default/events/ip-10-0-137-94.ec2.internal.18c0a6d61a423621\": read tcp 10.0.137.94:55098->3.224.51.234:6443: use of closed network connection" event="&Event{ObjectMeta:{ip-10-0-137-94.ec2.internal.18c0a6d61a423621  default   5298 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-94.ec2.internal,UID:ip-10-0-137-94.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-137-94.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-137-94.ec2.internal,},FirstTimestamp:2026-07-09 14:54:50 +0000 UTC,LastTimestamp:2026-07-09 14:54:53.425059679 +0000 UTC m=+1.267592602,Count:6,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-94.ec2.internal,}"
Jul 09 14:54:53.540101 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:54:53.540079    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-94.ec2.internal\" not found"
Jul 09 14:54:53.541555 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:54:53.541539    2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-94.ec2.internal\" not found" node="ip-10-0-137-94.ec2.internal"
Jul 09 14:54:53.545831 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:54:53.545813    2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-94.ec2.internal\" not found" node="ip-10-0-137-94.ec2.internal"
Jul 09 14:54:53.606332 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:53.606262    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e768764d27b505cd33de9c3393775e16-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-94.ec2.internal\" (UID: \"e768764d27b505cd33de9c3393775e16\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-94.ec2.internal"
Jul 09 14:54:53.606332 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:53.606283    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e768764d27b505cd33de9c3393775e16-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-94.ec2.internal\" (UID: \"e768764d27b505cd33de9c3393775e16\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-94.ec2.internal"
Jul 09 14:54:53.606332 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:53.606297    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e768764d27b505cd33de9c3393775e16-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-94.ec2.internal\" (UID: \"e768764d27b505cd33de9c3393775e16\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-94.ec2.internal"
Jul 09 14:54:53.606332 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:53.606316    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/842163ee6bc7db204a9ad24049bf1028-config\") pod \"kube-apiserver-proxy-ip-10-0-137-94.ec2.internal\" (UID: \"842163ee6bc7db204a9ad24049bf1028\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-94.ec2.internal"
Jul 09 14:54:53.606527 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:53.606350    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/842163ee6bc7db204a9ad24049bf1028-config\") pod \"kube-apiserver-proxy-ip-10-0-137-94.ec2.internal\" (UID: \"842163ee6bc7db204a9ad24049bf1028\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-94.ec2.internal"
Jul 09 14:54:53.606527 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:53.606357    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e768764d27b505cd33de9c3393775e16-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-94.ec2.internal\" (UID: \"e768764d27b505cd33de9c3393775e16\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-94.ec2.internal"
Jul 09 14:54:53.641115 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:54:53.641090    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-94.ec2.internal\" not found"
Jul 09 14:54:53.741585 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:54:53.741551    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-94.ec2.internal\" not found"
Jul 09 14:54:53.763730 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:53.763689    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-08 14:49:52 +0000 UTC" deadline="2027-12-11 07:21:10.6311372 +0000 UTC"
Jul 09 14:54:53.763772 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:53.763730    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12472h26m16.86741166s"
Jul 09 14:54:53.778857 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:53.778837    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 14:54:53.779817 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:53.779798    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-94.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 14:54:53.779908 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:53.779835    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-94.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 14:54:53.779908 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:53.779849    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-94.ec2.internal" event="NodeHasSufficientPID"
Jul 09 14:54:53.842433 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:54:53.842396    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-94.ec2.internal\" not found"
Jul 09 14:54:53.843517 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:53.843501    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-94.ec2.internal"
Jul 09 14:54:53.845051 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:53.845035    2575 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 14:54:53.848381 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:53.848286    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-94.ec2.internal"
Jul 09 14:54:53.877657 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:53.877594    2575 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 14:54:53.942922 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:54:53.942882    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-94.ec2.internal\" not found"
Jul 09 14:54:54.043493 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:54:54.043473    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-94.ec2.internal\" not found"
Jul 09 14:54:54.101748 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.101723    2575 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 14:54:54.200227 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.200150    2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-94.ec2.internal"
Jul 09 14:54:54.215158 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.215139    2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 09 14:54:54.216120 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.216108    2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-94.ec2.internal"
Jul 09 14:54:54.223720 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.223695    2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 09 14:54:54.469588 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:54.469554    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode768764d27b505cd33de9c3393775e16.slice/crio-e18e956ae036a304abffb12b39988f2ac03d0b37bb2152ec6937ac54fecbcbc1 WatchSource:0}: Error finding container e18e956ae036a304abffb12b39988f2ac03d0b37bb2152ec6937ac54fecbcbc1: Status 404 returned error can't find the container with id e18e956ae036a304abffb12b39988f2ac03d0b37bb2152ec6937ac54fecbcbc1
Jul 09 14:54:54.475661 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.475643    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 14:54:54.478646 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:54.478619    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod842163ee6bc7db204a9ad24049bf1028.slice/crio-5e0aad6be2e3f3334dce49975fb7e49a8a2e8fa5a1990cd38be5dcea247f8e6b WatchSource:0}: Error finding container 5e0aad6be2e3f3334dce49975fb7e49a8a2e8fa5a1990cd38be5dcea247f8e6b: Status 404 returned error can't find the container with id 5e0aad6be2e3f3334dce49975fb7e49a8a2e8fa5a1990cd38be5dcea247f8e6b
Jul 09 14:54:54.560152 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.560115    2575 apiserver.go:52] "Watching apiserver"
Jul 09 14:54:54.569504 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.569482    2575 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 09 14:54:54.571590 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.571569    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-fs6ww","openshift-ovn-kubernetes/ovnkube-node-zx64x","kube-system/global-pull-secret-syncer-f6rbl","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6v5hh","openshift-dns/node-resolver-xmx5q","openshift-image-registry/node-ca-zxwhs","openshift-multus/multus-additional-cni-plugins-lhnsd","openshift-multus/network-metrics-daemon-jpn9b","openshift-network-operator/iptables-alerter-2snzr","kube-system/konnectivity-agent-2pbcc","kube-system/kube-apiserver-proxy-ip-10-0-137-94.ec2.internal","openshift-cluster-node-tuning-operator/tuned-4mmjb","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-94.ec2.internal","openshift-multus/multus-qbpxv"]
Jul 09 14:54:54.576426 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.576403    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lhnsd"
Jul 09 14:54:54.578419 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.578402    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jpn9b"
Jul 09 14:54:54.578499 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:54:54.578477    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jpn9b" podUID="c37b4281-e19b-453c-aca5-f3fa37933b67"
Jul 09 14:54:54.579079 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.579064    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 09 14:54:54.579189 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.579137    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 09 14:54:54.579189 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.579179    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 09 14:54:54.579294 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.579240    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 09 14:54:54.579294 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.579281    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-zmgzp\""
Jul 09 14:54:54.579367 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.579287    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 09 14:54:54.580942 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.580921    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f6rbl"
Jul 09 14:54:54.581042 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:54:54.580982    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f6rbl" podUID="bf25b5cc-fd7d-4383-ae3f-6a2fc1df007e"
Jul 09 14:54:54.583085 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.583068    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6v5hh"
Jul 09 14:54:54.585280 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.585254    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xmx5q"
Jul 09 14:54:54.585377 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.585292    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 09 14:54:54.585377 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.585362    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-dj7kh\""
Jul 09 14:54:54.585484 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.585465    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 09 14:54:54.585658 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.585643    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 09 14:54:54.587357 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.587336    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 09 14:54:54.587543 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.587507    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-952l4\""
Jul 09 14:54:54.587620 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.587555    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 09 14:54:54.587620 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.587578    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zxwhs"
Jul 09 14:54:54.589741 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.589720    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2snzr"
Jul 09 14:54:54.589838 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.589810    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 09 14:54:54.589838 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.589823    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 09 14:54:54.589957 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.589912    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-7rdxb\""
Jul 09 14:54:54.590185 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.590171    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 09 14:54:54.591804 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.591786    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-wqxq7\""
Jul 09 14:54:54.592013 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.591998    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fs6ww"
Jul 09 14:54:54.592072 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:54:54.592054    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fs6ww" podUID="ae071a8e-6ae7-4330-b5e8-776283e86b63"
Jul 09 14:54:54.592251 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.592234    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 09 14:54:54.592312 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.592257    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 09 14:54:54.592461 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.592448    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 09 14:54:54.594422 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.594406    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zx64x"
Jul 09 14:54:54.596884 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.596865    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2pbcc"
Jul 09 14:54:54.597190 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.597175    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 09 14:54:54.597190 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.597194    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-9rjhf\""
Jul 09 14:54:54.597335 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.597212    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 09 14:54:54.597335 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.597260    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 09 14:54:54.597436 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.597345    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 09 14:54:54.598385 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.598371    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 09 14:54:54.598385 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.598380    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 09 14:54:54.599096 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.599079    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 09 14:54:54.599373 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.599359    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 09 14:54:54.599423 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.599411    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qbpxv"
Jul 09 14:54:54.599559 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.599546    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-pf65n\""
Jul 09 14:54:54.600159 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.600142    2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 09 14:54:54.601799 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.601782    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 09 14:54:54.601875 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.601795    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4mmjb"
Jul 09 14:54:54.602309 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.602290    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-hd6sz\""
Jul 09 14:54:54.605000 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.604602    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 09 14:54:54.605000 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.604759    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 09 14:54:54.605443 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.605424    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-tnvqv\""
Jul 09 14:54:54.612773 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.612754    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2bsr\" (UniqueName: \"kubernetes.io/projected/ff57ad35-41c5-4e84-af96-bf07b8b1a69e-kube-api-access-w2bsr\") pod \"tuned-4mmjb\" (UID: \"ff57ad35-41c5-4e84-af96-bf07b8b1a69e\") " pod="openshift-cluster-node-tuning-operator/tuned-4mmjb"
Jul 09 14:54:54.612868 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.612778    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/779ead75-a855-4c93-bfdf-c38546b8a181-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lhnsd\" (UID: \"779ead75-a855-4c93-bfdf-c38546b8a181\") " pod="openshift-multus/multus-additional-cni-plugins-lhnsd"
Jul 09 14:54:54.612868 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.612794    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/030200a1-2c06-4390-ab1b-d3e79bd705f2-host\") pod \"node-ca-zxwhs\" (UID: \"030200a1-2c06-4390-ab1b-d3e79bd705f2\") " pod="openshift-image-registry/node-ca-zxwhs"
Jul 09 14:54:54.612868 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.612809    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/40837b99-6d03-4623-af26-ff7de0ff8baa-ovnkube-script-lib\") pod \"ovnkube-node-zx64x\" (UID: \"40837b99-6d03-4623-af26-ff7de0ff8baa\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx64x"
Jul 09 14:54:54.612868 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.612827    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ff57ad35-41c5-4e84-af96-bf07b8b1a69e-etc-sysconfig\") pod \"tuned-4mmjb\" (UID: \"ff57ad35-41c5-4e84-af96-bf07b8b1a69e\") " pod="openshift-cluster-node-tuning-operator/tuned-4mmjb"
Jul 09 14:54:54.612868 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.612863    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/20ab37e4-d0b4-4298-bd29-c05f465cd6b0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6v5hh\" (UID: \"20ab37e4-d0b4-4298-bd29-c05f465cd6b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6v5hh"
Jul 09 14:54:54.613099 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.612883    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/40837b99-6d03-4623-af26-ff7de0ff8baa-host-slash\") pod \"ovnkube-node-zx64x\" (UID: \"40837b99-6d03-4623-af26-ff7de0ff8baa\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx64x"
Jul 09 14:54:54.613099 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.612913    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/40837b99-6d03-4623-af26-ff7de0ff8baa-node-log\") pod \"ovnkube-node-zx64x\" (UID: \"40837b99-6d03-4623-af26-ff7de0ff8baa\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx64x"
Jul 09 14:54:54.613099 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.612937    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/40837b99-6d03-4623-af26-ff7de0ff8baa-host-cni-bin\") pod \"ovnkube-node-zx64x\" (UID: \"40837b99-6d03-4623-af26-ff7de0ff8baa\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx64x"
Jul 09 14:54:54.613099 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.612955    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c37b4281-e19b-453c-aca5-f3fa37933b67-metrics-certs\") pod \"network-metrics-daemon-jpn9b\" (UID: \"c37b4281-e19b-453c-aca5-f3fa37933b67\") " pod="openshift-multus/network-metrics-daemon-jpn9b"
Jul 09 14:54:54.613099 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.612969    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ff57ad35-41c5-4e84-af96-bf07b8b1a69e-etc-sysctl-conf\") pod \"tuned-4mmjb\" (UID: \"ff57ad35-41c5-4e84-af96-bf07b8b1a69e\") " pod="openshift-cluster-node-tuning-operator/tuned-4mmjb"
Jul 09 14:54:54.613099 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.612989    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bf25b5cc-fd7d-4383-ae3f-6a2fc1df007e-dbus\") pod \"global-pull-secret-syncer-f6rbl\" (UID: \"bf25b5cc-fd7d-4383-ae3f-6a2fc1df007e\") " pod="kube-system/global-pull-secret-syncer-f6rbl"
Jul 09 14:54:54.613099 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.613021    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/20ab37e4-d0b4-4298-bd29-c05f465cd6b0-etc-selinux\") pod \"aws-ebs-csi-driver-node-6v5hh\" (UID: \"20ab37e4-d0b4-4298-bd29-c05f465cd6b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6v5hh"
Jul 09 14:54:54.613099 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.613042    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/40837b99-6d03-4623-af26-ff7de0ff8baa-log-socket\") pod \"ovnkube-node-zx64x\" (UID: \"40837b99-6d03-4623-af26-ff7de0ff8baa\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx64x"
Jul 09 14:54:54.613099 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.613058    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/40837b99-6d03-4623-af26-ff7de0ff8baa-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zx64x\" (UID: \"40837b99-6d03-4623-af26-ff7de0ff8baa\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx64x"
Jul 09 14:54:54.613099 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.613078    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ffe714b8-b418-41dd-8e65-e0467b6fa27b-host-slash\") pod \"iptables-alerter-2snzr\" (UID: \"ffe714b8-b418-41dd-8e65-e0467b6fa27b\") " pod="openshift-network-operator/iptables-alerter-2snzr"
Jul 09 14:54:54.613099 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.613097    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1f1e277c-317b-4031-af87-92c25d515f6e-multus-daemon-config\") pod \"multus-qbpxv\" (UID: \"1f1e277c-317b-4031-af87-92c25d515f6e\") " pod="openshift-multus/multus-qbpxv"
Jul 09 14:54:54.613618 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.613113    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff57ad35-41c5-4e84-af96-bf07b8b1a69e-etc-kubernetes\") pod \"tuned-4mmjb\" (UID: \"ff57ad35-41c5-4e84-af96-bf07b8b1a69e\") " pod="openshift-cluster-node-tuning-operator/tuned-4mmjb"
Jul 09 14:54:54.613618 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.613127    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bf25b5cc-fd7d-4383-ae3f-6a2fc1df007e-original-pull-secret\") pod \"global-pull-secret-syncer-f6rbl\" (UID: \"bf25b5cc-fd7d-4383-ae3f-6a2fc1df007e\") " pod="kube-system/global-pull-secret-syncer-f6rbl"
Jul 09 14:54:54.613618 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.613144    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/40837b99-6d03-4623-af26-ff7de0ff8baa-systemd-units\") pod \"ovnkube-node-zx64x\" (UID: \"40837b99-6d03-4623-af26-ff7de0ff8baa\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx64x"
Jul 09 14:54:54.613618 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.613166    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ff57ad35-41c5-4e84-af96-bf07b8b1a69e-lib-modules\") pod \"tuned-4mmjb\" (UID: \"ff57ad35-41c5-4e84-af96-bf07b8b1a69e\") " pod="openshift-cluster-node-tuning-operator/tuned-4mmjb"
Jul 09 14:54:54.613618 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.613186    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ff57ad35-41c5-4e84-af96-bf07b8b1a69e-tmp\") pod \"tuned-4mmjb\" (UID: \"ff57ad35-41c5-4e84-af96-bf07b8b1a69e\") " pod="openshift-cluster-node-tuning-operator/tuned-4mmjb"
Jul 09 14:54:54.613618 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.613201    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/20ab37e4-d0b4-4298-bd29-c05f465cd6b0-socket-dir\") pod \"aws-ebs-csi-driver-node-6v5hh\" (UID: \"20ab37e4-d0b4-4298-bd29-c05f465cd6b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6v5hh"
Jul 09 14:54:54.613618 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.613214    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/40837b99-6d03-4623-af26-ff7de0ff8baa-host-cni-netd\") pod \"ovnkube-node-zx64x\" (UID: \"40837b99-6d03-4623-af26-ff7de0ff8baa\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx64x"
Jul 09 14:54:54.613618 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.613243    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/40837b99-6d03-4623-af26-ff7de0ff8baa-ovnkube-config\") pod \"ovnkube-node-zx64x\" (UID: \"40837b99-6d03-4623-af26-ff7de0ff8baa\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx64x"
Jul 09 14:54:54.613618 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.613266    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1f1e277c-317b-4031-af87-92c25d515f6e-host-var-lib-cni-multus\") pod \"multus-qbpxv\" (UID: \"1f1e277c-317b-4031-af87-92c25d515f6e\") " pod="openshift-multus/multus-qbpxv"
Jul 09 14:54:54.613618 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.613290    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ff57ad35-41c5-4e84-af96-bf07b8b1a69e-run\") pod \"tuned-4mmjb\" (UID: \"ff57ad35-41c5-4e84-af96-bf07b8b1a69e\") " pod="openshift-cluster-node-tuning-operator/tuned-4mmjb"
Jul 09 14:54:54.613618 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.613318    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ff57ad35-41c5-4e84-af96-bf07b8b1a69e-sys\") pod \"tuned-4mmjb\" (UID: \"ff57ad35-41c5-4e84-af96-bf07b8b1a69e\") " pod="openshift-cluster-node-tuning-operator/tuned-4mmjb"
Jul 09 14:54:54.613618 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.613341    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ff57ad35-41c5-4e84-af96-bf07b8b1a69e-host\") pod \"tuned-4mmjb\" (UID: \"ff57ad35-41c5-4e84-af96-bf07b8b1a69e\") " pod="openshift-cluster-node-tuning-operator/tuned-4mmjb"
Jul 09 14:54:54.613618 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.613367    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/20ab37e4-d0b4-4298-bd29-c05f465cd6b0-device-dir\") pod \"aws-ebs-csi-driver-node-6v5hh\" (UID: \"20ab37e4-d0b4-4298-bd29-c05f465cd6b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6v5hh"
Jul 09 14:54:54.613618 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.613392    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fcff5fbe-84d3-47a1-9cde-4db751cbaae6-hosts-file\") pod \"node-resolver-xmx5q\" (UID: \"fcff5fbe-84d3-47a1-9cde-4db751cbaae6\") " pod="openshift-dns/node-resolver-xmx5q"
Jul 09 14:54:54.614287 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.613412    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/40837b99-6d03-4623-af26-ff7de0ff8baa-host-run-netns\") pod \"ovnkube-node-zx64x\" (UID: \"40837b99-6d03-4623-af26-ff7de0ff8baa\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx64x"
Jul 09 14:54:54.614287 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.613429    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/40837b99-6d03-4623-af26-ff7de0ff8baa-etc-openvswitch\") pod \"ovnkube-node-zx64x\" (UID: \"40837b99-6d03-4623-af26-ff7de0ff8baa\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx64x"
Jul 09 14:54:54.614287 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.613444    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6e3ee08b-fbd7-4ff0-b953-fd749858497c-konnectivity-ca\") pod \"konnectivity-agent-2pbcc\" (UID: \"6e3ee08b-fbd7-4ff0-b953-fd749858497c\") " pod="kube-system/konnectivity-agent-2pbcc"
Jul 09 14:54:54.614287 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.613465    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1f1e277c-317b-4031-af87-92c25d515f6e-multus-socket-dir-parent\") pod \"multus-qbpxv\" (UID: \"1f1e277c-317b-4031-af87-92c25d515f6e\") " pod="openshift-multus/multus-qbpxv"
Jul 09 14:54:54.614287 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.613497    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/030200a1-2c06-4390-ab1b-d3e79bd705f2-serviceca\") pod \"node-ca-zxwhs\" (UID: \"030200a1-2c06-4390-ab1b-d3e79bd705f2\") " pod="openshift-image-registry/node-ca-zxwhs"
Jul 09 14:54:54.614287 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.613514    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpmbp\" (UniqueName: \"kubernetes.io/projected/030200a1-2c06-4390-ab1b-d3e79bd705f2-kube-api-access-bpmbp\") pod \"node-ca-zxwhs\" (UID: \"030200a1-2c06-4390-ab1b-d3e79bd705f2\") " pod="openshift-image-registry/node-ca-zxwhs"
Jul 09 14:54:54.614287 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.613528    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/40837b99-6d03-4623-af26-ff7de0ff8baa-run-ovn\") pod \"ovnkube-node-zx64x\" (UID: \"40837b99-6d03-4623-af26-ff7de0ff8baa\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx64x"
Jul 09 14:54:54.614287 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.613542    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n595r\" (UniqueName: \"kubernetes.io/projected/40837b99-6d03-4623-af26-ff7de0ff8baa-kube-api-access-n595r\") pod \"ovnkube-node-zx64x\" (UID: \"40837b99-6d03-4623-af26-ff7de0ff8baa\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx64x"
Jul 09 14:54:54.614287 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.613557    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4l4fq\" (UniqueName: \"kubernetes.io/projected/c37b4281-e19b-453c-aca5-f3fa37933b67-kube-api-access-4l4fq\") pod \"network-metrics-daemon-jpn9b\" (UID: \"c37b4281-e19b-453c-aca5-f3fa37933b67\") " pod="openshift-multus/network-metrics-daemon-jpn9b"
Jul 09 14:54:54.614287 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.613572    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjx7d\" (UniqueName: \"kubernetes.io/projected/ae071a8e-6ae7-4330-b5e8-776283e86b63-kube-api-access-rjx7d\") pod \"network-check-target-fs6ww\" (UID: \"ae071a8e-6ae7-4330-b5e8-776283e86b63\") " pod="openshift-network-diagnostics/network-check-target-fs6ww"
Jul 09 14:54:54.614287 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.613587    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1f1e277c-317b-4031-af87-92c25d515f6e-multus-cni-dir\") pod \"multus-qbpxv\" (UID: \"1f1e277c-317b-4031-af87-92c25d515f6e\") " pod="openshift-multus/multus-qbpxv"
Jul 09 14:54:54.614287 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.613600    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1f1e277c-317b-4031-af87-92c25d515f6e-cni-binary-copy\") pod \"multus-qbpxv\" (UID: \"1f1e277c-317b-4031-af87-92c25d515f6e\") " pod="openshift-multus/multus-qbpxv"
Jul 09 14:54:54.614287 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.613614    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1f1e277c-317b-4031-af87-92c25d515f6e-host-run-multus-certs\") pod \"multus-qbpxv\" (UID: \"1f1e277c-317b-4031-af87-92c25d515f6e\") " pod="openshift-multus/multus-qbpxv"
Jul 09 14:54:54.614287 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.613630    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/779ead75-a855-4c93-bfdf-c38546b8a181-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lhnsd\" (UID: \"779ead75-a855-4c93-bfdf-c38546b8a181\") " pod="openshift-multus/multus-additional-cni-plugins-lhnsd"
Jul 09 14:54:54.614986 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.613644    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1f1e277c-317b-4031-af87-92c25d515f6e-multus-conf-dir\") pod \"multus-qbpxv\" (UID: \"1f1e277c-317b-4031-af87-92c25d515f6e\") " pod="openshift-multus/multus-qbpxv"
Jul 09 14:54:54.614986 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.613657    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1f1e277c-317b-4031-af87-92c25d515f6e-etc-kubernetes\") pod \"multus-qbpxv\" (UID: \"1f1e277c-317b-4031-af87-92c25d515f6e\") " pod="openshift-multus/multus-qbpxv"
Jul 09 14:54:54.614986 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.613683    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ff57ad35-41c5-4e84-af96-bf07b8b1a69e-etc-tuned\") pod \"tuned-4mmjb\" (UID: \"ff57ad35-41c5-4e84-af96-bf07b8b1a69e\") " pod="openshift-cluster-node-tuning-operator/tuned-4mmjb"
Jul 09 14:54:54.614986 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.613702    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/779ead75-a855-4c93-bfdf-c38546b8a181-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lhnsd\" (UID: \"779ead75-a855-4c93-bfdf-c38546b8a181\") " pod="openshift-multus/multus-additional-cni-plugins-lhnsd"
Jul 09 14:54:54.614986 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.613735    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bf25b5cc-fd7d-4383-ae3f-6a2fc1df007e-kubelet-config\") pod \"global-pull-secret-syncer-f6rbl\" (UID: \"bf25b5cc-fd7d-4383-ae3f-6a2fc1df007e\") " pod="kube-system/global-pull-secret-syncer-f6rbl"
Jul 09 14:54:54.614986 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.613749    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkp2x\" (UniqueName: \"kubernetes.io/projected/20ab37e4-d0b4-4298-bd29-c05f465cd6b0-kube-api-access-wkp2x\") pod \"aws-ebs-csi-driver-node-6v5hh\" (UID: \"20ab37e4-d0b4-4298-bd29-c05f465cd6b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6v5hh"
Jul 09 14:54:54.614986 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.613763    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/40837b99-6d03-4623-af26-ff7de0ff8baa-run-systemd\") pod \"ovnkube-node-zx64x\" (UID: \"40837b99-6d03-4623-af26-ff7de0ff8baa\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx64x"
Jul 09 14:54:54.614986 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.613779    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/40837b99-6d03-4623-af26-ff7de0ff8baa-var-lib-openvswitch\") pod \"ovnkube-node-zx64x\" (UID: \"40837b99-6d03-4623-af26-ff7de0ff8baa\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx64x"
Jul 09 14:54:54.614986 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.613808    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1f1e277c-317b-4031-af87-92c25d515f6e-cnibin\") pod \"multus-qbpxv\" (UID: \"1f1e277c-317b-4031-af87-92c25d515f6e\") " pod="openshift-multus/multus-qbpxv"
Jul 09 14:54:54.614986 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.613824    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1f1e277c-317b-4031-af87-92c25d515f6e-host-run-k8s-cni-cncf-io\") pod \"multus-qbpxv\" (UID: \"1f1e277c-317b-4031-af87-92c25d515f6e\") " pod="openshift-multus/multus-qbpxv"
Jul 09 14:54:54.614986 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.613837    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1f1e277c-317b-4031-af87-92c25d515f6e-host-var-lib-kubelet\") pod \"multus-qbpxv\" (UID: \"1f1e277c-317b-4031-af87-92c25d515f6e\") " pod="openshift-multus/multus-qbpxv"
Jul 09 14:54:54.614986 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.613851    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/779ead75-a855-4c93-bfdf-c38546b8a181-cnibin\") pod \"multus-additional-cni-plugins-lhnsd\" (UID: \"779ead75-a855-4c93-bfdf-c38546b8a181\") " pod="openshift-multus/multus-additional-cni-plugins-lhnsd"
Jul 09 14:54:54.614986 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.613888    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/779ead75-a855-4c93-bfdf-c38546b8a181-cni-binary-copy\") pod \"multus-additional-cni-plugins-lhnsd\" (UID: \"779ead75-a855-4c93-bfdf-c38546b8a181\") " pod="openshift-multus/multus-additional-cni-plugins-lhnsd"
Jul 09 14:54:54.614986 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.613906    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/40837b99-6d03-4623-af26-ff7de0ff8baa-host-run-ovn-kubernetes\") pod \"ovnkube-node-zx64x\" (UID: \"40837b99-6d03-4623-af26-ff7de0ff8baa\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx64x"
Jul 09 14:54:54.615819 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.613919    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1f1e277c-317b-4031-af87-92c25d515f6e-hostroot\") pod \"multus-qbpxv\" (UID: \"1f1e277c-317b-4031-af87-92c25d515f6e\") " pod="openshift-multus/multus-qbpxv"
Jul 09 14:54:54.615819 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.613942    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t449h\" (UniqueName: \"kubernetes.io/projected/1f1e277c-317b-4031-af87-92c25d515f6e-kube-api-access-t449h\") pod \"multus-qbpxv\" (UID: \"1f1e277c-317b-4031-af87-92c25d515f6e\") " pod="openshift-multus/multus-qbpxv"
Jul 09 14:54:54.615819 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.613971    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ff57ad35-41c5-4e84-af96-bf07b8b1a69e-etc-sysctl-d\") pod \"tuned-4mmjb\" (UID: \"ff57ad35-41c5-4e84-af96-bf07b8b1a69e\") " pod="openshift-cluster-node-tuning-operator/tuned-4mmjb"
Jul 09 14:54:54.615819 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.613988    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff57ad35-41c5-4e84-af96-bf07b8b1a69e-var-lib-kubelet\") pod \"tuned-4mmjb\" (UID: \"ff57ad35-41c5-4e84-af96-bf07b8b1a69e\") " pod="openshift-cluster-node-tuning-operator/tuned-4mmjb"
Jul 09 14:54:54.615819 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.614010    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/779ead75-a855-4c93-bfdf-c38546b8a181-os-release\") pod \"multus-additional-cni-plugins-lhnsd\" (UID: \"779ead75-a855-4c93-bfdf-c38546b8a181\") " pod="openshift-multus/multus-additional-cni-plugins-lhnsd"
Jul 09 14:54:54.615819 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.614036    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jl88p\" (UniqueName: \"kubernetes.io/projected/779ead75-a855-4c93-bfdf-c38546b8a181-kube-api-access-jl88p\") pod \"multus-additional-cni-plugins-lhnsd\" (UID: \"779ead75-a855-4c93-bfdf-c38546b8a181\") " pod="openshift-multus/multus-additional-cni-plugins-lhnsd"
Jul 09 14:54:54.615819 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.614055    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/40837b99-6d03-4623-af26-ff7de0ff8baa-run-openvswitch\") pod \"ovnkube-node-zx64x\" (UID: \"40837b99-6d03-4623-af26-ff7de0ff8baa\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx64x"
Jul 09 14:54:54.615819 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.614077    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjh6f\" (UniqueName: \"kubernetes.io/projected/ffe714b8-b418-41dd-8e65-e0467b6fa27b-kube-api-access-qjh6f\") pod \"iptables-alerter-2snzr\" (UID: \"ffe714b8-b418-41dd-8e65-e0467b6fa27b\") " pod="openshift-network-operator/iptables-alerter-2snzr"
Jul 09 14:54:54.615819 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.614099    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1f1e277c-317b-4031-af87-92c25d515f6e-os-release\") pod \"multus-qbpxv\" (UID: \"1f1e277c-317b-4031-af87-92c25d515f6e\") " pod="openshift-multus/multus-qbpxv"
Jul 09 14:54:54.615819 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.614115    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ff57ad35-41c5-4e84-af96-bf07b8b1a69e-etc-modprobe-d\") pod \"tuned-4mmjb\" (UID: \"ff57ad35-41c5-4e84-af96-bf07b8b1a69e\") " pod="openshift-cluster-node-tuning-operator/tuned-4mmjb"
Jul 09 14:54:54.615819 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.614132    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/779ead75-a855-4c93-bfdf-c38546b8a181-system-cni-dir\") pod \"multus-additional-cni-plugins-lhnsd\" (UID: \"779ead75-a855-4c93-bfdf-c38546b8a181\") " pod="openshift-multus/multus-additional-cni-plugins-lhnsd"
Jul 09 14:54:54.615819 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.614166    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/20ab37e4-d0b4-4298-bd29-c05f465cd6b0-registration-dir\") pod \"aws-ebs-csi-driver-node-6v5hh\" (UID: \"20ab37e4-d0b4-4298-bd29-c05f465cd6b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6v5hh"
Jul 09 14:54:54.615819 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.614187    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/20ab37e4-d0b4-4298-bd29-c05f465cd6b0-sys-fs\") pod \"aws-ebs-csi-driver-node-6v5hh\" (UID: \"20ab37e4-d0b4-4298-bd29-c05f465cd6b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6v5hh"
Jul 09 14:54:54.616474 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.614204    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ffe714b8-b418-41dd-8e65-e0467b6fa27b-iptables-alerter-script\") pod \"iptables-alerter-2snzr\" (UID: \"ffe714b8-b418-41dd-8e65-e0467b6fa27b\") " pod="openshift-network-operator/iptables-alerter-2snzr"
Jul 09 14:54:54.616474 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.614218    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6e3ee08b-fbd7-4ff0-b953-fd749858497c-agent-certs\") pod \"konnectivity-agent-2pbcc\" (UID: \"6e3ee08b-fbd7-4ff0-b953-fd749858497c\") " pod="kube-system/konnectivity-agent-2pbcc"
Jul 09 14:54:54.616474 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.614233    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1f1e277c-317b-4031-af87-92c25d515f6e-system-cni-dir\") pod \"multus-qbpxv\" (UID: \"1f1e277c-317b-4031-af87-92c25d515f6e\") " pod="openshift-multus/multus-qbpxv"
Jul 09 14:54:54.616474 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.614256    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1f1e277c-317b-4031-af87-92c25d515f6e-host-var-lib-cni-bin\") pod \"multus-qbpxv\" (UID: \"1f1e277c-317b-4031-af87-92c25d515f6e\") " pod="openshift-multus/multus-qbpxv"
Jul 09 14:54:54.616474 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.614273    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ff57ad35-41c5-4e84-af96-bf07b8b1a69e-etc-systemd\") pod \"tuned-4mmjb\" (UID: \"ff57ad35-41c5-4e84-af96-bf07b8b1a69e\") " pod="openshift-cluster-node-tuning-operator/tuned-4mmjb"
Jul 09 14:54:54.616474 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.614286    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/40837b99-6d03-4623-af26-ff7de0ff8baa-host-kubelet\") pod \"ovnkube-node-zx64x\" (UID: \"40837b99-6d03-4623-af26-ff7de0ff8baa\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx64x"
Jul 09 14:54:54.616474 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.614299    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fcff5fbe-84d3-47a1-9cde-4db751cbaae6-tmp-dir\") pod \"node-resolver-xmx5q\" (UID: \"fcff5fbe-84d3-47a1-9cde-4db751cbaae6\") " pod="openshift-dns/node-resolver-xmx5q"
Jul 09 14:54:54.616474 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.614318    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n79w8\" (UniqueName: \"kubernetes.io/projected/fcff5fbe-84d3-47a1-9cde-4db751cbaae6-kube-api-access-n79w8\") pod \"node-resolver-xmx5q\" (UID: \"fcff5fbe-84d3-47a1-9cde-4db751cbaae6\") " pod="openshift-dns/node-resolver-xmx5q"
Jul 09 14:54:54.616474 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.614338    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/40837b99-6d03-4623-af26-ff7de0ff8baa-env-overrides\") pod \"ovnkube-node-zx64x\" (UID: \"40837b99-6d03-4623-af26-ff7de0ff8baa\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx64x"
Jul 09 14:54:54.616474 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.614354    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/40837b99-6d03-4623-af26-ff7de0ff8baa-ovn-node-metrics-cert\") pod \"ovnkube-node-zx64x\" (UID: \"40837b99-6d03-4623-af26-ff7de0ff8baa\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx64x"
Jul 09 14:54:54.616474 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.614368    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1f1e277c-317b-4031-af87-92c25d515f6e-host-run-netns\") pod \"multus-qbpxv\" (UID: \"1f1e277c-317b-4031-af87-92c25d515f6e\") " pod="openshift-multus/multus-qbpxv"
Jul 09 14:54:54.618197 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.618178    2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 09 14:54:54.655959 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.655937    2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-skd4d"
Jul 09 14:54:54.665153 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.665135    2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-skd4d"
Jul 09 14:54:54.700998 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.700976    2575 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 09 14:54:54.715345 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.715299    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/40837b99-6d03-4623-af26-ff7de0ff8baa-run-ovn\") pod \"ovnkube-node-zx64x\" (UID: \"40837b99-6d03-4623-af26-ff7de0ff8baa\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx64x"
Jul 09 14:54:54.715345 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.715325    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n595r\" (UniqueName: \"kubernetes.io/projected/40837b99-6d03-4623-af26-ff7de0ff8baa-kube-api-access-n595r\") pod \"ovnkube-node-zx64x\" (UID: \"40837b99-6d03-4623-af26-ff7de0ff8baa\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx64x"
Jul 09 14:54:54.715345 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.715341    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4l4fq\" (UniqueName: \"kubernetes.io/projected/c37b4281-e19b-453c-aca5-f3fa37933b67-kube-api-access-4l4fq\") pod \"network-metrics-daemon-jpn9b\" (UID: \"c37b4281-e19b-453c-aca5-f3fa37933b67\") " pod="openshift-multus/network-metrics-daemon-jpn9b"
Jul 09 14:54:54.715516 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.715357    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjx7d\" (UniqueName: \"kubernetes.io/projected/ae071a8e-6ae7-4330-b5e8-776283e86b63-kube-api-access-rjx7d\") pod \"network-check-target-fs6ww\" (UID: \"ae071a8e-6ae7-4330-b5e8-776283e86b63\") " pod="openshift-network-diagnostics/network-check-target-fs6ww"
Jul 09 14:54:54.715516 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.715372    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1f1e277c-317b-4031-af87-92c25d515f6e-multus-cni-dir\") pod \"multus-qbpxv\" (UID: \"1f1e277c-317b-4031-af87-92c25d515f6e\") " pod="openshift-multus/multus-qbpxv"
Jul 09 14:54:54.715516 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.715385    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1f1e277c-317b-4031-af87-92c25d515f6e-cni-binary-copy\") pod \"multus-qbpxv\" (UID: \"1f1e277c-317b-4031-af87-92c25d515f6e\") " pod="openshift-multus/multus-qbpxv"
Jul 09 14:54:54.715516 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.715400    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1f1e277c-317b-4031-af87-92c25d515f6e-host-run-multus-certs\") pod \"multus-qbpxv\" (UID: \"1f1e277c-317b-4031-af87-92c25d515f6e\") " pod="openshift-multus/multus-qbpxv"
Jul 09 14:54:54.715516 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.715442    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/40837b99-6d03-4623-af26-ff7de0ff8baa-run-ovn\") pod \"ovnkube-node-zx64x\" (UID: \"40837b99-6d03-4623-af26-ff7de0ff8baa\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx64x"
Jul 09 14:54:54.715516 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.715474    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/779ead75-a855-4c93-bfdf-c38546b8a181-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lhnsd\" (UID: \"779ead75-a855-4c93-bfdf-c38546b8a181\") " pod="openshift-multus/multus-additional-cni-plugins-lhnsd"
Jul 09 14:54:54.715516 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.715501    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1f1e277c-317b-4031-af87-92c25d515f6e-multus-conf-dir\") pod \"multus-qbpxv\" (UID: \"1f1e277c-317b-4031-af87-92c25d515f6e\") " pod="openshift-multus/multus-qbpxv"
Jul 09 14:54:54.715861 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.715522    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1f1e277c-317b-4031-af87-92c25d515f6e-host-run-multus-certs\") pod \"multus-qbpxv\" (UID: \"1f1e277c-317b-4031-af87-92c25d515f6e\") " pod="openshift-multus/multus-qbpxv"
Jul 09 14:54:54.715861 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.715525    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1f1e277c-317b-4031-af87-92c25d515f6e-etc-kubernetes\") pod \"multus-qbpxv\" (UID: \"1f1e277c-317b-4031-af87-92c25d515f6e\") " pod="openshift-multus/multus-qbpxv"
Jul 09 14:54:54.715861 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.715560    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ff57ad35-41c5-4e84-af96-bf07b8b1a69e-etc-tuned\") pod \"tuned-4mmjb\" (UID: \"ff57ad35-41c5-4e84-af96-bf07b8b1a69e\") " pod="openshift-cluster-node-tuning-operator/tuned-4mmjb"
Jul 09 14:54:54.715861 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.715561    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1f1e277c-317b-4031-af87-92c25d515f6e-etc-kubernetes\") pod \"multus-qbpxv\" (UID: \"1f1e277c-317b-4031-af87-92c25d515f6e\") " pod="openshift-multus/multus-qbpxv"
Jul 09 14:54:54.715861 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.715574    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1f1e277c-317b-4031-af87-92c25d515f6e-multus-conf-dir\") pod \"multus-qbpxv\" (UID: \"1f1e277c-317b-4031-af87-92c25d515f6e\") " pod="openshift-multus/multus-qbpxv"
Jul 09 14:54:54.715861 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.715585    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/779ead75-a855-4c93-bfdf-c38546b8a181-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lhnsd\" (UID: \"779ead75-a855-4c93-bfdf-c38546b8a181\") " pod="openshift-multus/multus-additional-cni-plugins-lhnsd"
Jul 09 14:54:54.715861 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.715624    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bf25b5cc-fd7d-4383-ae3f-6a2fc1df007e-kubelet-config\") pod \"global-pull-secret-syncer-f6rbl\" (UID: \"bf25b5cc-fd7d-4383-ae3f-6a2fc1df007e\") " pod="kube-system/global-pull-secret-syncer-f6rbl"
Jul 09 14:54:54.715861 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.715652    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkp2x\" (UniqueName: \"kubernetes.io/projected/20ab37e4-d0b4-4298-bd29-c05f465cd6b0-kube-api-access-wkp2x\") pod \"aws-ebs-csi-driver-node-6v5hh\" (UID: \"20ab37e4-d0b4-4298-bd29-c05f465cd6b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6v5hh"
Jul 09 14:54:54.715861 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.715676    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/40837b99-6d03-4623-af26-ff7de0ff8baa-run-systemd\") pod \"ovnkube-node-zx64x\" (UID: \"40837b99-6d03-4623-af26-ff7de0ff8baa\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx64x"
Jul 09 14:54:54.715861 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.715691    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/779ead75-a855-4c93-bfdf-c38546b8a181-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lhnsd\" (UID: \"779ead75-a855-4c93-bfdf-c38546b8a181\") " pod="openshift-multus/multus-additional-cni-plugins-lhnsd"
Jul 09 14:54:54.715861 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.715702    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/40837b99-6d03-4623-af26-ff7de0ff8baa-var-lib-openvswitch\") pod \"ovnkube-node-zx64x\" (UID: \"40837b99-6d03-4623-af26-ff7de0ff8baa\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx64x"
Jul 09 14:54:54.715861 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.715725    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bf25b5cc-fd7d-4383-ae3f-6a2fc1df007e-kubelet-config\") pod \"global-pull-secret-syncer-f6rbl\" (UID: \"bf25b5cc-fd7d-4383-ae3f-6a2fc1df007e\") " pod="kube-system/global-pull-secret-syncer-f6rbl"
Jul 09 14:54:54.715861 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.715758    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/40837b99-6d03-4623-af26-ff7de0ff8baa-var-lib-openvswitch\") pod \"ovnkube-node-zx64x\" (UID: \"40837b99-6d03-4623-af26-ff7de0ff8baa\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx64x"
Jul 09 14:54:54.715861 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.715761    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1f1e277c-317b-4031-af87-92c25d515f6e-cnibin\") pod \"multus-qbpxv\" (UID: \"1f1e277c-317b-4031-af87-92c25d515f6e\") " pod="openshift-multus/multus-qbpxv"
Jul 09 14:54:54.716512 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.715794    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1f1e277c-317b-4031-af87-92c25d515f6e-host-run-k8s-cni-cncf-io\") pod \"multus-qbpxv\" (UID: \"1f1e277c-317b-4031-af87-92c25d515f6e\") " pod="openshift-multus/multus-qbpxv"
Jul 09 14:54:54.716512 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.715803    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/40837b99-6d03-4623-af26-ff7de0ff8baa-run-systemd\") pod \"ovnkube-node-zx64x\" (UID: \"40837b99-6d03-4623-af26-ff7de0ff8baa\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx64x"
Jul 09 14:54:54.716512 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.715751    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1f1e277c-317b-4031-af87-92c25d515f6e-multus-cni-dir\") pod \"multus-qbpxv\" (UID: \"1f1e277c-317b-4031-af87-92c25d515f6e\") " pod="openshift-multus/multus-qbpxv"
Jul 09 14:54:54.716512 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.715821    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1f1e277c-317b-4031-af87-92c25d515f6e-host-var-lib-kubelet\") pod \"multus-qbpxv\" (UID: \"1f1e277c-317b-4031-af87-92c25d515f6e\") " pod="openshift-multus/multus-qbpxv"
Jul 09 14:54:54.716512 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.715850    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1f1e277c-317b-4031-af87-92c25d515f6e-cnibin\") pod \"multus-qbpxv\" (UID: \"1f1e277c-317b-4031-af87-92c25d515f6e\") " pod="openshift-multus/multus-qbpxv"
Jul 09 14:54:54.716512 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.715875    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/779ead75-a855-4c93-bfdf-c38546b8a181-cnibin\") pod \"multus-additional-cni-plugins-lhnsd\" (UID: \"779ead75-a855-4c93-bfdf-c38546b8a181\") " pod="openshift-multus/multus-additional-cni-plugins-lhnsd"
Jul 09 14:54:54.716512 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.715899    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1f1e277c-317b-4031-af87-92c25d515f6e-host-var-lib-kubelet\") pod \"multus-qbpxv\" (UID: \"1f1e277c-317b-4031-af87-92c25d515f6e\") " pod="openshift-multus/multus-qbpxv"
Jul 09 14:54:54.716512 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.715903    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/779ead75-a855-4c93-bfdf-c38546b8a181-cni-binary-copy\") pod \"multus-additional-cni-plugins-lhnsd\" (UID: \"779ead75-a855-4c93-bfdf-c38546b8a181\") " pod="openshift-multus/multus-additional-cni-plugins-lhnsd"
Jul 09 14:54:54.716512 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.715933    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/40837b99-6d03-4623-af26-ff7de0ff8baa-host-run-ovn-kubernetes\") pod \"ovnkube-node-zx64x\" (UID: \"40837b99-6d03-4623-af26-ff7de0ff8baa\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx64x"
Jul 09 14:54:54.716512 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.715950    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/779ead75-a855-4c93-bfdf-c38546b8a181-cnibin\") pod \"multus-additional-cni-plugins-lhnsd\" (UID: \"779ead75-a855-4c93-bfdf-c38546b8a181\") " pod="openshift-multus/multus-additional-cni-plugins-lhnsd"
Jul 09 14:54:54.716512 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.715963    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1f1e277c-317b-4031-af87-92c25d515f6e-hostroot\") pod \"multus-qbpxv\" (UID: \"1f1e277c-317b-4031-af87-92c25d515f6e\") " pod="openshift-multus/multus-qbpxv"
Jul 09 14:54:54.716512 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.715990    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t449h\" (UniqueName: \"kubernetes.io/projected/1f1e277c-317b-4031-af87-92c25d515f6e-kube-api-access-t449h\") pod \"multus-qbpxv\" (UID: \"1f1e277c-317b-4031-af87-92c25d515f6e\") " pod="openshift-multus/multus-qbpxv"
Jul 09 14:54:54.716512 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.716007    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/40837b99-6d03-4623-af26-ff7de0ff8baa-host-run-ovn-kubernetes\") pod \"ovnkube-node-zx64x\" (UID: \"40837b99-6d03-4623-af26-ff7de0ff8baa\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx64x"
Jul 09 14:54:54.716512 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.715916    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1f1e277c-317b-4031-af87-92c25d515f6e-host-run-k8s-cni-cncf-io\") pod \"multus-qbpxv\" (UID: \"1f1e277c-317b-4031-af87-92c25d515f6e\") " pod="openshift-multus/multus-qbpxv"
Jul 09 14:54:54.716512 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.716011    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1f1e277c-317b-4031-af87-92c25d515f6e-cni-binary-copy\") pod \"multus-qbpxv\" (UID: \"1f1e277c-317b-4031-af87-92c25d515f6e\") " pod="openshift-multus/multus-qbpxv"
Jul 09 14:54:54.717330 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.716019    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ff57ad35-41c5-4e84-af96-bf07b8b1a69e-etc-sysctl-d\") pod \"tuned-4mmjb\" (UID: \"ff57ad35-41c5-4e84-af96-bf07b8b1a69e\") " pod="openshift-cluster-node-tuning-operator/tuned-4mmjb"
Jul 09 14:54:54.717330 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.716060    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1f1e277c-317b-4031-af87-92c25d515f6e-hostroot\") pod \"multus-qbpxv\" (UID: \"1f1e277c-317b-4031-af87-92c25d515f6e\") " pod="openshift-multus/multus-qbpxv"
Jul 09 14:54:54.717330 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.716065    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff57ad35-41c5-4e84-af96-bf07b8b1a69e-var-lib-kubelet\") pod \"tuned-4mmjb\" (UID: \"ff57ad35-41c5-4e84-af96-bf07b8b1a69e\") " pod="openshift-cluster-node-tuning-operator/tuned-4mmjb"
Jul 09 14:54:54.717330 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.716094    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/779ead75-a855-4c93-bfdf-c38546b8a181-os-release\") pod \"multus-additional-cni-plugins-lhnsd\" (UID: \"779ead75-a855-4c93-bfdf-c38546b8a181\") " pod="openshift-multus/multus-additional-cni-plugins-lhnsd"
Jul 09 14:54:54.717330 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.716119    2575 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 09 14:54:54.717330 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.716151    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/779ead75-a855-4c93-bfdf-c38546b8a181-os-release\") pod \"multus-additional-cni-plugins-lhnsd\" (UID: \"779ead75-a855-4c93-bfdf-c38546b8a181\") " pod="openshift-multus/multus-additional-cni-plugins-lhnsd"
Jul 09 14:54:54.717330 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.716208    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff57ad35-41c5-4e84-af96-bf07b8b1a69e-var-lib-kubelet\") pod \"tuned-4mmjb\" (UID: \"ff57ad35-41c5-4e84-af96-bf07b8b1a69e\") " pod="openshift-cluster-node-tuning-operator/tuned-4mmjb"
Jul 09 14:54:54.717330 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.716179    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jl88p\" (UniqueName: \"kubernetes.io/projected/779ead75-a855-4c93-bfdf-c38546b8a181-kube-api-access-jl88p\") pod \"multus-additional-cni-plugins-lhnsd\" (UID: \"779ead75-a855-4c93-bfdf-c38546b8a181\") " pod="openshift-multus/multus-additional-cni-plugins-lhnsd"
Jul 09 14:54:54.717330 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.716255    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/40837b99-6d03-4623-af26-ff7de0ff8baa-run-openvswitch\") pod \"ovnkube-node-zx64x\" (UID: \"40837b99-6d03-4623-af26-ff7de0ff8baa\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx64x"
Jul 09 14:54:54.717330 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.716282    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjh6f\" (UniqueName: \"kubernetes.io/projected/ffe714b8-b418-41dd-8e65-e0467b6fa27b-kube-api-access-qjh6f\") pod \"iptables-alerter-2snzr\" (UID: \"ffe714b8-b418-41dd-8e65-e0467b6fa27b\") " pod="openshift-network-operator/iptables-alerter-2snzr"
Jul 09 14:54:54.717330 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.716325    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/779ead75-a855-4c93-bfdf-c38546b8a181-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lhnsd\" (UID: \"779ead75-a855-4c93-bfdf-c38546b8a181\") " pod="openshift-multus/multus-additional-cni-plugins-lhnsd"
Jul 09 14:54:54.717330 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.716359    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/40837b99-6d03-4623-af26-ff7de0ff8baa-run-openvswitch\") pod \"ovnkube-node-zx64x\" (UID: \"40837b99-6d03-4623-af26-ff7de0ff8baa\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx64x"
Jul 09 14:54:54.717330 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.716368    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1f1e277c-317b-4031-af87-92c25d515f6e-os-release\") pod \"multus-qbpxv\" (UID: \"1f1e277c-317b-4031-af87-92c25d515f6e\") " pod="openshift-multus/multus-qbpxv"
Jul 09 14:54:54.717330 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.716348    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/779ead75-a855-4c93-bfdf-c38546b8a181-cni-binary-copy\") pod \"multus-additional-cni-plugins-lhnsd\" (UID: \"779ead75-a855-4c93-bfdf-c38546b8a181\") " pod="openshift-multus/multus-additional-cni-plugins-lhnsd"
Jul 09 14:54:54.717330 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.716400    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ff57ad35-41c5-4e84-af96-bf07b8b1a69e-etc-modprobe-d\") pod \"tuned-4mmjb\" (UID: \"ff57ad35-41c5-4e84-af96-bf07b8b1a69e\") " pod="openshift-cluster-node-tuning-operator/tuned-4mmjb"
Jul 09 14:54:54.718145 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.716426    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/779ead75-a855-4c93-bfdf-c38546b8a181-system-cni-dir\") pod \"multus-additional-cni-plugins-lhnsd\" (UID: \"779ead75-a855-4c93-bfdf-c38546b8a181\") " pod="openshift-multus/multus-additional-cni-plugins-lhnsd"
Jul 09 14:54:54.718145 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.716451    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/20ab37e4-d0b4-4298-bd29-c05f465cd6b0-registration-dir\") pod \"aws-ebs-csi-driver-node-6v5hh\" (UID: \"20ab37e4-d0b4-4298-bd29-c05f465cd6b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6v5hh"
Jul 09 14:54:54.718145 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.716428    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1f1e277c-317b-4031-af87-92c25d515f6e-os-release\") pod \"multus-qbpxv\" (UID: \"1f1e277c-317b-4031-af87-92c25d515f6e\") " pod="openshift-multus/multus-qbpxv"
Jul 09 14:54:54.718145 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.716473    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/20ab37e4-d0b4-4298-bd29-c05f465cd6b0-sys-fs\") pod \"aws-ebs-csi-driver-node-6v5hh\" (UID: \"20ab37e4-d0b4-4298-bd29-c05f465cd6b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6v5hh"
Jul 09 14:54:54.718145 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.716509    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ffe714b8-b418-41dd-8e65-e0467b6fa27b-iptables-alerter-script\") pod \"iptables-alerter-2snzr\" (UID: \"ffe714b8-b418-41dd-8e65-e0467b6fa27b\") " pod="openshift-network-operator/iptables-alerter-2snzr"
Jul 09 14:54:54.718145 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.716514    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ff57ad35-41c5-4e84-af96-bf07b8b1a69e-etc-modprobe-d\") pod \"tuned-4mmjb\" (UID: \"ff57ad35-41c5-4e84-af96-bf07b8b1a69e\") " pod="openshift-cluster-node-tuning-operator/tuned-4mmjb"
Jul 09 14:54:54.718145 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.716525    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/20ab37e4-d0b4-4298-bd29-c05f465cd6b0-registration-dir\") pod \"aws-ebs-csi-driver-node-6v5hh\" (UID: \"20ab37e4-d0b4-4298-bd29-c05f465cd6b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6v5hh"
Jul 09 14:54:54.718145 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.716532    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6e3ee08b-fbd7-4ff0-b953-fd749858497c-agent-certs\") pod \"konnectivity-agent-2pbcc\" (UID: \"6e3ee08b-fbd7-4ff0-b953-fd749858497c\") " pod="kube-system/konnectivity-agent-2pbcc"
Jul 09 14:54:54.718145 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.716525    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/779ead75-a855-4c93-bfdf-c38546b8a181-system-cni-dir\") pod \"multus-additional-cni-plugins-lhnsd\" (UID: \"779ead75-a855-4c93-bfdf-c38546b8a181\") " pod="openshift-multus/multus-additional-cni-plugins-lhnsd"
Jul 09 14:54:54.718145 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.716578    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1f1e277c-317b-4031-af87-92c25d515f6e-system-cni-dir\") pod \"multus-qbpxv\" (UID: \"1f1e277c-317b-4031-af87-92c25d515f6e\") " pod="openshift-multus/multus-qbpxv"
Jul 09 14:54:54.718145 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.716643    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1f1e277c-317b-4031-af87-92c25d515f6e-system-cni-dir\") pod \"multus-qbpxv\" (UID: \"1f1e277c-317b-4031-af87-92c25d515f6e\") " pod="openshift-multus/multus-qbpxv"
Jul 09 14:54:54.718145 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.716653    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/20ab37e4-d0b4-4298-bd29-c05f465cd6b0-sys-fs\") pod \"aws-ebs-csi-driver-node-6v5hh\" (UID: \"20ab37e4-d0b4-4298-bd29-c05f465cd6b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6v5hh"
Jul 09 14:54:54.718145 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.716687    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1f1e277c-317b-4031-af87-92c25d515f6e-host-var-lib-cni-bin\") pod \"multus-qbpxv\" (UID: \"1f1e277c-317b-4031-af87-92c25d515f6e\") " pod="openshift-multus/multus-qbpxv"
Jul 09 14:54:54.718145 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.716691    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ff57ad35-41c5-4e84-af96-bf07b8b1a69e-etc-sysctl-d\") pod \"tuned-4mmjb\" (UID: \"ff57ad35-41c5-4e84-af96-bf07b8b1a69e\") " pod="openshift-cluster-node-tuning-operator/tuned-4mmjb"
Jul 09 14:54:54.718879 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.716771    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ff57ad35-41c5-4e84-af96-bf07b8b1a69e-etc-systemd\") pod \"tuned-4mmjb\" (UID: \"ff57ad35-41c5-4e84-af96-bf07b8b1a69e\") " pod="openshift-cluster-node-tuning-operator/tuned-4mmjb"
Jul 09 14:54:54.718879 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.716774    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1f1e277c-317b-4031-af87-92c25d515f6e-host-var-lib-cni-bin\") pod \"multus-qbpxv\" (UID: \"1f1e277c-317b-4031-af87-92c25d515f6e\") " pod="openshift-multus/multus-qbpxv"
Jul 09 14:54:54.718879 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.716791    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/40837b99-6d03-4623-af26-ff7de0ff8baa-host-kubelet\") pod \"ovnkube-node-zx64x\" (UID: \"40837b99-6d03-4623-af26-ff7de0ff8baa\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx64x"
Jul 09 14:54:54.718879 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.716810    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fcff5fbe-84d3-47a1-9cde-4db751cbaae6-tmp-dir\") pod \"node-resolver-xmx5q\" (UID: \"fcff5fbe-84d3-47a1-9cde-4db751cbaae6\") " pod="openshift-dns/node-resolver-xmx5q"
Jul 09 14:54:54.718879 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.716825    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/40837b99-6d03-4623-af26-ff7de0ff8baa-host-kubelet\") pod \"ovnkube-node-zx64x\" (UID: \"40837b99-6d03-4623-af26-ff7de0ff8baa\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx64x"
Jul 09 14:54:54.718879 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.716833    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ff57ad35-41c5-4e84-af96-bf07b8b1a69e-etc-systemd\") pod \"tuned-4mmjb\" (UID: \"ff57ad35-41c5-4e84-af96-bf07b8b1a69e\") " pod="openshift-cluster-node-tuning-operator/tuned-4mmjb"
Jul 09 14:54:54.718879 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.716831    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n79w8\" (UniqueName: \"kubernetes.io/projected/fcff5fbe-84d3-47a1-9cde-4db751cbaae6-kube-api-access-n79w8\") pod \"node-resolver-xmx5q\" (UID: \"fcff5fbe-84d3-47a1-9cde-4db751cbaae6\") " pod="openshift-dns/node-resolver-xmx5q"
Jul 09 14:54:54.718879 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.716865    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/40837b99-6d03-4623-af26-ff7de0ff8baa-env-overrides\") pod \"ovnkube-node-zx64x\" (UID: \"40837b99-6d03-4623-af26-ff7de0ff8baa\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx64x"
Jul 09 14:54:54.718879 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.716910    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/40837b99-6d03-4623-af26-ff7de0ff8baa-ovn-node-metrics-cert\") pod \"ovnkube-node-zx64x\" (UID: \"40837b99-6d03-4623-af26-ff7de0ff8baa\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx64x"
Jul 09 14:54:54.718879 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.716947    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1f1e277c-317b-4031-af87-92c25d515f6e-host-run-netns\") pod \"multus-qbpxv\" (UID: \"1f1e277c-317b-4031-af87-92c25d515f6e\") " pod="openshift-multus/multus-qbpxv"
Jul 09 14:54:54.718879 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.716968    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2bsr\" (UniqueName: \"kubernetes.io/projected/ff57ad35-41c5-4e84-af96-bf07b8b1a69e-kube-api-access-w2bsr\") pod \"tuned-4mmjb\" (UID: \"ff57ad35-41c5-4e84-af96-bf07b8b1a69e\") " pod="openshift-cluster-node-tuning-operator/tuned-4mmjb"
Jul 09 14:54:54.718879 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.716988    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/779ead75-a855-4c93-bfdf-c38546b8a181-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lhnsd\" (UID: \"779ead75-a855-4c93-bfdf-c38546b8a181\") " pod="openshift-multus/multus-additional-cni-plugins-lhnsd"
Jul 09 14:54:54.718879 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.717049    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1f1e277c-317b-4031-af87-92c25d515f6e-host-run-netns\") pod \"multus-qbpxv\" (UID: \"1f1e277c-317b-4031-af87-92c25d515f6e\") " pod="openshift-multus/multus-qbpxv"
Jul 09 14:54:54.718879 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.717121    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/030200a1-2c06-4390-ab1b-d3e79bd705f2-host\") pod \"node-ca-zxwhs\" (UID: \"030200a1-2c06-4390-ab1b-d3e79bd705f2\") " pod="openshift-image-registry/node-ca-zxwhs"
Jul 09 14:54:54.718879 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.717140    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/40837b99-6d03-4623-af26-ff7de0ff8baa-ovnkube-script-lib\") pod \"ovnkube-node-zx64x\" (UID: \"40837b99-6d03-4623-af26-ff7de0ff8baa\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx64x"
Jul 09 14:54:54.719544 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.717170    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ff57ad35-41c5-4e84-af96-bf07b8b1a69e-etc-sysconfig\") pod \"tuned-4mmjb\" (UID: \"ff57ad35-41c5-4e84-af96-bf07b8b1a69e\") " pod="openshift-cluster-node-tuning-operator/tuned-4mmjb"
Jul 09 14:54:54.719544 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.717212    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ffe714b8-b418-41dd-8e65-e0467b6fa27b-iptables-alerter-script\") pod \"iptables-alerter-2snzr\" (UID: \"ffe714b8-b418-41dd-8e65-e0467b6fa27b\") " pod="openshift-network-operator/iptables-alerter-2snzr"
Jul 09 14:54:54.719544 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.717211    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/20ab37e4-d0b4-4298-bd29-c05f465cd6b0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6v5hh\" (UID: \"20ab37e4-d0b4-4298-bd29-c05f465cd6b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6v5hh"
Jul 09 14:54:54.719544 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.717188    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fcff5fbe-84d3-47a1-9cde-4db751cbaae6-tmp-dir\") pod \"node-resolver-xmx5q\" (UID: \"fcff5fbe-84d3-47a1-9cde-4db751cbaae6\") " pod="openshift-dns/node-resolver-xmx5q"
Jul 09 14:54:54.719544 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.717243    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/40837b99-6d03-4623-af26-ff7de0ff8baa-host-slash\") pod \"ovnkube-node-zx64x\" (UID: \"40837b99-6d03-4623-af26-ff7de0ff8baa\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx64x"
Jul 09 14:54:54.719544 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.717263    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/40837b99-6d03-4623-af26-ff7de0ff8baa-node-log\") pod \"ovnkube-node-zx64x\" (UID: \"40837b99-6d03-4623-af26-ff7de0ff8baa\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx64x"
Jul 09 14:54:54.719544 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.717286    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/40837b99-6d03-4623-af26-ff7de0ff8baa-host-cni-bin\") pod \"ovnkube-node-zx64x\" (UID: \"40837b99-6d03-4623-af26-ff7de0ff8baa\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx64x"
Jul 09 14:54:54.719544 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.717330    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/40837b99-6d03-4623-af26-ff7de0ff8baa-host-cni-bin\") pod \"ovnkube-node-zx64x\" (UID: \"40837b99-6d03-4623-af26-ff7de0ff8baa\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx64x"
Jul 09 14:54:54.719544 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.717328    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ff57ad35-41c5-4e84-af96-bf07b8b1a69e-etc-sysconfig\") pod \"tuned-4mmjb\" (UID: \"ff57ad35-41c5-4e84-af96-bf07b8b1a69e\") " pod="openshift-cluster-node-tuning-operator/tuned-4mmjb"
Jul 09 14:54:54.719544 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.717223    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/030200a1-2c06-4390-ab1b-d3e79bd705f2-host\") pod \"node-ca-zxwhs\" (UID: \"030200a1-2c06-4390-ab1b-d3e79bd705f2\") " pod="openshift-image-registry/node-ca-zxwhs"
Jul 09 14:54:54.719544 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.717388    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/20ab37e4-d0b4-4298-bd29-c05f465cd6b0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6v5hh\" (UID: \"20ab37e4-d0b4-4298-bd29-c05f465cd6b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6v5hh"
Jul 09 14:54:54.719544 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.717393    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/40837b99-6d03-4623-af26-ff7de0ff8baa-host-slash\") pod \"ovnkube-node-zx64x\" (UID: \"40837b99-6d03-4623-af26-ff7de0ff8baa\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx64x"
Jul 09 14:54:54.719544 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.717414    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/40837b99-6d03-4623-af26-ff7de0ff8baa-env-overrides\") pod \"ovnkube-node-zx64x\" (UID: \"40837b99-6d03-4623-af26-ff7de0ff8baa\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx64x"
Jul 09 14:54:54.719544 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.717418    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c37b4281-e19b-453c-aca5-f3fa37933b67-metrics-certs\") pod \"network-metrics-daemon-jpn9b\" (UID: \"c37b4281-e19b-453c-aca5-f3fa37933b67\") " pod="openshift-multus/network-metrics-daemon-jpn9b"
Jul 09 14:54:54.719544 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.717538    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ff57ad35-41c5-4e84-af96-bf07b8b1a69e-etc-sysctl-conf\") pod \"tuned-4mmjb\" (UID: \"ff57ad35-41c5-4e84-af96-bf07b8b1a69e\") " pod="openshift-cluster-node-tuning-operator/tuned-4mmjb"
Jul 09 14:54:54.720128 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:54:54.717555    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 14:54:54.720128 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.717569    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/40837b99-6d03-4623-af26-ff7de0ff8baa-node-log\") pod \"ovnkube-node-zx64x\" (UID: \"40837b99-6d03-4623-af26-ff7de0ff8baa\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx64x"
Jul 09 14:54:54.720128 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.717662    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ff57ad35-41c5-4e84-af96-bf07b8b1a69e-etc-sysctl-conf\") pod \"tuned-4mmjb\" (UID: \"ff57ad35-41c5-4e84-af96-bf07b8b1a69e\") " pod="openshift-cluster-node-tuning-operator/tuned-4mmjb"
Jul 09 14:54:54.720128 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:54:54.717746    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c37b4281-e19b-453c-aca5-f3fa37933b67-metrics-certs podName:c37b4281-e19b-453c-aca5-f3fa37933b67 nodeName:}" failed. No retries permitted until 2026-07-09 14:54:55.217721926 +0000 UTC m=+3.060254850 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c37b4281-e19b-453c-aca5-f3fa37933b67-metrics-certs") pod "network-metrics-daemon-jpn9b" (UID: "c37b4281-e19b-453c-aca5-f3fa37933b67") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 14:54:54.720128 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.717775    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/40837b99-6d03-4623-af26-ff7de0ff8baa-ovnkube-script-lib\") pod \"ovnkube-node-zx64x\" (UID: \"40837b99-6d03-4623-af26-ff7de0ff8baa\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx64x"
Jul 09 14:54:54.720128 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.717804    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bf25b5cc-fd7d-4383-ae3f-6a2fc1df007e-dbus\") pod \"global-pull-secret-syncer-f6rbl\" (UID: \"bf25b5cc-fd7d-4383-ae3f-6a2fc1df007e\") " pod="kube-system/global-pull-secret-syncer-f6rbl"
Jul 09 14:54:54.720128 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.717840    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/20ab37e4-d0b4-4298-bd29-c05f465cd6b0-etc-selinux\") pod \"aws-ebs-csi-driver-node-6v5hh\" (UID: \"20ab37e4-d0b4-4298-bd29-c05f465cd6b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6v5hh"
Jul 09 14:54:54.720128 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.717904    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/40837b99-6d03-4623-af26-ff7de0ff8baa-log-socket\") pod \"ovnkube-node-zx64x\" (UID: \"40837b99-6d03-4623-af26-ff7de0ff8baa\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx64x"
Jul 09 14:54:54.720128 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.717916    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bf25b5cc-fd7d-4383-ae3f-6a2fc1df007e-dbus\") pod \"global-pull-secret-syncer-f6rbl\" (UID: \"bf25b5cc-fd7d-4383-ae3f-6a2fc1df007e\") " pod="kube-system/global-pull-secret-syncer-f6rbl"
Jul 09 14:54:54.720128 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.717944    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/40837b99-6d03-4623-af26-ff7de0ff8baa-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zx64x\" (UID: \"40837b99-6d03-4623-af26-ff7de0ff8baa\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx64x"
Jul 09 14:54:54.720128 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.717969    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ffe714b8-b418-41dd-8e65-e0467b6fa27b-host-slash\") pod \"iptables-alerter-2snzr\" (UID: \"ffe714b8-b418-41dd-8e65-e0467b6fa27b\") " pod="openshift-network-operator/iptables-alerter-2snzr"
Jul 09 14:54:54.720128 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.717973    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/40837b99-6d03-4623-af26-ff7de0ff8baa-log-socket\") pod \"ovnkube-node-zx64x\" (UID: \"40837b99-6d03-4623-af26-ff7de0ff8baa\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx64x"
Jul 09 14:54:54.720128 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.717997    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/20ab37e4-d0b4-4298-bd29-c05f465cd6b0-etc-selinux\") pod \"aws-ebs-csi-driver-node-6v5hh\" (UID: \"20ab37e4-d0b4-4298-bd29-c05f465cd6b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6v5hh"
Jul 09 14:54:54.720128 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.718004    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1f1e277c-317b-4031-af87-92c25d515f6e-multus-daemon-config\") pod \"multus-qbpxv\" (UID: \"1f1e277c-317b-4031-af87-92c25d515f6e\") " pod="openshift-multus/multus-qbpxv"
Jul 09 14:54:54.720560 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.718036    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/40837b99-6d03-4623-af26-ff7de0ff8baa-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zx64x\" (UID: \"40837b99-6d03-4623-af26-ff7de0ff8baa\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx64x"
Jul 09 14:54:54.720560 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.718050    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff57ad35-41c5-4e84-af96-bf07b8b1a69e-etc-kubernetes\") pod \"tuned-4mmjb\" (UID: \"ff57ad35-41c5-4e84-af96-bf07b8b1a69e\") " pod="openshift-cluster-node-tuning-operator/tuned-4mmjb"
Jul 09 14:54:54.720560 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.718078    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bf25b5cc-fd7d-4383-ae3f-6a2fc1df007e-original-pull-secret\") pod \"global-pull-secret-syncer-f6rbl\" (UID: \"bf25b5cc-fd7d-4383-ae3f-6a2fc1df007e\") " pod="kube-system/global-pull-secret-syncer-f6rbl"
Jul 09 14:54:54.720560 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.718043    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ffe714b8-b418-41dd-8e65-e0467b6fa27b-host-slash\") pod \"iptables-alerter-2snzr\" (UID: \"ffe714b8-b418-41dd-8e65-e0467b6fa27b\") " pod="openshift-network-operator/iptables-alerter-2snzr"
Jul 09 14:54:54.720560 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.718099    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/40837b99-6d03-4623-af26-ff7de0ff8baa-systemd-units\") pod \"ovnkube-node-zx64x\" (UID: \"40837b99-6d03-4623-af26-ff7de0ff8baa\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx64x"
Jul 09 14:54:54.720560 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.718135    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ff57ad35-41c5-4e84-af96-bf07b8b1a69e-lib-modules\") pod \"tuned-4mmjb\" (UID: \"ff57ad35-41c5-4e84-af96-bf07b8b1a69e\") " pod="openshift-cluster-node-tuning-operator/tuned-4mmjb"
Jul 09 14:54:54.720560 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.718147    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff57ad35-41c5-4e84-af96-bf07b8b1a69e-etc-kubernetes\") pod \"tuned-4mmjb\" (UID: \"ff57ad35-41c5-4e84-af96-bf07b8b1a69e\") " pod="openshift-cluster-node-tuning-operator/tuned-4mmjb"
Jul 09 14:54:54.720560 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.718230    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ff57ad35-41c5-4e84-af96-bf07b8b1a69e-tmp\") pod \"tuned-4mmjb\" (UID: \"ff57ad35-41c5-4e84-af96-bf07b8b1a69e\") " pod="openshift-cluster-node-tuning-operator/tuned-4mmjb"
Jul 09 14:54:54.720560 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.718243    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/40837b99-6d03-4623-af26-ff7de0ff8baa-systemd-units\") pod \"ovnkube-node-zx64x\" (UID: \"40837b99-6d03-4623-af26-ff7de0ff8baa\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx64x"
Jul 09 14:54:54.720560 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.718252    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/20ab37e4-d0b4-4298-bd29-c05f465cd6b0-socket-dir\") pod \"aws-ebs-csi-driver-node-6v5hh\" (UID: \"20ab37e4-d0b4-4298-bd29-c05f465cd6b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6v5hh"
Jul 09 14:54:54.720560 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:54:54.718271    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 14:54:54.720560 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.718284    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/40837b99-6d03-4623-af26-ff7de0ff8baa-host-cni-netd\") pod \"ovnkube-node-zx64x\" (UID: \"40837b99-6d03-4623-af26-ff7de0ff8baa\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx64x"
Jul 09 14:54:54.720560 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:54:54.718344    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf25b5cc-fd7d-4383-ae3f-6a2fc1df007e-original-pull-secret podName:bf25b5cc-fd7d-4383-ae3f-6a2fc1df007e nodeName:}" failed. No retries permitted until 2026-07-09 14:54:55.21830793 +0000 UTC m=+3.060840851 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bf25b5cc-fd7d-4383-ae3f-6a2fc1df007e-original-pull-secret") pod "global-pull-secret-syncer-f6rbl" (UID: "bf25b5cc-fd7d-4383-ae3f-6a2fc1df007e") : object "kube-system"/"original-pull-secret" not registered
Jul 09 14:54:54.720560 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.718352    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/40837b99-6d03-4623-af26-ff7de0ff8baa-host-cni-netd\") pod \"ovnkube-node-zx64x\" (UID: \"40837b99-6d03-4623-af26-ff7de0ff8baa\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx64x"
Jul 09 14:54:54.720983 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.718365    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/40837b99-6d03-4623-af26-ff7de0ff8baa-ovnkube-config\") pod \"ovnkube-node-zx64x\" (UID: \"40837b99-6d03-4623-af26-ff7de0ff8baa\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx64x"
Jul 09 14:54:54.720983 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.718395    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1f1e277c-317b-4031-af87-92c25d515f6e-host-var-lib-cni-multus\") pod \"multus-qbpxv\" (UID: \"1f1e277c-317b-4031-af87-92c25d515f6e\") " pod="openshift-multus/multus-qbpxv"
Jul 09 14:54:54.720983 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.718434    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ff57ad35-41c5-4e84-af96-bf07b8b1a69e-run\") pod \"tuned-4mmjb\" (UID: \"ff57ad35-41c5-4e84-af96-bf07b8b1a69e\") " pod="openshift-cluster-node-tuning-operator/tuned-4mmjb"
Jul 09 14:54:54.720983 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.718459    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ff57ad35-41c5-4e84-af96-bf07b8b1a69e-sys\") pod \"tuned-4mmjb\" (UID: \"ff57ad35-41c5-4e84-af96-bf07b8b1a69e\") " pod="openshift-cluster-node-tuning-operator/tuned-4mmjb"
Jul 09 14:54:54.720983 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.718496    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1f1e277c-317b-4031-af87-92c25d515f6e-multus-daemon-config\") pod \"multus-qbpxv\" (UID: \"1f1e277c-317b-4031-af87-92c25d515f6e\") " pod="openshift-multus/multus-qbpxv"
Jul 09 14:54:54.720983 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.718534    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1f1e277c-317b-4031-af87-92c25d515f6e-host-var-lib-cni-multus\") pod \"multus-qbpxv\" (UID: \"1f1e277c-317b-4031-af87-92c25d515f6e\") " pod="openshift-multus/multus-qbpxv"
Jul 09 14:54:54.720983 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.718551    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ff57ad35-41c5-4e84-af96-bf07b8b1a69e-sys\") pod \"tuned-4mmjb\" (UID: \"ff57ad35-41c5-4e84-af96-bf07b8b1a69e\") " pod="openshift-cluster-node-tuning-operator/tuned-4mmjb"
Jul 09 14:54:54.720983 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.718583    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ff57ad35-41c5-4e84-af96-bf07b8b1a69e-lib-modules\") pod \"tuned-4mmjb\" (UID: \"ff57ad35-41c5-4e84-af96-bf07b8b1a69e\") " pod="openshift-cluster-node-tuning-operator/tuned-4mmjb"
Jul 09 14:54:54.720983 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.718593    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ff57ad35-41c5-4e84-af96-bf07b8b1a69e-host\") pod \"tuned-4mmjb\" (UID: \"ff57ad35-41c5-4e84-af96-bf07b8b1a69e\") " pod="openshift-cluster-node-tuning-operator/tuned-4mmjb"
Jul 09 14:54:54.720983 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.718461    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/20ab37e4-d0b4-4298-bd29-c05f465cd6b0-socket-dir\") pod \"aws-ebs-csi-driver-node-6v5hh\" (UID: \"20ab37e4-d0b4-4298-bd29-c05f465cd6b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6v5hh"
Jul 09 14:54:54.720983 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.718624    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/20ab37e4-d0b4-4298-bd29-c05f465cd6b0-device-dir\") pod \"aws-ebs-csi-driver-node-6v5hh\" (UID: \"20ab37e4-d0b4-4298-bd29-c05f465cd6b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6v5hh"
Jul 09 14:54:54.720983 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.718656    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fcff5fbe-84d3-47a1-9cde-4db751cbaae6-hosts-file\") pod \"node-resolver-xmx5q\" (UID: \"fcff5fbe-84d3-47a1-9cde-4db751cbaae6\") " pod="openshift-dns/node-resolver-xmx5q"
Jul 09 14:54:54.720983 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.718657    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ff57ad35-41c5-4e84-af96-bf07b8b1a69e-host\") pod \"tuned-4mmjb\" (UID: \"ff57ad35-41c5-4e84-af96-bf07b8b1a69e\") " pod="openshift-cluster-node-tuning-operator/tuned-4mmjb"
Jul 09 14:54:54.720983 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.718682    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/40837b99-6d03-4623-af26-ff7de0ff8baa-host-run-netns\") pod \"ovnkube-node-zx64x\" (UID: \"40837b99-6d03-4623-af26-ff7de0ff8baa\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx64x"
Jul 09 14:54:54.720983 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.718697    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ff57ad35-41c5-4e84-af96-bf07b8b1a69e-run\") pod \"tuned-4mmjb\" (UID: \"ff57ad35-41c5-4e84-af96-bf07b8b1a69e\") " pod="openshift-cluster-node-tuning-operator/tuned-4mmjb"
Jul 09 14:54:54.721409 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.718722    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/40837b99-6d03-4623-af26-ff7de0ff8baa-etc-openvswitch\") pod \"ovnkube-node-zx64x\" (UID: \"40837b99-6d03-4623-af26-ff7de0ff8baa\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx64x"
Jul 09 14:54:54.721409 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.718724    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/20ab37e4-d0b4-4298-bd29-c05f465cd6b0-device-dir\") pod \"aws-ebs-csi-driver-node-6v5hh\" (UID: \"20ab37e4-d0b4-4298-bd29-c05f465cd6b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6v5hh"
Jul 09 14:54:54.721409 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.718757    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/40837b99-6d03-4623-af26-ff7de0ff8baa-host-run-netns\") pod \"ovnkube-node-zx64x\" (UID: \"40837b99-6d03-4623-af26-ff7de0ff8baa\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx64x"
Jul 09 14:54:54.721409 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.718763    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fcff5fbe-84d3-47a1-9cde-4db751cbaae6-hosts-file\") pod \"node-resolver-xmx5q\" (UID: \"fcff5fbe-84d3-47a1-9cde-4db751cbaae6\") " pod="openshift-dns/node-resolver-xmx5q"
Jul 09 14:54:54.721409 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.718774    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/40837b99-6d03-4623-af26-ff7de0ff8baa-etc-openvswitch\") pod \"ovnkube-node-zx64x\" (UID: \"40837b99-6d03-4623-af26-ff7de0ff8baa\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx64x"
Jul 09 14:54:54.721409 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.718786    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6e3ee08b-fbd7-4ff0-b953-fd749858497c-konnectivity-ca\") pod \"konnectivity-agent-2pbcc\" (UID: \"6e3ee08b-fbd7-4ff0-b953-fd749858497c\") " pod="kube-system/konnectivity-agent-2pbcc"
Jul 09 14:54:54.721409 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.718811    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1f1e277c-317b-4031-af87-92c25d515f6e-multus-socket-dir-parent\") pod \"multus-qbpxv\" (UID: \"1f1e277c-317b-4031-af87-92c25d515f6e\") " pod="openshift-multus/multus-qbpxv"
Jul 09 14:54:54.721409 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.718826    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/030200a1-2c06-4390-ab1b-d3e79bd705f2-serviceca\") pod \"node-ca-zxwhs\" (UID: \"030200a1-2c06-4390-ab1b-d3e79bd705f2\") " pod="openshift-image-registry/node-ca-zxwhs"
Jul 09 14:54:54.721409 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.718847    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpmbp\" (UniqueName: \"kubernetes.io/projected/030200a1-2c06-4390-ab1b-d3e79bd705f2-kube-api-access-bpmbp\") pod \"node-ca-zxwhs\" (UID: \"030200a1-2c06-4390-ab1b-d3e79bd705f2\") " pod="openshift-image-registry/node-ca-zxwhs"
Jul 09 14:54:54.721409 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.718946    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1f1e277c-317b-4031-af87-92c25d515f6e-multus-socket-dir-parent\") pod \"multus-qbpxv\" (UID: \"1f1e277c-317b-4031-af87-92c25d515f6e\") " pod="openshift-multus/multus-qbpxv"
Jul 09 14:54:54.721409 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.718946    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/40837b99-6d03-4623-af26-ff7de0ff8baa-ovnkube-config\") pod \"ovnkube-node-zx64x\" (UID: \"40837b99-6d03-4623-af26-ff7de0ff8baa\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx64x"
Jul 09 14:54:54.721409 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.719058    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/779ead75-a855-4c93-bfdf-c38546b8a181-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lhnsd\" (UID: \"779ead75-a855-4c93-bfdf-c38546b8a181\") " pod="openshift-multus/multus-additional-cni-plugins-lhnsd"
Jul 09 14:54:54.721409 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.719379    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/030200a1-2c06-4390-ab1b-d3e79bd705f2-serviceca\") pod \"node-ca-zxwhs\" (UID: \"030200a1-2c06-4390-ab1b-d3e79bd705f2\") " pod="openshift-image-registry/node-ca-zxwhs"
Jul 09 14:54:54.721409 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.719464    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6e3ee08b-fbd7-4ff0-b953-fd749858497c-konnectivity-ca\") pod \"konnectivity-agent-2pbcc\" (UID: \"6e3ee08b-fbd7-4ff0-b953-fd749858497c\") " pod="kube-system/konnectivity-agent-2pbcc"
Jul 09 14:54:54.721409 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.719983    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ff57ad35-41c5-4e84-af96-bf07b8b1a69e-etc-tuned\") pod \"tuned-4mmjb\" (UID: \"ff57ad35-41c5-4e84-af96-bf07b8b1a69e\") " pod="openshift-cluster-node-tuning-operator/tuned-4mmjb"
Jul 09 14:54:54.721830 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.720074    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/40837b99-6d03-4623-af26-ff7de0ff8baa-ovn-node-metrics-cert\") pod \"ovnkube-node-zx64x\" (UID: \"40837b99-6d03-4623-af26-ff7de0ff8baa\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx64x"
Jul 09 14:54:54.721830 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.720217    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6e3ee08b-fbd7-4ff0-b953-fd749858497c-agent-certs\") pod \"konnectivity-agent-2pbcc\" (UID: \"6e3ee08b-fbd7-4ff0-b953-fd749858497c\") " pod="kube-system/konnectivity-agent-2pbcc"
Jul 09 14:54:54.721830 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.720923    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ff57ad35-41c5-4e84-af96-bf07b8b1a69e-tmp\") pod \"tuned-4mmjb\" (UID: \"ff57ad35-41c5-4e84-af96-bf07b8b1a69e\") " pod="openshift-cluster-node-tuning-operator/tuned-4mmjb"
Jul 09 14:54:54.725744 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:54:54.725728    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 14:54:54.725805 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:54:54.725748    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 14:54:54.725805 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:54:54.725758    2575 projected.go:196] Error preparing data for projected volume kube-api-access-rjx7d for pod openshift-network-diagnostics/network-check-target-fs6ww: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 14:54:54.725805 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:54:54.725797    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae071a8e-6ae7-4330-b5e8-776283e86b63-kube-api-access-rjx7d podName:ae071a8e-6ae7-4330-b5e8-776283e86b63 nodeName:}" failed. No retries permitted until 2026-07-09 14:54:55.225786834 +0000 UTC m=+3.068319744 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-rjx7d" (UniqueName: "kubernetes.io/projected/ae071a8e-6ae7-4330-b5e8-776283e86b63-kube-api-access-rjx7d") pod "network-check-target-fs6ww" (UID: "ae071a8e-6ae7-4330-b5e8-776283e86b63") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 14:54:54.728495 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.728472    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjh6f\" (UniqueName: \"kubernetes.io/projected/ffe714b8-b418-41dd-8e65-e0467b6fa27b-kube-api-access-qjh6f\") pod \"iptables-alerter-2snzr\" (UID: \"ffe714b8-b418-41dd-8e65-e0467b6fa27b\") " pod="openshift-network-operator/iptables-alerter-2snzr"
Jul 09 14:54:54.728743 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.728727    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpmbp\" (UniqueName: \"kubernetes.io/projected/030200a1-2c06-4390-ab1b-d3e79bd705f2-kube-api-access-bpmbp\") pod \"node-ca-zxwhs\" (UID: \"030200a1-2c06-4390-ab1b-d3e79bd705f2\") " pod="openshift-image-registry/node-ca-zxwhs"
Jul 09 14:54:54.728828 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.728766    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jl88p\" (UniqueName: \"kubernetes.io/projected/779ead75-a855-4c93-bfdf-c38546b8a181-kube-api-access-jl88p\") pod \"multus-additional-cni-plugins-lhnsd\" (UID: \"779ead75-a855-4c93-bfdf-c38546b8a181\") " pod="openshift-multus/multus-additional-cni-plugins-lhnsd"
Jul 09 14:54:54.728828 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.728779    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t449h\" (UniqueName: \"kubernetes.io/projected/1f1e277c-317b-4031-af87-92c25d515f6e-kube-api-access-t449h\") pod \"multus-qbpxv\" (UID: \"1f1e277c-317b-4031-af87-92c25d515f6e\") " pod="openshift-multus/multus-qbpxv"
Jul 09 14:54:54.729370 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.729346    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2bsr\" (UniqueName: \"kubernetes.io/projected/ff57ad35-41c5-4e84-af96-bf07b8b1a69e-kube-api-access-w2bsr\") pod \"tuned-4mmjb\" (UID: \"ff57ad35-41c5-4e84-af96-bf07b8b1a69e\") " pod="openshift-cluster-node-tuning-operator/tuned-4mmjb"
Jul 09 14:54:54.729498 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.729480    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n595r\" (UniqueName: \"kubernetes.io/projected/40837b99-6d03-4623-af26-ff7de0ff8baa-kube-api-access-n595r\") pod \"ovnkube-node-zx64x\" (UID: \"40837b99-6d03-4623-af26-ff7de0ff8baa\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx64x"
Jul 09 14:54:54.729498 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.729490    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4l4fq\" (UniqueName: \"kubernetes.io/projected/c37b4281-e19b-453c-aca5-f3fa37933b67-kube-api-access-4l4fq\") pod \"network-metrics-daemon-jpn9b\" (UID: \"c37b4281-e19b-453c-aca5-f3fa37933b67\") " pod="openshift-multus/network-metrics-daemon-jpn9b"
Jul 09 14:54:54.729570 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.729489    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n79w8\" (UniqueName: \"kubernetes.io/projected/fcff5fbe-84d3-47a1-9cde-4db751cbaae6-kube-api-access-n79w8\") pod \"node-resolver-xmx5q\" (UID: \"fcff5fbe-84d3-47a1-9cde-4db751cbaae6\") " pod="openshift-dns/node-resolver-xmx5q"
Jul 09 14:54:54.730515 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.730497    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkp2x\" (UniqueName: \"kubernetes.io/projected/20ab37e4-d0b4-4298-bd29-c05f465cd6b0-kube-api-access-wkp2x\") pod \"aws-ebs-csi-driver-node-6v5hh\" (UID: \"20ab37e4-d0b4-4298-bd29-c05f465cd6b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6v5hh"
Jul 09 14:54:54.869178 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.869144    2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 14:54:54.884393 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.884363    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lhnsd"
Jul 09 14:54:54.891907 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.891891    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6v5hh"
Jul 09 14:54:54.894214 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:54.894188    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod779ead75_a855_4c93_bfdf_c38546b8a181.slice/crio-63086bf41002a2f74b6f89018150f9029b8fec3b4968d6144acb871aa15b16f2 WatchSource:0}: Error finding container 63086bf41002a2f74b6f89018150f9029b8fec3b4968d6144acb871aa15b16f2: Status 404 returned error can't find the container with id 63086bf41002a2f74b6f89018150f9029b8fec3b4968d6144acb871aa15b16f2
Jul 09 14:54:54.899940 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.899925    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xmx5q"
Jul 09 14:54:54.900548 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:54.900529    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20ab37e4_d0b4_4298_bd29_c05f465cd6b0.slice/crio-36ec8bebe1f8b55a00e541f12206df11e6ea0790f289e22b33d90da5ba7d09c1 WatchSource:0}: Error finding container 36ec8bebe1f8b55a00e541f12206df11e6ea0790f289e22b33d90da5ba7d09c1: Status 404 returned error can't find the container with id 36ec8bebe1f8b55a00e541f12206df11e6ea0790f289e22b33d90da5ba7d09c1
Jul 09 14:54:54.905670 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.905648    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zxwhs"
Jul 09 14:54:54.911290 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.911273    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2snzr"
Jul 09 14:54:54.911520 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:54.911500    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcff5fbe_84d3_47a1_9cde_4db751cbaae6.slice/crio-01682d91904f3882f65c93e3a4f4e9159fe7a4115aa568440711a861ebacca4b WatchSource:0}: Error finding container 01682d91904f3882f65c93e3a4f4e9159fe7a4115aa568440711a861ebacca4b: Status 404 returned error can't find the container with id 01682d91904f3882f65c93e3a4f4e9159fe7a4115aa568440711a861ebacca4b
Jul 09 14:54:54.914374 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:54.914355    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod030200a1_2c06_4390_ab1b_d3e79bd705f2.slice/crio-78a23d535f3470a7e58e191f9ebd5eb376229ca65a7ccc47f4541c2c35797ca0 WatchSource:0}: Error finding container 78a23d535f3470a7e58e191f9ebd5eb376229ca65a7ccc47f4541c2c35797ca0: Status 404 returned error can't find the container with id 78a23d535f3470a7e58e191f9ebd5eb376229ca65a7ccc47f4541c2c35797ca0
Jul 09 14:54:54.918446 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.918430    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zx64x"
Jul 09 14:54:54.920611 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:54.920590    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffe714b8_b418_41dd_8e65_e0467b6fa27b.slice/crio-04f38bc2244b5a1caa32ec5784315be89d4b6864054520d6af1592498ee7bdc4 WatchSource:0}: Error finding container 04f38bc2244b5a1caa32ec5784315be89d4b6864054520d6af1592498ee7bdc4: Status 404 returned error can't find the container with id 04f38bc2244b5a1caa32ec5784315be89d4b6864054520d6af1592498ee7bdc4
Jul 09 14:54:54.922753 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.922734    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2pbcc"
Jul 09 14:54:54.926116 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:54.926099    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40837b99_6d03_4623_af26_ff7de0ff8baa.slice/crio-a18c1afcfece876dc5b869a761fbaa7168772a4ebb196bd166cecb615599590c WatchSource:0}: Error finding container a18c1afcfece876dc5b869a761fbaa7168772a4ebb196bd166cecb615599590c: Status 404 returned error can't find the container with id a18c1afcfece876dc5b869a761fbaa7168772a4ebb196bd166cecb615599590c
Jul 09 14:54:54.928009 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.927993    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qbpxv"
Jul 09 14:54:54.930880 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:54.930820    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e3ee08b_fbd7_4ff0_b953_fd749858497c.slice/crio-0cb9f44aca96db64000470c1f772828644241eb4b1db67597e1ec1d67a26afff WatchSource:0}: Error finding container 0cb9f44aca96db64000470c1f772828644241eb4b1db67597e1ec1d67a26afff: Status 404 returned error can't find the container with id 0cb9f44aca96db64000470c1f772828644241eb4b1db67597e1ec1d67a26afff
Jul 09 14:54:54.932936 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:54.932913    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4mmjb"
Jul 09 14:54:54.936045 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:54.936025    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f1e277c_317b_4031_af87_92c25d515f6e.slice/crio-6f9b0ad04020b91aca467e2cbab5eb678704df4454f393bd7eb1d67a3376f52b WatchSource:0}: Error finding container 6f9b0ad04020b91aca467e2cbab5eb678704df4454f393bd7eb1d67a3376f52b: Status 404 returned error can't find the container with id 6f9b0ad04020b91aca467e2cbab5eb678704df4454f393bd7eb1d67a3376f52b
Jul 09 14:54:54.941492 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:54:54.941471    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff57ad35_41c5_4e84_af96_bf07b8b1a69e.slice/crio-66e86ee28a8215a251af0c6052b0a63a0ac403dc6fea2d6e7e86b3518efce509 WatchSource:0}: Error finding container 66e86ee28a8215a251af0c6052b0a63a0ac403dc6fea2d6e7e86b3518efce509: Status 404 returned error can't find the container with id 66e86ee28a8215a251af0c6052b0a63a0ac403dc6fea2d6e7e86b3518efce509
Jul 09 14:54:55.221631 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:55.221595    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c37b4281-e19b-453c-aca5-f3fa37933b67-metrics-certs\") pod \"network-metrics-daemon-jpn9b\" (UID: \"c37b4281-e19b-453c-aca5-f3fa37933b67\") " pod="openshift-multus/network-metrics-daemon-jpn9b"
Jul 09 14:54:55.221834 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:55.221654    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bf25b5cc-fd7d-4383-ae3f-6a2fc1df007e-original-pull-secret\") pod \"global-pull-secret-syncer-f6rbl\" (UID: \"bf25b5cc-fd7d-4383-ae3f-6a2fc1df007e\") " pod="kube-system/global-pull-secret-syncer-f6rbl"
Jul 09 14:54:55.221834 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:54:55.221777    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 14:54:55.221951 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:54:55.221843    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c37b4281-e19b-453c-aca5-f3fa37933b67-metrics-certs podName:c37b4281-e19b-453c-aca5-f3fa37933b67 nodeName:}" failed. No retries permitted until 2026-07-09 14:54:56.221823399 +0000 UTC m=+4.064356326 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c37b4281-e19b-453c-aca5-f3fa37933b67-metrics-certs") pod "network-metrics-daemon-jpn9b" (UID: "c37b4281-e19b-453c-aca5-f3fa37933b67") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 14:54:55.221951 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:54:55.221782    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 14:54:55.221951 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:54:55.221938    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf25b5cc-fd7d-4383-ae3f-6a2fc1df007e-original-pull-secret podName:bf25b5cc-fd7d-4383-ae3f-6a2fc1df007e nodeName:}" failed. No retries permitted until 2026-07-09 14:54:56.221916358 +0000 UTC m=+4.064449272 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bf25b5cc-fd7d-4383-ae3f-6a2fc1df007e-original-pull-secret") pod "global-pull-secret-syncer-f6rbl" (UID: "bf25b5cc-fd7d-4383-ae3f-6a2fc1df007e") : object "kube-system"/"original-pull-secret" not registered
Jul 09 14:54:55.315538 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:55.315480    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4mmjb" event={"ID":"ff57ad35-41c5-4e84-af96-bf07b8b1a69e","Type":"ContainerStarted","Data":"66e86ee28a8215a251af0c6052b0a63a0ac403dc6fea2d6e7e86b3518efce509"}
Jul 09 14:54:55.316749 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:55.316723    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qbpxv" event={"ID":"1f1e277c-317b-4031-af87-92c25d515f6e","Type":"ContainerStarted","Data":"6f9b0ad04020b91aca467e2cbab5eb678704df4454f393bd7eb1d67a3376f52b"}
Jul 09 14:54:55.317912 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:55.317886    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2snzr" event={"ID":"ffe714b8-b418-41dd-8e65-e0467b6fa27b","Type":"ContainerStarted","Data":"04f38bc2244b5a1caa32ec5784315be89d4b6864054520d6af1592498ee7bdc4"}
Jul 09 14:54:55.319122 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:55.319102    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zxwhs" event={"ID":"030200a1-2c06-4390-ab1b-d3e79bd705f2","Type":"ContainerStarted","Data":"78a23d535f3470a7e58e191f9ebd5eb376229ca65a7ccc47f4541c2c35797ca0"}
Jul 09 14:54:55.320245 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:55.320220    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xmx5q" event={"ID":"fcff5fbe-84d3-47a1-9cde-4db751cbaae6","Type":"ContainerStarted","Data":"01682d91904f3882f65c93e3a4f4e9159fe7a4115aa568440711a861ebacca4b"}
Jul 09 14:54:55.321500 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:55.321477    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lhnsd" event={"ID":"779ead75-a855-4c93-bfdf-c38546b8a181","Type":"ContainerStarted","Data":"63086bf41002a2f74b6f89018150f9029b8fec3b4968d6144acb871aa15b16f2"}
Jul 09 14:54:55.321978 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:55.321957    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjx7d\" (UniqueName: \"kubernetes.io/projected/ae071a8e-6ae7-4330-b5e8-776283e86b63-kube-api-access-rjx7d\") pod \"network-check-target-fs6ww\" (UID: \"ae071a8e-6ae7-4330-b5e8-776283e86b63\") " pod="openshift-network-diagnostics/network-check-target-fs6ww"
Jul 09 14:54:55.322102 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:54:55.322079    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 14:54:55.322205 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:54:55.322109    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 14:54:55.322205 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:54:55.322121    2575 projected.go:196] Error preparing data for projected volume kube-api-access-rjx7d for pod openshift-network-diagnostics/network-check-target-fs6ww: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 14:54:55.322205 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:54:55.322173    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae071a8e-6ae7-4330-b5e8-776283e86b63-kube-api-access-rjx7d podName:ae071a8e-6ae7-4330-b5e8-776283e86b63 nodeName:}" failed. No retries permitted until 2026-07-09 14:54:56.322153495 +0000 UTC m=+4.164686426 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-rjx7d" (UniqueName: "kubernetes.io/projected/ae071a8e-6ae7-4330-b5e8-776283e86b63-kube-api-access-rjx7d") pod "network-check-target-fs6ww" (UID: "ae071a8e-6ae7-4330-b5e8-776283e86b63") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 14:54:55.322620 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:55.322603    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-94.ec2.internal" event={"ID":"842163ee6bc7db204a9ad24049bf1028","Type":"ContainerStarted","Data":"5e0aad6be2e3f3334dce49975fb7e49a8a2e8fa5a1990cd38be5dcea247f8e6b"}
Jul 09 14:54:55.324469 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:55.324450    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-94.ec2.internal" event={"ID":"e768764d27b505cd33de9c3393775e16","Type":"ContainerStarted","Data":"e18e956ae036a304abffb12b39988f2ac03d0b37bb2152ec6937ac54fecbcbc1"}
Jul 09 14:54:55.326233 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:55.326209    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2pbcc" event={"ID":"6e3ee08b-fbd7-4ff0-b953-fd749858497c","Type":"ContainerStarted","Data":"0cb9f44aca96db64000470c1f772828644241eb4b1db67597e1ec1d67a26afff"}
Jul 09 14:54:55.327866 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:55.327696    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zx64x" event={"ID":"40837b99-6d03-4623-af26-ff7de0ff8baa","Type":"ContainerStarted","Data":"a18c1afcfece876dc5b869a761fbaa7168772a4ebb196bd166cecb615599590c"}
Jul 09 14:54:55.329126 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:55.329104    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6v5hh" event={"ID":"20ab37e4-d0b4-4298-bd29-c05f465cd6b0","Type":"ContainerStarted","Data":"36ec8bebe1f8b55a00e541f12206df11e6ea0790f289e22b33d90da5ba7d09c1"}
Jul 09 14:54:55.668203 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:55.668113    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 14:49:54 +0000 UTC" deadline="2028-01-27 09:59:17.909360181 +0000 UTC"
Jul 09 14:54:55.668203 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:55.668155    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13603h4m22.241209646s"
Jul 09 14:54:56.233345 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:56.233011    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c37b4281-e19b-453c-aca5-f3fa37933b67-metrics-certs\") pod \"network-metrics-daemon-jpn9b\" (UID: \"c37b4281-e19b-453c-aca5-f3fa37933b67\") " pod="openshift-multus/network-metrics-daemon-jpn9b"
Jul 09 14:54:56.233345 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:56.233042    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bf25b5cc-fd7d-4383-ae3f-6a2fc1df007e-original-pull-secret\") pod \"global-pull-secret-syncer-f6rbl\" (UID: \"bf25b5cc-fd7d-4383-ae3f-6a2fc1df007e\") " pod="kube-system/global-pull-secret-syncer-f6rbl"
Jul 09 14:54:56.233345 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:54:56.233133    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 14:54:56.233345 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:54:56.233183    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf25b5cc-fd7d-4383-ae3f-6a2fc1df007e-original-pull-secret podName:bf25b5cc-fd7d-4383-ae3f-6a2fc1df007e nodeName:}" failed. No retries permitted until 2026-07-09 14:54:58.23316526 +0000 UTC m=+6.075698172 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bf25b5cc-fd7d-4383-ae3f-6a2fc1df007e-original-pull-secret") pod "global-pull-secret-syncer-f6rbl" (UID: "bf25b5cc-fd7d-4383-ae3f-6a2fc1df007e") : object "kube-system"/"original-pull-secret" not registered
Jul 09 14:54:56.233345 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:54:56.233253    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 14:54:56.233345 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:54:56.233278    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c37b4281-e19b-453c-aca5-f3fa37933b67-metrics-certs podName:c37b4281-e19b-453c-aca5-f3fa37933b67 nodeName:}" failed. No retries permitted until 2026-07-09 14:54:58.233271442 +0000 UTC m=+6.075804352 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c37b4281-e19b-453c-aca5-f3fa37933b67-metrics-certs") pod "network-metrics-daemon-jpn9b" (UID: "c37b4281-e19b-453c-aca5-f3fa37933b67") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 14:54:56.311212 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:56.310817    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fs6ww"
Jul 09 14:54:56.311212 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:54:56.310916    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fs6ww" podUID="ae071a8e-6ae7-4330-b5e8-776283e86b63"
Jul 09 14:54:56.311212 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:56.310983    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f6rbl"
Jul 09 14:54:56.311212 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:54:56.311036    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f6rbl" podUID="bf25b5cc-fd7d-4383-ae3f-6a2fc1df007e"
Jul 09 14:54:56.311212 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:56.311096    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jpn9b"
Jul 09 14:54:56.311212 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:54:56.311178    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jpn9b" podUID="c37b4281-e19b-453c-aca5-f3fa37933b67"
Jul 09 14:54:56.334103 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:56.334053    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjx7d\" (UniqueName: \"kubernetes.io/projected/ae071a8e-6ae7-4330-b5e8-776283e86b63-kube-api-access-rjx7d\") pod \"network-check-target-fs6ww\" (UID: \"ae071a8e-6ae7-4330-b5e8-776283e86b63\") " pod="openshift-network-diagnostics/network-check-target-fs6ww"
Jul 09 14:54:56.334262 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:54:56.334239    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 14:54:56.334334 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:54:56.334275    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 14:54:56.334334 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:54:56.334288    2575 projected.go:196] Error preparing data for projected volume kube-api-access-rjx7d for pod openshift-network-diagnostics/network-check-target-fs6ww: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 14:54:56.334437 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:54:56.334342    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae071a8e-6ae7-4330-b5e8-776283e86b63-kube-api-access-rjx7d podName:ae071a8e-6ae7-4330-b5e8-776283e86b63 nodeName:}" failed. No retries permitted until 2026-07-09 14:54:58.334323225 +0000 UTC m=+6.176856138 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-rjx7d" (UniqueName: "kubernetes.io/projected/ae071a8e-6ae7-4330-b5e8-776283e86b63-kube-api-access-rjx7d") pod "network-check-target-fs6ww" (UID: "ae071a8e-6ae7-4330-b5e8-776283e86b63") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 14:54:56.668477 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:56.668387    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 14:49:54 +0000 UTC" deadline="2028-04-21 04:07:42.297383004 +0000 UTC"
Jul 09 14:54:56.668477 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:56.668425    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15637h12m45.628961007s"
Jul 09 14:54:58.250522 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:58.250479    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c37b4281-e19b-453c-aca5-f3fa37933b67-metrics-certs\") pod \"network-metrics-daemon-jpn9b\" (UID: \"c37b4281-e19b-453c-aca5-f3fa37933b67\") " pod="openshift-multus/network-metrics-daemon-jpn9b"
Jul 09 14:54:58.250980 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:58.250534    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bf25b5cc-fd7d-4383-ae3f-6a2fc1df007e-original-pull-secret\") pod \"global-pull-secret-syncer-f6rbl\" (UID: \"bf25b5cc-fd7d-4383-ae3f-6a2fc1df007e\") " pod="kube-system/global-pull-secret-syncer-f6rbl"
Jul 09 14:54:58.250980 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:54:58.250804    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 14:54:58.250980 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:54:58.250870    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c37b4281-e19b-453c-aca5-f3fa37933b67-metrics-certs podName:c37b4281-e19b-453c-aca5-f3fa37933b67 nodeName:}" failed. No retries permitted until 2026-07-09 14:55:02.250851421 +0000 UTC m=+10.093384345 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c37b4281-e19b-453c-aca5-f3fa37933b67-metrics-certs") pod "network-metrics-daemon-jpn9b" (UID: "c37b4281-e19b-453c-aca5-f3fa37933b67") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 14:54:58.251173 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:54:58.250976    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 14:54:58.251173 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:54:58.251028    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf25b5cc-fd7d-4383-ae3f-6a2fc1df007e-original-pull-secret podName:bf25b5cc-fd7d-4383-ae3f-6a2fc1df007e nodeName:}" failed. No retries permitted until 2026-07-09 14:55:02.251012687 +0000 UTC m=+10.093545609 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bf25b5cc-fd7d-4383-ae3f-6a2fc1df007e-original-pull-secret") pod "global-pull-secret-syncer-f6rbl" (UID: "bf25b5cc-fd7d-4383-ae3f-6a2fc1df007e") : object "kube-system"/"original-pull-secret" not registered
Jul 09 14:54:58.311079 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:58.311049    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f6rbl"
Jul 09 14:54:58.311282 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:54:58.311227    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f6rbl" podUID="bf25b5cc-fd7d-4383-ae3f-6a2fc1df007e"
Jul 09 14:54:58.311650 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:58.311632    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jpn9b"
Jul 09 14:54:58.311798 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:54:58.311755    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jpn9b" podUID="c37b4281-e19b-453c-aca5-f3fa37933b67"
Jul 09 14:54:58.311858 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:58.311820    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fs6ww"
Jul 09 14:54:58.311903 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:54:58.311886    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fs6ww" podUID="ae071a8e-6ae7-4330-b5e8-776283e86b63"
Jul 09 14:54:58.351590 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:54:58.351499    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjx7d\" (UniqueName: \"kubernetes.io/projected/ae071a8e-6ae7-4330-b5e8-776283e86b63-kube-api-access-rjx7d\") pod \"network-check-target-fs6ww\" (UID: \"ae071a8e-6ae7-4330-b5e8-776283e86b63\") " pod="openshift-network-diagnostics/network-check-target-fs6ww"
Jul 09 14:54:58.351769 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:54:58.351647    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 14:54:58.351769 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:54:58.351669    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 14:54:58.351769 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:54:58.351684    2575 projected.go:196] Error preparing data for projected volume kube-api-access-rjx7d for pod openshift-network-diagnostics/network-check-target-fs6ww: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 14:54:58.351769 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:54:58.351749    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae071a8e-6ae7-4330-b5e8-776283e86b63-kube-api-access-rjx7d podName:ae071a8e-6ae7-4330-b5e8-776283e86b63 nodeName:}" failed. No retries permitted until 2026-07-09 14:55:02.351735626 +0000 UTC m=+10.194268536 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-rjx7d" (UniqueName: "kubernetes.io/projected/ae071a8e-6ae7-4330-b5e8-776283e86b63-kube-api-access-rjx7d") pod "network-check-target-fs6ww" (UID: "ae071a8e-6ae7-4330-b5e8-776283e86b63") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 14:55:00.310686 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:00.310641    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fs6ww"
Jul 09 14:55:00.310686 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:00.310675    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f6rbl"
Jul 09 14:55:00.311217 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:00.310651    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jpn9b"
Jul 09 14:55:00.311217 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:00.310784    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fs6ww" podUID="ae071a8e-6ae7-4330-b5e8-776283e86b63"
Jul 09 14:55:00.311217 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:00.311150    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f6rbl" podUID="bf25b5cc-fd7d-4383-ae3f-6a2fc1df007e"
Jul 09 14:55:00.311318 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:00.311229    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jpn9b" podUID="c37b4281-e19b-453c-aca5-f3fa37933b67"
Jul 09 14:55:02.281580 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:02.281538    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c37b4281-e19b-453c-aca5-f3fa37933b67-metrics-certs\") pod \"network-metrics-daemon-jpn9b\" (UID: \"c37b4281-e19b-453c-aca5-f3fa37933b67\") " pod="openshift-multus/network-metrics-daemon-jpn9b"
Jul 09 14:55:02.281580 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:02.281587    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bf25b5cc-fd7d-4383-ae3f-6a2fc1df007e-original-pull-secret\") pod \"global-pull-secret-syncer-f6rbl\" (UID: \"bf25b5cc-fd7d-4383-ae3f-6a2fc1df007e\") " pod="kube-system/global-pull-secret-syncer-f6rbl"
Jul 09 14:55:02.282054 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:02.281730    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 14:55:02.282054 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:02.281808    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf25b5cc-fd7d-4383-ae3f-6a2fc1df007e-original-pull-secret podName:bf25b5cc-fd7d-4383-ae3f-6a2fc1df007e nodeName:}" failed. No retries permitted until 2026-07-09 14:55:10.281788813 +0000 UTC m=+18.124321726 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bf25b5cc-fd7d-4383-ae3f-6a2fc1df007e-original-pull-secret") pod "global-pull-secret-syncer-f6rbl" (UID: "bf25b5cc-fd7d-4383-ae3f-6a2fc1df007e") : object "kube-system"/"original-pull-secret" not registered
Jul 09 14:55:02.282149 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:02.282052    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 14:55:02.282149 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:02.282114    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c37b4281-e19b-453c-aca5-f3fa37933b67-metrics-certs podName:c37b4281-e19b-453c-aca5-f3fa37933b67 nodeName:}" failed. No retries permitted until 2026-07-09 14:55:10.282097759 +0000 UTC m=+18.124630678 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c37b4281-e19b-453c-aca5-f3fa37933b67-metrics-certs") pod "network-metrics-daemon-jpn9b" (UID: "c37b4281-e19b-453c-aca5-f3fa37933b67") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 14:55:02.310389 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:02.310362    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jpn9b"
Jul 09 14:55:02.310389 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:02.310377    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f6rbl"
Jul 09 14:55:02.310590 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:02.310392    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fs6ww"
Jul 09 14:55:02.310590 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:02.310489    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f6rbl" podUID="bf25b5cc-fd7d-4383-ae3f-6a2fc1df007e"
Jul 09 14:55:02.310885 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:02.310848    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jpn9b" podUID="c37b4281-e19b-453c-aca5-f3fa37933b67"
Jul 09 14:55:02.310965 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:02.310931    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fs6ww" podUID="ae071a8e-6ae7-4330-b5e8-776283e86b63"
Jul 09 14:55:02.382897 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:02.382851    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjx7d\" (UniqueName: \"kubernetes.io/projected/ae071a8e-6ae7-4330-b5e8-776283e86b63-kube-api-access-rjx7d\") pod \"network-check-target-fs6ww\" (UID: \"ae071a8e-6ae7-4330-b5e8-776283e86b63\") " pod="openshift-network-diagnostics/network-check-target-fs6ww"
Jul 09 14:55:02.383062 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:02.383021    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 14:55:02.383062 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:02.383047    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 14:55:02.383062 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:02.383060    2575 projected.go:196] Error preparing data for projected volume kube-api-access-rjx7d for pod openshift-network-diagnostics/network-check-target-fs6ww: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 14:55:02.383200 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:02.383121    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae071a8e-6ae7-4330-b5e8-776283e86b63-kube-api-access-rjx7d podName:ae071a8e-6ae7-4330-b5e8-776283e86b63 nodeName:}" failed. No retries permitted until 2026-07-09 14:55:10.383102359 +0000 UTC m=+18.225635272 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-rjx7d" (UniqueName: "kubernetes.io/projected/ae071a8e-6ae7-4330-b5e8-776283e86b63-kube-api-access-rjx7d") pod "network-check-target-fs6ww" (UID: "ae071a8e-6ae7-4330-b5e8-776283e86b63") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 14:55:04.311145 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:04.311086    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fs6ww"
Jul 09 14:55:04.311609 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:04.311095    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jpn9b"
Jul 09 14:55:04.311609 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:04.311210    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fs6ww" podUID="ae071a8e-6ae7-4330-b5e8-776283e86b63"
Jul 09 14:55:04.311609 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:04.311241    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f6rbl"
Jul 09 14:55:04.311609 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:04.311339    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jpn9b" podUID="c37b4281-e19b-453c-aca5-f3fa37933b67"
Jul 09 14:55:04.311609 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:04.311418    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f6rbl" podUID="bf25b5cc-fd7d-4383-ae3f-6a2fc1df007e"
Jul 09 14:55:06.311215 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:06.311183    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f6rbl"
Jul 09 14:55:06.311215 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:06.311208    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fs6ww"
Jul 09 14:55:06.311599 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:06.311288    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f6rbl" podUID="bf25b5cc-fd7d-4383-ae3f-6a2fc1df007e"
Jul 09 14:55:06.311599 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:06.311323    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jpn9b"
Jul 09 14:55:06.311599 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:06.311396    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jpn9b" podUID="c37b4281-e19b-453c-aca5-f3fa37933b67"
Jul 09 14:55:06.311807 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:06.311624    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fs6ww" podUID="ae071a8e-6ae7-4330-b5e8-776283e86b63"
Jul 09 14:55:08.310933 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:08.310901    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fs6ww"
Jul 09 14:55:08.311401 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:08.310935    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f6rbl"
Jul 09 14:55:08.311401 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:08.310935    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jpn9b"
Jul 09 14:55:08.311401 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:08.311005    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fs6ww" podUID="ae071a8e-6ae7-4330-b5e8-776283e86b63"
Jul 09 14:55:08.311401 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:08.311121    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jpn9b" podUID="c37b4281-e19b-453c-aca5-f3fa37933b67"
Jul 09 14:55:08.311401 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:08.311238    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f6rbl" podUID="bf25b5cc-fd7d-4383-ae3f-6a2fc1df007e"
Jul 09 14:55:10.311139 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:10.311100    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f6rbl"
Jul 09 14:55:10.311636 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:10.311100    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jpn9b"
Jul 09 14:55:10.311636 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:10.311241    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f6rbl" podUID="bf25b5cc-fd7d-4383-ae3f-6a2fc1df007e"
Jul 09 14:55:10.311636 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:10.311361    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jpn9b" podUID="c37b4281-e19b-453c-aca5-f3fa37933b67"
Jul 09 14:55:10.311636 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:10.311100    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fs6ww"
Jul 09 14:55:10.311636 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:10.311454    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fs6ww" podUID="ae071a8e-6ae7-4330-b5e8-776283e86b63"
Jul 09 14:55:10.342596 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:10.342572    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c37b4281-e19b-453c-aca5-f3fa37933b67-metrics-certs\") pod \"network-metrics-daemon-jpn9b\" (UID: \"c37b4281-e19b-453c-aca5-f3fa37933b67\") " pod="openshift-multus/network-metrics-daemon-jpn9b"
Jul 09 14:55:10.342596 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:10.342605    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bf25b5cc-fd7d-4383-ae3f-6a2fc1df007e-original-pull-secret\") pod \"global-pull-secret-syncer-f6rbl\" (UID: \"bf25b5cc-fd7d-4383-ae3f-6a2fc1df007e\") " pod="kube-system/global-pull-secret-syncer-f6rbl"
Jul 09 14:55:10.342825 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:10.342747    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 14:55:10.342825 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:10.342801    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c37b4281-e19b-453c-aca5-f3fa37933b67-metrics-certs podName:c37b4281-e19b-453c-aca5-f3fa37933b67 nodeName:}" failed. No retries permitted until 2026-07-09 14:55:26.342787146 +0000 UTC m=+34.185320061 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c37b4281-e19b-453c-aca5-f3fa37933b67-metrics-certs") pod "network-metrics-daemon-jpn9b" (UID: "c37b4281-e19b-453c-aca5-f3fa37933b67") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 14:55:10.342929 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:10.342747    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 14:55:10.342929 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:10.342876    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf25b5cc-fd7d-4383-ae3f-6a2fc1df007e-original-pull-secret podName:bf25b5cc-fd7d-4383-ae3f-6a2fc1df007e nodeName:}" failed. No retries permitted until 2026-07-09 14:55:26.342863083 +0000 UTC m=+34.185396009 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bf25b5cc-fd7d-4383-ae3f-6a2fc1df007e-original-pull-secret") pod "global-pull-secret-syncer-f6rbl" (UID: "bf25b5cc-fd7d-4383-ae3f-6a2fc1df007e") : object "kube-system"/"original-pull-secret" not registered
Jul 09 14:55:10.443780 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:10.443748    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjx7d\" (UniqueName: \"kubernetes.io/projected/ae071a8e-6ae7-4330-b5e8-776283e86b63-kube-api-access-rjx7d\") pod \"network-check-target-fs6ww\" (UID: \"ae071a8e-6ae7-4330-b5e8-776283e86b63\") " pod="openshift-network-diagnostics/network-check-target-fs6ww"
Jul 09 14:55:10.443917 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:10.443883    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 14:55:10.443917 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:10.443899    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 14:55:10.443917 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:10.443908    2575 projected.go:196] Error preparing data for projected volume kube-api-access-rjx7d for pod openshift-network-diagnostics/network-check-target-fs6ww: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 14:55:10.444039 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:10.443950    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae071a8e-6ae7-4330-b5e8-776283e86b63-kube-api-access-rjx7d podName:ae071a8e-6ae7-4330-b5e8-776283e86b63 nodeName:}" failed. No retries permitted until 2026-07-09 14:55:26.443937933 +0000 UTC m=+34.286470844 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-rjx7d" (UniqueName: "kubernetes.io/projected/ae071a8e-6ae7-4330-b5e8-776283e86b63-kube-api-access-rjx7d") pod "network-check-target-fs6ww" (UID: "ae071a8e-6ae7-4330-b5e8-776283e86b63") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 14:55:12.310363 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:12.310325    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jpn9b"
Jul 09 14:55:12.310825 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:12.310325    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f6rbl"
Jul 09 14:55:12.310825 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:12.310447    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jpn9b" podUID="c37b4281-e19b-453c-aca5-f3fa37933b67"
Jul 09 14:55:12.310825 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:12.310543    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f6rbl" podUID="bf25b5cc-fd7d-4383-ae3f-6a2fc1df007e"
Jul 09 14:55:12.310825 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:12.310328    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fs6ww"
Jul 09 14:55:12.310825 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:12.310650    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fs6ww" podUID="ae071a8e-6ae7-4330-b5e8-776283e86b63"
Jul 09 14:55:14.310899 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:14.310866    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f6rbl"
Jul 09 14:55:14.310899 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:14.310890    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fs6ww"
Jul 09 14:55:14.311385 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:14.310878    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jpn9b"
Jul 09 14:55:14.311385 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:14.310977    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f6rbl" podUID="bf25b5cc-fd7d-4383-ae3f-6a2fc1df007e"
Jul 09 14:55:14.311385 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:14.311064    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fs6ww" podUID="ae071a8e-6ae7-4330-b5e8-776283e86b63"
Jul 09 14:55:14.311385 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:14.311184    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jpn9b" podUID="c37b4281-e19b-453c-aca5-f3fa37933b67"
Jul 09 14:55:15.387357 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:15.386611    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4mmjb" event={"ID":"ff57ad35-41c5-4e84-af96-bf07b8b1a69e","Type":"ContainerStarted","Data":"8e09e52c966a36b2b5f5d33a607b7fd9e4877d56b16615331b6507ec5cbe895c"}
Jul 09 14:55:15.388745 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:15.388433    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qbpxv" event={"ID":"1f1e277c-317b-4031-af87-92c25d515f6e","Type":"ContainerStarted","Data":"4c872f32db1093aa7a7ef9c89b7a7bf7ada6ebc504627e7950ec344bc1b867ae"}
Jul 09 14:55:15.391192 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:15.390804    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-94.ec2.internal" event={"ID":"842163ee6bc7db204a9ad24049bf1028","Type":"ContainerStarted","Data":"923a396b4ff3a51d91f0152175c88679b97fc18f0a1092cdd64dcb47c54b7919"}
Jul 09 14:55:15.394051 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:15.394028    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zx64x" event={"ID":"40837b99-6d03-4623-af26-ff7de0ff8baa","Type":"ContainerStarted","Data":"fff7390ce373ca1bfc2ee1801897ad02b74f8c3dccba73c64408d6973e8ed8ca"}
Jul 09 14:55:15.394158 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:15.394105    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zx64x" event={"ID":"40837b99-6d03-4623-af26-ff7de0ff8baa","Type":"ContainerStarted","Data":"e9ca349cfb4166a98547fefe00238040b0053ac3db9b2093dba4da1e445b7f13"}
Jul 09 14:55:15.457412 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:15.457117    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-4mmjb" podStartSLOduration=2.443042617 podStartE2EDuration="22.457096896s" totalImagesPullingTime="20.014054279s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:54:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:55:15.430067441 +0000 UTC m=+23.272600375" watchObservedRunningTime="2026-07-09 14:55:15.457096896 +0000 UTC m=+23.299629829"
Jul 09 14:55:15.457749 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:15.457598    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-qbpxv" podStartSLOduration=2.410753018 podStartE2EDuration="22.457584595s" totalImagesPullingTime="20.046831577s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:54:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:55:15.455549502 +0000 UTC m=+23.298082434" watchObservedRunningTime="2026-07-09 14:55:15.457584595 +0000 UTC m=+23.300117528"
Jul 09 14:55:15.483464 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:15.483428    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-94.ec2.internal" podStartSLOduration=21.483414891 podStartE2EDuration="21.483414891s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:54:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:55:15.483406877 +0000 UTC m=+23.325939810" watchObservedRunningTime="2026-07-09 14:55:15.483414891 +0000 UTC m=+23.325947836"
Jul 09 14:55:16.310416 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:16.310389    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f6rbl"
Jul 09 14:55:16.310730 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:16.310491    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jpn9b"
Jul 09 14:55:16.310730 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:16.310499    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f6rbl" podUID="bf25b5cc-fd7d-4383-ae3f-6a2fc1df007e"
Jul 09 14:55:16.310730 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:16.310522    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fs6ww"
Jul 09 14:55:16.310730 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:16.310605    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jpn9b" podUID="c37b4281-e19b-453c-aca5-f3fa37933b67"
Jul 09 14:55:16.310730 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:16.310673    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fs6ww" podUID="ae071a8e-6ae7-4330-b5e8-776283e86b63"
Jul 09 14:55:16.397414 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:16.397380    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2snzr" event={"ID":"ffe714b8-b418-41dd-8e65-e0467b6fa27b","Type":"ContainerStarted","Data":"9b16e5a359285eb21b7e637dc3aac7e1c9e277b2eb25a39e0a14f2c1b8ef193d"}
Jul 09 14:55:16.398944 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:16.398919    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zxwhs" event={"ID":"030200a1-2c06-4390-ab1b-d3e79bd705f2","Type":"ContainerStarted","Data":"49326b08d2e1b75c92968b2c4be620f4958c019fe7fa5823f7bceb12dd55855c"}
Jul 09 14:55:16.400404 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:16.400379    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xmx5q" event={"ID":"fcff5fbe-84d3-47a1-9cde-4db751cbaae6","Type":"ContainerStarted","Data":"1cd5fad9a9630162b182d9fdf8b0c61675b8d22b04d9ad4279b28f503747f0e5"}
Jul 09 14:55:16.405702 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:16.405681    2575 generic.go:356] "Generic (PLEG): container finished" podID="779ead75-a855-4c93-bfdf-c38546b8a181" containerID="dd160321aef9c11a457d6840ff538eef8563a659c376dfe89e020fcc39fbb929" exitCode=0
Jul 09 14:55:16.405825 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:16.405745    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lhnsd" event={"ID":"779ead75-a855-4c93-bfdf-c38546b8a181","Type":"ContainerDied","Data":"dd160321aef9c11a457d6840ff538eef8563a659c376dfe89e020fcc39fbb929"}
Jul 09 14:55:16.407368 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:16.407300    2575 generic.go:356] "Generic (PLEG): container finished" podID="e768764d27b505cd33de9c3393775e16" containerID="c2e25c75132f1d5786195b7c8a959e52e64a7c0537c830446c0f3a97266392d1" exitCode=0
Jul 09 14:55:16.407368 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:16.407345    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-94.ec2.internal" event={"ID":"e768764d27b505cd33de9c3393775e16","Type":"ContainerDied","Data":"c2e25c75132f1d5786195b7c8a959e52e64a7c0537c830446c0f3a97266392d1"}
Jul 09 14:55:16.408999 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:16.408974    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2pbcc" event={"ID":"6e3ee08b-fbd7-4ff0-b953-fd749858497c","Type":"ContainerStarted","Data":"a1934dd71ed4762206207d13ad83a8fcbd8e4a9d8b0063db57e15851fa659d7c"}
Jul 09 14:55:16.412426 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:16.412380    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zx64x" event={"ID":"40837b99-6d03-4623-af26-ff7de0ff8baa","Type":"ContainerStarted","Data":"6befc97b2726dd478eeff9d137c0c08be636bb805d75946f63bdbd016a1e2ef0"}
Jul 09 14:55:16.412538 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:16.412444    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zx64x" event={"ID":"40837b99-6d03-4623-af26-ff7de0ff8baa","Type":"ContainerStarted","Data":"3150b2f1177bb429279331f8d2923f5fd24ebb2a6cd3abdfb403ae0f492a7cfc"}
Jul 09 14:55:16.412538 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:16.412485    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zx64x" event={"ID":"40837b99-6d03-4623-af26-ff7de0ff8baa","Type":"ContainerStarted","Data":"feee602c456737803f96f13566731b2eb1cd2e5ace1f0bb68bc95adba6ae4491"}
Jul 09 14:55:16.412538 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:16.412532    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zx64x" event={"ID":"40837b99-6d03-4623-af26-ff7de0ff8baa","Type":"ContainerStarted","Data":"7be517044c821fa0c0ab52175d62e656eebbdf876316d5480f3a75ef5c8e180a"}
Jul 09 14:55:16.413855 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:16.413837    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6v5hh" event={"ID":"20ab37e4-d0b4-4298-bd29-c05f465cd6b0","Type":"ContainerStarted","Data":"81583fa5b26436c362fc66e94b1aaec6e13454a91babdff22da1b6ee50ae610a"}
Jul 09 14:55:16.417843 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:16.417800    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-2snzr" podStartSLOduration=3.383219772 podStartE2EDuration="23.417788622s" totalImagesPullingTime="20.03456885s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:54:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:55:16.417281984 +0000 UTC m=+24.259814916" watchObservedRunningTime="2026-07-09 14:55:16.417788622 +0000 UTC m=+24.260321553"
Jul 09 14:55:16.434556 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:16.434492    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-zxwhs" podStartSLOduration=3.368441169 podStartE2EDuration="23.434477775s" totalImagesPullingTime="20.066036606s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:54:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:55:16.43440393 +0000 UTC m=+24.276936863" watchObservedRunningTime="2026-07-09 14:55:16.434477775 +0000 UTC m=+24.277010710"
Jul 09 14:55:16.452234 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:16.452194    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-2pbcc" podStartSLOduration=11.694048343 podStartE2EDuration="23.452181547s" totalImagesPullingTime="11.758133204s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:54:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:55:16.451884142 +0000 UTC m=+24.294417074" watchObservedRunningTime="2026-07-09 14:55:16.452181547 +0000 UTC m=+24.294714478"
Jul 09 14:55:16.524998 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:16.524950    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-xmx5q" podStartSLOduration=3.4814694299999998 podStartE2EDuration="23.524932086s" totalImagesPullingTime="20.043462656s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:54:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:55:16.496907019 +0000 UTC m=+24.339439952" watchObservedRunningTime="2026-07-09 14:55:16.524932086 +0000 UTC m=+24.367465019"
Jul 09 14:55:16.736565 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:16.736542    2575 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 09 14:55:16.906782 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:16.906701    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-2pbcc"
Jul 09 14:55:16.907251 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:16.907232    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-2pbcc"
Jul 09 14:55:17.329310 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:17.329104    2575 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-09T14:55:16.736561781Z","UUID":"e9b4d676-43be-4662-94db-1f9ecfd5686d","Handler":null,"Name":"","Endpoint":""}
Jul 09 14:55:17.330896 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:17.330840    2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 09 14:55:17.330896 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:17.330885    2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 09 14:55:17.419954 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:17.419917    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-94.ec2.internal" event={"ID":"e768764d27b505cd33de9c3393775e16","Type":"ContainerStarted","Data":"400bdd4afb48d8020f9e3787f4eef76e7cd113f263f5d171fbaf9c630457452a"}
Jul 09 14:55:17.422179 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:17.422148    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6v5hh" event={"ID":"20ab37e4-d0b4-4298-bd29-c05f465cd6b0","Type":"ContainerStarted","Data":"af04e2e3db4ea38a24926abb8ceacfd356bc0eb6002841a173a9f20238cc5b74"}
Jul 09 14:55:17.422774 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:17.422752    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-2pbcc"
Jul 09 14:55:17.423424 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:17.423406    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-2pbcc"
Jul 09 14:55:17.440879 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:17.440830    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-94.ec2.internal" podStartSLOduration=23.440817945 podStartE2EDuration="23.440817945s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:54:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:55:17.44045556 +0000 UTC m=+25.282988492" watchObservedRunningTime="2026-07-09 14:55:17.440817945 +0000 UTC m=+25.283350877"
Jul 09 14:55:18.310931 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:18.310898    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fs6ww"
Jul 09 14:55:18.311094 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:18.310937    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f6rbl"
Jul 09 14:55:18.311094 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:18.311000    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jpn9b"
Jul 09 14:55:18.311094 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:18.311016    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fs6ww" podUID="ae071a8e-6ae7-4330-b5e8-776283e86b63"
Jul 09 14:55:18.311094 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:18.311081    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jpn9b" podUID="c37b4281-e19b-453c-aca5-f3fa37933b67"
Jul 09 14:55:18.311292 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:18.311125    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f6rbl" podUID="bf25b5cc-fd7d-4383-ae3f-6a2fc1df007e"
Jul 09 14:55:18.428127 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:18.428046    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zx64x" event={"ID":"40837b99-6d03-4623-af26-ff7de0ff8baa","Type":"ContainerStarted","Data":"c4c624a1c819a37f0563ede1f2ca971bae0d0434ed74eceb9e38b414f49d18f8"}
Jul 09 14:55:18.430435 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:18.430403    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6v5hh" event={"ID":"20ab37e4-d0b4-4298-bd29-c05f465cd6b0","Type":"ContainerStarted","Data":"65b97920d13d0bf35477f8b741f2fd3e4d79c0a18e3f538c6fdb6d438e7768f4"}
Jul 09 14:55:18.455272 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:18.455220    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6v5hh" podStartSLOduration=2.887970986 podStartE2EDuration="25.455202131s" totalImagesPullingTime="22.567231145s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:54:53 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:55:18.454856862 +0000 UTC m=+26.297389794" watchObservedRunningTime="2026-07-09 14:55:18.455202131 +0000 UTC m=+26.297735065"
Jul 09 14:55:20.311404 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:20.311217    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f6rbl"
Jul 09 14:55:20.311845 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:20.311217    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fs6ww"
Jul 09 14:55:20.311845 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:20.311494    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f6rbl" podUID="bf25b5cc-fd7d-4383-ae3f-6a2fc1df007e"
Jul 09 14:55:20.311845 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:20.311556    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fs6ww" podUID="ae071a8e-6ae7-4330-b5e8-776283e86b63"
Jul 09 14:55:20.311845 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:20.311217    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jpn9b"
Jul 09 14:55:20.311845 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:20.311691    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jpn9b" podUID="c37b4281-e19b-453c-aca5-f3fa37933b67"
Jul 09 14:55:22.310793 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:22.310584    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fs6ww"
Jul 09 14:55:22.311207 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:22.310628    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jpn9b"
Jul 09 14:55:22.311207 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:22.310882    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fs6ww" podUID="ae071a8e-6ae7-4330-b5e8-776283e86b63"
Jul 09 14:55:22.311207 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:22.310627    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f6rbl"
Jul 09 14:55:22.311207 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:22.310949    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jpn9b" podUID="c37b4281-e19b-453c-aca5-f3fa37933b67"
Jul 09 14:55:22.311207 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:22.311015    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f6rbl" podUID="bf25b5cc-fd7d-4383-ae3f-6a2fc1df007e"
Jul 09 14:55:22.441628 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:22.441518    2575 generic.go:356] "Generic (PLEG): container finished" podID="779ead75-a855-4c93-bfdf-c38546b8a181" containerID="21cd18a99a4048b9066fe31a1730fe0a28fec14d1bfa3fa7db37a4587d4a89f4" exitCode=0
Jul 09 14:55:22.441628 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:22.441606    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lhnsd" event={"ID":"779ead75-a855-4c93-bfdf-c38546b8a181","Type":"ContainerDied","Data":"21cd18a99a4048b9066fe31a1730fe0a28fec14d1bfa3fa7db37a4587d4a89f4"}
Jul 09 14:55:22.445183 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:22.445162    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zx64x" event={"ID":"40837b99-6d03-4623-af26-ff7de0ff8baa","Type":"ContainerStarted","Data":"12de811cf43c64caf64c816386b3eb9ad94dd4b94bb8aef969edfd1be04e699c"}
Jul 09 14:55:22.445450 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:22.445427    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zx64x"
Jul 09 14:55:22.445549 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:22.445486    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zx64x"
Jul 09 14:55:22.445549 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:22.445520    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zx64x"
Jul 09 14:55:22.460362 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:22.460342    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zx64x"
Jul 09 14:55:22.460538 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:22.460525    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zx64x"
Jul 09 14:55:22.504680 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:22.504629    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-zx64x" podStartSLOduration=9.292571543 podStartE2EDuration="29.504616836s" totalImagesPullingTime="20.212045293s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:54:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:55:22.504520281 +0000 UTC m=+30.347053211" watchObservedRunningTime="2026-07-09 14:55:22.504616836 +0000 UTC m=+30.347149765"
Jul 09 14:55:23.449134 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:23.449054    2575 generic.go:356] "Generic (PLEG): container finished" podID="779ead75-a855-4c93-bfdf-c38546b8a181" containerID="e61bf04d320c74c9b53306a8d5456ab9bc6c15e62ef5eec76957873e2bbe4ed4" exitCode=0
Jul 09 14:55:23.449500 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:23.449136    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lhnsd" event={"ID":"779ead75-a855-4c93-bfdf-c38546b8a181","Type":"ContainerDied","Data":"e61bf04d320c74c9b53306a8d5456ab9bc6c15e62ef5eec76957873e2bbe4ed4"}
Jul 09 14:55:24.196815 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:24.196781    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jpn9b"]
Jul 09 14:55:24.197000 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:24.196946    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jpn9b"
Jul 09 14:55:24.197094 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:24.197068    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jpn9b" podUID="c37b4281-e19b-453c-aca5-f3fa37933b67"
Jul 09 14:55:24.201485 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:24.201457    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fs6ww"]
Jul 09 14:55:24.201649 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:24.201575    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fs6ww"
Jul 09 14:55:24.201725 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:24.201667    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fs6ww" podUID="ae071a8e-6ae7-4330-b5e8-776283e86b63"
Jul 09 14:55:24.217984 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:24.217954    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-f6rbl"]
Jul 09 14:55:24.218154 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:24.218069    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f6rbl"
Jul 09 14:55:24.218213 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:24.218171    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f6rbl" podUID="bf25b5cc-fd7d-4383-ae3f-6a2fc1df007e"
Jul 09 14:55:24.454287 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:24.454230    2575 generic.go:356] "Generic (PLEG): container finished" podID="779ead75-a855-4c93-bfdf-c38546b8a181" containerID="0d3a5b91be359d34473f405b1749e556a867b0226efe462b008e4bff0b43cb73" exitCode=0
Jul 09 14:55:24.454660 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:24.454311    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lhnsd" event={"ID":"779ead75-a855-4c93-bfdf-c38546b8a181","Type":"ContainerDied","Data":"0d3a5b91be359d34473f405b1749e556a867b0226efe462b008e4bff0b43cb73"}
Jul 09 14:55:26.311057 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:26.310974    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fs6ww"
Jul 09 14:55:26.311480 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:26.311092    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f6rbl"
Jul 09 14:55:26.311480 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:26.311103    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fs6ww" podUID="ae071a8e-6ae7-4330-b5e8-776283e86b63"
Jul 09 14:55:26.311480 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:26.311121    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jpn9b"
Jul 09 14:55:26.311480 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:26.311272    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f6rbl" podUID="bf25b5cc-fd7d-4383-ae3f-6a2fc1df007e"
Jul 09 14:55:26.311480 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:26.311361    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jpn9b" podUID="c37b4281-e19b-453c-aca5-f3fa37933b67"
Jul 09 14:55:26.361552 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:26.361516    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c37b4281-e19b-453c-aca5-f3fa37933b67-metrics-certs\") pod \"network-metrics-daemon-jpn9b\" (UID: \"c37b4281-e19b-453c-aca5-f3fa37933b67\") " pod="openshift-multus/network-metrics-daemon-jpn9b"
Jul 09 14:55:26.361742 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:26.361571    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bf25b5cc-fd7d-4383-ae3f-6a2fc1df007e-original-pull-secret\") pod \"global-pull-secret-syncer-f6rbl\" (UID: \"bf25b5cc-fd7d-4383-ae3f-6a2fc1df007e\") " pod="kube-system/global-pull-secret-syncer-f6rbl"
Jul 09 14:55:26.361742 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:26.361692    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 14:55:26.361742 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:26.361727    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 14:55:26.361908 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:26.361778    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c37b4281-e19b-453c-aca5-f3fa37933b67-metrics-certs podName:c37b4281-e19b-453c-aca5-f3fa37933b67 nodeName:}" failed. No retries permitted until 2026-07-09 14:55:58.361758563 +0000 UTC m=+66.204291476 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c37b4281-e19b-453c-aca5-f3fa37933b67-metrics-certs") pod "network-metrics-daemon-jpn9b" (UID: "c37b4281-e19b-453c-aca5-f3fa37933b67") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 14:55:26.361908 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:26.361800    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf25b5cc-fd7d-4383-ae3f-6a2fc1df007e-original-pull-secret podName:bf25b5cc-fd7d-4383-ae3f-6a2fc1df007e nodeName:}" failed. No retries permitted until 2026-07-09 14:55:58.36178929 +0000 UTC m=+66.204322203 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bf25b5cc-fd7d-4383-ae3f-6a2fc1df007e-original-pull-secret") pod "global-pull-secret-syncer-f6rbl" (UID: "bf25b5cc-fd7d-4383-ae3f-6a2fc1df007e") : object "kube-system"/"original-pull-secret" not registered
Jul 09 14:55:26.462623 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:26.462580    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjx7d\" (UniqueName: \"kubernetes.io/projected/ae071a8e-6ae7-4330-b5e8-776283e86b63-kube-api-access-rjx7d\") pod \"network-check-target-fs6ww\" (UID: \"ae071a8e-6ae7-4330-b5e8-776283e86b63\") " pod="openshift-network-diagnostics/network-check-target-fs6ww"
Jul 09 14:55:26.462817 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:26.462743    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 14:55:26.462817 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:26.462769    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 14:55:26.462817 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:26.462781    2575 projected.go:196] Error preparing data for projected volume kube-api-access-rjx7d for pod openshift-network-diagnostics/network-check-target-fs6ww: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 14:55:26.462974 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:26.462841    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae071a8e-6ae7-4330-b5e8-776283e86b63-kube-api-access-rjx7d podName:ae071a8e-6ae7-4330-b5e8-776283e86b63 nodeName:}" failed. No retries permitted until 2026-07-09 14:55:58.462825287 +0000 UTC m=+66.305358199 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-rjx7d" (UniqueName: "kubernetes.io/projected/ae071a8e-6ae7-4330-b5e8-776283e86b63-kube-api-access-rjx7d") pod "network-check-target-fs6ww" (UID: "ae071a8e-6ae7-4330-b5e8-776283e86b63") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 14:55:27.909143 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:27.909053    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-94.ec2.internal" event="NodeReady"
Jul 09 14:55:27.909650 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:27.909216    2575 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 09 14:55:27.956513 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:27.956474    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dc9c8f7b6-dxptp"]
Jul 09 14:55:27.959996 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:27.959975    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dc9c8f7b6-dxptp"
Jul 09 14:55:27.961222 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:27.961143    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-85c46dccf6-wnfkx"]
Jul 09 14:55:27.963825 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:27.963800    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 09 14:55:27.963932 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:27.963822    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 09 14:55:27.963998 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:27.963930    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 09 14:55:27.964195 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:27.964174    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b65dc8b7d-24jr7"]
Jul 09 14:55:27.964370 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:27.964352    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85c46dccf6-wnfkx"
Jul 09 14:55:27.964525 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:27.964509    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 09 14:55:27.967334 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:27.967314    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57bf8d5b48-fslzd"]
Jul 09 14:55:27.967633 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:27.967516    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b65dc8b7d-24jr7"
Jul 09 14:55:27.968357 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:27.968339    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 09 14:55:27.968443 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:27.968393    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-gfkwb\""
Jul 09 14:55:27.970340 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:27.970321    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-qkh9h"]
Jul 09 14:55:27.970466 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:27.970449    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57bf8d5b48-fslzd"
Jul 09 14:55:27.970731 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:27.970692    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 09 14:55:27.971063 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:27.971040    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-47ltj\""
Jul 09 14:55:27.971063 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:27.971045    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 09 14:55:27.972265 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:27.971779    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 09 14:55:27.975298 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:27.973755    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 09 14:55:27.975298 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:27.974529    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-qkh9h"
Jul 09 14:55:27.975298 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:27.974562    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 09 14:55:27.975298 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:27.974592    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 09 14:55:27.978176 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:27.975789    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 09 14:55:27.978176 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:27.976917    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 09 14:55:27.978176 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:27.977603    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 09 14:55:27.978176 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:27.978091    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-tjbtl"]
Jul 09 14:55:27.978176 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:27.978159    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-74p4g\""
Jul 09 14:55:27.979504 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:27.979325    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 09 14:55:27.983530 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:27.983510    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dc9c8f7b6-dxptp"]
Jul 09 14:55:27.983637 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:27.983619    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tjbtl"
Jul 09 14:55:27.985295 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:27.985272    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b65dc8b7d-24jr7"]
Jul 09 14:55:27.986213 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:27.986194    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57bf8d5b48-fslzd"]
Jul 09 14:55:27.987043 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:27.987023    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-qkh9h"]
Jul 09 14:55:27.988110 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:27.988073    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mn998\""
Jul 09 14:55:27.988319 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:27.988301    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 09 14:55:27.989127 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:27.989061    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 09 14:55:27.989802 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:27.989784    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-bsf52"]
Jul 09 14:55:27.992824 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:27.992806    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-85c46dccf6-wnfkx"]
Jul 09 14:55:27.993013 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:27.992929    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bsf52"
Jul 09 14:55:27.998423 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:27.998403    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 09 14:55:27.998502 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:27.998438    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 09 14:55:27.998677 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:27.998662    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 09 14:55:27.998677 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:27.998672    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-qmd6h\""
Jul 09 14:55:28.005084 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.005064    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bsf52"]
Jul 09 14:55:28.006436 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.006418    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tjbtl"]
Jul 09 14:55:28.077136 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.077101    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/03d6966e-dce9-4725-94f4-fbeafd3f48f0-ca-trust-extracted\") pod \"image-registry-85c46dccf6-wnfkx\" (UID: \"03d6966e-dce9-4725-94f4-fbeafd3f48f0\") " pod="openshift-image-registry/image-registry-85c46dccf6-wnfkx"
Jul 09 14:55:28.077288 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.077142    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4da1e96e-5ef6-4039-9a5e-0f1745820cc8-config-volume\") pod \"dns-default-tjbtl\" (UID: \"4da1e96e-5ef6-4039-9a5e-0f1745820cc8\") " pod="openshift-dns/dns-default-tjbtl"
Jul 09 14:55:28.077288 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.077197    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ps27z\" (UniqueName: \"kubernetes.io/projected/03d6966e-dce9-4725-94f4-fbeafd3f48f0-kube-api-access-ps27z\") pod \"image-registry-85c46dccf6-wnfkx\" (UID: \"03d6966e-dce9-4725-94f4-fbeafd3f48f0\") " pod="openshift-image-registry/image-registry-85c46dccf6-wnfkx"
Jul 09 14:55:28.077288 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.077225    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/03d6966e-dce9-4725-94f4-fbeafd3f48f0-registry-tls\") pod \"image-registry-85c46dccf6-wnfkx\" (UID: \"03d6966e-dce9-4725-94f4-fbeafd3f48f0\") " pod="openshift-image-registry/image-registry-85c46dccf6-wnfkx"
Jul 09 14:55:28.077288 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.077250    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/03d6966e-dce9-4725-94f4-fbeafd3f48f0-bound-sa-token\") pod \"image-registry-85c46dccf6-wnfkx\" (UID: \"03d6966e-dce9-4725-94f4-fbeafd3f48f0\") " pod="openshift-image-registry/image-registry-85c46dccf6-wnfkx"
Jul 09 14:55:28.077451 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.077308    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c369b2d0-4cba-42f1-9268-689f4e694970-tmp\") pod \"klusterlet-addon-workmgr-5dc9c8f7b6-dxptp\" (UID: \"c369b2d0-4cba-42f1-9268-689f4e694970\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dc9c8f7b6-dxptp"
Jul 09 14:55:28.077451 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.077337    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fceb57a3-32ec-4a87-92a4-e92920e8326a-cert\") pod \"ingress-canary-bsf52\" (UID: \"fceb57a3-32ec-4a87-92a4-e92920e8326a\") " pod="openshift-ingress-canary/ingress-canary-bsf52"
Jul 09 14:55:28.077451 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.077360    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/03d6966e-dce9-4725-94f4-fbeafd3f48f0-installation-pull-secrets\") pod \"image-registry-85c46dccf6-wnfkx\" (UID: \"03d6966e-dce9-4725-94f4-fbeafd3f48f0\") " pod="openshift-image-registry/image-registry-85c46dccf6-wnfkx"
Jul 09 14:55:28.077451 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.077389    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l55xq\" (UniqueName: \"kubernetes.io/projected/4033d521-7b5b-4604-b9e2-90c6793fe0e3-kube-api-access-l55xq\") pod \"managed-serviceaccount-addon-agent-5b65dc8b7d-24jr7\" (UID: \"4033d521-7b5b-4604-b9e2-90c6793fe0e3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b65dc8b7d-24jr7"
Jul 09 14:55:28.077451 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.077419    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/7b7fc356-35d5-4aae-af54-3633423b16d1-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-57bf8d5b48-fslzd\" (UID: \"7b7fc356-35d5-4aae-af54-3633423b16d1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57bf8d5b48-fslzd"
Jul 09 14:55:28.077451 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.077437    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gb8r\" (UniqueName: \"kubernetes.io/projected/4da1e96e-5ef6-4039-9a5e-0f1745820cc8-kube-api-access-8gb8r\") pod \"dns-default-tjbtl\" (UID: \"4da1e96e-5ef6-4039-9a5e-0f1745820cc8\") " pod="openshift-dns/dns-default-tjbtl"
Jul 09 14:55:28.077648 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.077454    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4da1e96e-5ef6-4039-9a5e-0f1745820cc8-tmp-dir\") pod \"dns-default-tjbtl\" (UID: \"4da1e96e-5ef6-4039-9a5e-0f1745820cc8\") " pod="openshift-dns/dns-default-tjbtl"
Jul 09 14:55:28.077648 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.077507    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c006160e-a992-4ef4-86d2-a0ecd918f582-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-qkh9h\" (UID: \"c006160e-a992-4ef4-86d2-a0ecd918f582\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-qkh9h"
Jul 09 14:55:28.077648 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.077543    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/c369b2d0-4cba-42f1-9268-689f4e694970-klusterlet-config\") pod \"klusterlet-addon-workmgr-5dc9c8f7b6-dxptp\" (UID: \"c369b2d0-4cba-42f1-9268-689f4e694970\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dc9c8f7b6-dxptp"
Jul 09 14:55:28.077648 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.077567    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgv6b\" (UniqueName: \"kubernetes.io/projected/7b7fc356-35d5-4aae-af54-3633423b16d1-kube-api-access-rgv6b\") pod \"cluster-proxy-proxy-agent-57bf8d5b48-fslzd\" (UID: \"7b7fc356-35d5-4aae-af54-3633423b16d1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57bf8d5b48-fslzd"
Jul 09 14:55:28.077648 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.077590    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vzzn\" (UniqueName: \"kubernetes.io/projected/c369b2d0-4cba-42f1-9268-689f4e694970-kube-api-access-4vzzn\") pod \"klusterlet-addon-workmgr-5dc9c8f7b6-dxptp\" (UID: \"c369b2d0-4cba-42f1-9268-689f4e694970\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dc9c8f7b6-dxptp"
Jul 09 14:55:28.077648 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.077604    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2g8l\" (UniqueName: \"kubernetes.io/projected/fceb57a3-32ec-4a87-92a4-e92920e8326a-kube-api-access-l2g8l\") pod \"ingress-canary-bsf52\" (UID: \"fceb57a3-32ec-4a87-92a4-e92920e8326a\") " pod="openshift-ingress-canary/ingress-canary-bsf52"
Jul 09 14:55:28.077648 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.077620    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/7b7fc356-35d5-4aae-af54-3633423b16d1-hub\") pod \"cluster-proxy-proxy-agent-57bf8d5b48-fslzd\" (UID: \"7b7fc356-35d5-4aae-af54-3633423b16d1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57bf8d5b48-fslzd"
Jul 09 14:55:28.077648 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.077644    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/03d6966e-dce9-4725-94f4-fbeafd3f48f0-registry-certificates\") pod \"image-registry-85c46dccf6-wnfkx\" (UID: \"03d6966e-dce9-4725-94f4-fbeafd3f48f0\") " pod="openshift-image-registry/image-registry-85c46dccf6-wnfkx"
Jul 09 14:55:28.078047 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.077683    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c006160e-a992-4ef4-86d2-a0ecd918f582-nginx-conf\") pod \"networking-console-plugin-6cf856758c-qkh9h\" (UID: \"c006160e-a992-4ef4-86d2-a0ecd918f582\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-qkh9h"
Jul 09 14:55:28.078047 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.077751    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7b7fc356-35d5-4aae-af54-3633423b16d1-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-57bf8d5b48-fslzd\" (UID: \"7b7fc356-35d5-4aae-af54-3633423b16d1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57bf8d5b48-fslzd"
Jul 09 14:55:28.078047 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.077778    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b7fc356-35d5-4aae-af54-3633423b16d1-additional-service-ca\") pod \"cluster-proxy-proxy-agent-57bf8d5b48-fslzd\" (UID: \"7b7fc356-35d5-4aae-af54-3633423b16d1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57bf8d5b48-fslzd"
Jul 09 14:55:28.078047 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.077823    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/03d6966e-dce9-4725-94f4-fbeafd3f48f0-image-registry-private-configuration\") pod \"image-registry-85c46dccf6-wnfkx\" (UID: \"03d6966e-dce9-4725-94f4-fbeafd3f48f0\") " pod="openshift-image-registry/image-registry-85c46dccf6-wnfkx"
Jul 09 14:55:28.078047 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.077863    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/7b7fc356-35d5-4aae-af54-3633423b16d1-ca\") pod \"cluster-proxy-proxy-agent-57bf8d5b48-fslzd\" (UID: \"7b7fc356-35d5-4aae-af54-3633423b16d1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57bf8d5b48-fslzd"
Jul 09 14:55:28.078047 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.077889    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4da1e96e-5ef6-4039-9a5e-0f1745820cc8-metrics-tls\") pod \"dns-default-tjbtl\" (UID: \"4da1e96e-5ef6-4039-9a5e-0f1745820cc8\") " pod="openshift-dns/dns-default-tjbtl"
Jul 09 14:55:28.078047 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.077915    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4033d521-7b5b-4604-b9e2-90c6793fe0e3-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5b65dc8b7d-24jr7\" (UID: \"4033d521-7b5b-4604-b9e2-90c6793fe0e3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b65dc8b7d-24jr7"
Jul 09 14:55:28.078047 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.077944    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/03d6966e-dce9-4725-94f4-fbeafd3f48f0-trusted-ca\") pod \"image-registry-85c46dccf6-wnfkx\" (UID: \"03d6966e-dce9-4725-94f4-fbeafd3f48f0\") " pod="openshift-image-registry/image-registry-85c46dccf6-wnfkx"
Jul 09 14:55:28.150391 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.150355    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:28.178478 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.178401    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/03d6966e-dce9-4725-94f4-fbeafd3f48f0-bound-sa-token\") pod \"image-registry-85c46dccf6-wnfkx\" (UID: \"03d6966e-dce9-4725-94f4-fbeafd3f48f0\") " pod="openshift-image-registry/image-registry-85c46dccf6-wnfkx"
Jul 09 14:55:28.178478 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.178446    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c369b2d0-4cba-42f1-9268-689f4e694970-tmp\") pod \"klusterlet-addon-workmgr-5dc9c8f7b6-dxptp\" (UID: \"c369b2d0-4cba-42f1-9268-689f4e694970\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dc9c8f7b6-dxptp"
Jul 09 14:55:28.178478 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.178465    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fceb57a3-32ec-4a87-92a4-e92920e8326a-cert\") pod \"ingress-canary-bsf52\" (UID: \"fceb57a3-32ec-4a87-92a4-e92920e8326a\") " pod="openshift-ingress-canary/ingress-canary-bsf52"
Jul 09 14:55:28.178777 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.178548    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/03d6966e-dce9-4725-94f4-fbeafd3f48f0-installation-pull-secrets\") pod \"image-registry-85c46dccf6-wnfkx\" (UID: \"03d6966e-dce9-4725-94f4-fbeafd3f48f0\") " pod="openshift-image-registry/image-registry-85c46dccf6-wnfkx"
Jul 09 14:55:28.178777 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.178604    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l55xq\" (UniqueName: \"kubernetes.io/projected/4033d521-7b5b-4604-b9e2-90c6793fe0e3-kube-api-access-l55xq\") pod \"managed-serviceaccount-addon-agent-5b65dc8b7d-24jr7\" (UID: \"4033d521-7b5b-4604-b9e2-90c6793fe0e3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b65dc8b7d-24jr7"
Jul 09 14:55:28.178777 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.178643    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/7b7fc356-35d5-4aae-af54-3633423b16d1-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-57bf8d5b48-fslzd\" (UID: \"7b7fc356-35d5-4aae-af54-3633423b16d1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57bf8d5b48-fslzd"
Jul 09 14:55:28.178777 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.178666    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gb8r\" (UniqueName: \"kubernetes.io/projected/4da1e96e-5ef6-4039-9a5e-0f1745820cc8-kube-api-access-8gb8r\") pod \"dns-default-tjbtl\" (UID: \"4da1e96e-5ef6-4039-9a5e-0f1745820cc8\") " pod="openshift-dns/dns-default-tjbtl"
Jul 09 14:55:28.178777 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.178692    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4da1e96e-5ef6-4039-9a5e-0f1745820cc8-tmp-dir\") pod \"dns-default-tjbtl\" (UID: \"4da1e96e-5ef6-4039-9a5e-0f1745820cc8\") " pod="openshift-dns/dns-default-tjbtl"
Jul 09 14:55:28.178777 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.178743    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c006160e-a992-4ef4-86d2-a0ecd918f582-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-qkh9h\" (UID: \"c006160e-a992-4ef4-86d2-a0ecd918f582\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-qkh9h"
Jul 09 14:55:28.178777 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.178775    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/c369b2d0-4cba-42f1-9268-689f4e694970-klusterlet-config\") pod \"klusterlet-addon-workmgr-5dc9c8f7b6-dxptp\" (UID: \"c369b2d0-4cba-42f1-9268-689f4e694970\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dc9c8f7b6-dxptp"
Jul 09 14:55:28.179119 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.178803    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgv6b\" (UniqueName: \"kubernetes.io/projected/7b7fc356-35d5-4aae-af54-3633423b16d1-kube-api-access-rgv6b\") pod \"cluster-proxy-proxy-agent-57bf8d5b48-fslzd\" (UID: \"7b7fc356-35d5-4aae-af54-3633423b16d1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57bf8d5b48-fslzd"
Jul 09 14:55:28.179119 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.178830    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vzzn\" (UniqueName: \"kubernetes.io/projected/c369b2d0-4cba-42f1-9268-689f4e694970-kube-api-access-4vzzn\") pod \"klusterlet-addon-workmgr-5dc9c8f7b6-dxptp\" (UID: \"c369b2d0-4cba-42f1-9268-689f4e694970\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dc9c8f7b6-dxptp"
Jul 09 14:55:28.179119 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.178853    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2g8l\" (UniqueName: \"kubernetes.io/projected/fceb57a3-32ec-4a87-92a4-e92920e8326a-kube-api-access-l2g8l\") pod \"ingress-canary-bsf52\" (UID: \"fceb57a3-32ec-4a87-92a4-e92920e8326a\") " pod="openshift-ingress-canary/ingress-canary-bsf52"
Jul 09 14:55:28.179119 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.178878    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/7b7fc356-35d5-4aae-af54-3633423b16d1-hub\") pod \"cluster-proxy-proxy-agent-57bf8d5b48-fslzd\" (UID: \"7b7fc356-35d5-4aae-af54-3633423b16d1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57bf8d5b48-fslzd"
Jul 09 14:55:28.179119 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.178910    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/03d6966e-dce9-4725-94f4-fbeafd3f48f0-registry-certificates\") pod \"image-registry-85c46dccf6-wnfkx\" (UID: \"03d6966e-dce9-4725-94f4-fbeafd3f48f0\") " pod="openshift-image-registry/image-registry-85c46dccf6-wnfkx"
Jul 09 14:55:28.179119 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.178935    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c006160e-a992-4ef4-86d2-a0ecd918f582-nginx-conf\") pod \"networking-console-plugin-6cf856758c-qkh9h\" (UID: \"c006160e-a992-4ef4-86d2-a0ecd918f582\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-qkh9h"
Jul 09 14:55:28.179323 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.178972    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7b7fc356-35d5-4aae-af54-3633423b16d1-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-57bf8d5b48-fslzd\" (UID: \"7b7fc356-35d5-4aae-af54-3633423b16d1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57bf8d5b48-fslzd"
Jul 09 14:55:28.179323 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.179241    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b7fc356-35d5-4aae-af54-3633423b16d1-additional-service-ca\") pod \"cluster-proxy-proxy-agent-57bf8d5b48-fslzd\" (UID: \"7b7fc356-35d5-4aae-af54-3633423b16d1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57bf8d5b48-fslzd"
Jul 09 14:55:28.179323 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.179275    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/03d6966e-dce9-4725-94f4-fbeafd3f48f0-image-registry-private-configuration\") pod \"image-registry-85c46dccf6-wnfkx\" (UID: \"03d6966e-dce9-4725-94f4-fbeafd3f48f0\") " pod="openshift-image-registry/image-registry-85c46dccf6-wnfkx"
Jul 09 14:55:28.179462 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.179067    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c369b2d0-4cba-42f1-9268-689f4e694970-tmp\") pod \"klusterlet-addon-workmgr-5dc9c8f7b6-dxptp\" (UID: \"c369b2d0-4cba-42f1-9268-689f4e694970\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dc9c8f7b6-dxptp"
Jul 09 14:55:28.179462 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:28.179134    2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 09 14:55:28.179462 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.179410    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/7b7fc356-35d5-4aae-af54-3633423b16d1-ca\") pod \"cluster-proxy-proxy-agent-57bf8d5b48-fslzd\" (UID: \"7b7fc356-35d5-4aae-af54-3633423b16d1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57bf8d5b48-fslzd"
Jul 09 14:55:28.179462 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.179426    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4da1e96e-5ef6-4039-9a5e-0f1745820cc8-tmp-dir\") pod \"dns-default-tjbtl\" (UID: \"4da1e96e-5ef6-4039-9a5e-0f1745820cc8\") " pod="openshift-dns/dns-default-tjbtl"
Jul 09 14:55:28.179462 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:28.179434    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c006160e-a992-4ef4-86d2-a0ecd918f582-networking-console-plugin-cert podName:c006160e-a992-4ef4-86d2-a0ecd918f582 nodeName:}" failed. No retries permitted until 2026-07-09 14:55:28.679408417 +0000 UTC m=+36.521941346 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c006160e-a992-4ef4-86d2-a0ecd918f582-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-qkh9h" (UID: "c006160e-a992-4ef4-86d2-a0ecd918f582") : secret "networking-console-plugin-cert" not found
Jul 09 14:55:28.179725 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.179483    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4da1e96e-5ef6-4039-9a5e-0f1745820cc8-metrics-tls\") pod \"dns-default-tjbtl\" (UID: \"4da1e96e-5ef6-4039-9a5e-0f1745820cc8\") " pod="openshift-dns/dns-default-tjbtl"
Jul 09 14:55:28.179725 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.179507    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4033d521-7b5b-4604-b9e2-90c6793fe0e3-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5b65dc8b7d-24jr7\" (UID: \"4033d521-7b5b-4604-b9e2-90c6793fe0e3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b65dc8b7d-24jr7"
Jul 09 14:55:28.179725 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.179540    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/03d6966e-dce9-4725-94f4-fbeafd3f48f0-trusted-ca\") pod \"image-registry-85c46dccf6-wnfkx\" (UID: \"03d6966e-dce9-4725-94f4-fbeafd3f48f0\") " pod="openshift-image-registry/image-registry-85c46dccf6-wnfkx"
Jul 09 14:55:28.179725 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.179575    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/03d6966e-dce9-4725-94f4-fbeafd3f48f0-ca-trust-extracted\") pod \"image-registry-85c46dccf6-wnfkx\" (UID: \"03d6966e-dce9-4725-94f4-fbeafd3f48f0\") " pod="openshift-image-registry/image-registry-85c46dccf6-wnfkx"
Jul 09 14:55:28.179725 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.179594    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4da1e96e-5ef6-4039-9a5e-0f1745820cc8-config-volume\") pod \"dns-default-tjbtl\" (UID: \"4da1e96e-5ef6-4039-9a5e-0f1745820cc8\") " pod="openshift-dns/dns-default-tjbtl"
Jul 09 14:55:28.179725 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.179638    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ps27z\" (UniqueName: \"kubernetes.io/projected/03d6966e-dce9-4725-94f4-fbeafd3f48f0-kube-api-access-ps27z\") pod \"image-registry-85c46dccf6-wnfkx\" (UID: \"03d6966e-dce9-4725-94f4-fbeafd3f48f0\") " pod="openshift-image-registry/image-registry-85c46dccf6-wnfkx"
Jul 09 14:55:28.179725 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.179662    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/03d6966e-dce9-4725-94f4-fbeafd3f48f0-registry-tls\") pod \"image-registry-85c46dccf6-wnfkx\" (UID: \"03d6966e-dce9-4725-94f4-fbeafd3f48f0\") " pod="openshift-image-registry/image-registry-85c46dccf6-wnfkx"
Jul 09 14:55:28.180066 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:28.179789    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 14:55:28.180066 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:28.179805    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85c46dccf6-wnfkx: secret "image-registry-tls" not found
Jul 09 14:55:28.180066 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:28.179853    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03d6966e-dce9-4725-94f4-fbeafd3f48f0-registry-tls podName:03d6966e-dce9-4725-94f4-fbeafd3f48f0 nodeName:}" failed. No retries permitted until 2026-07-09 14:55:28.679836471 +0000 UTC m=+36.522369385 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/03d6966e-dce9-4725-94f4-fbeafd3f48f0-registry-tls") pod "image-registry-85c46dccf6-wnfkx" (UID: "03d6966e-dce9-4725-94f4-fbeafd3f48f0") : secret "image-registry-tls" not found
Jul 09 14:55:28.180222 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:28.180096    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 14:55:28.180222 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.180124    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/03d6966e-dce9-4725-94f4-fbeafd3f48f0-ca-trust-extracted\") pod \"image-registry-85c46dccf6-wnfkx\" (UID: \"03d6966e-dce9-4725-94f4-fbeafd3f48f0\") " pod="openshift-image-registry/image-registry-85c46dccf6-wnfkx"
Jul 09 14:55:28.180222 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:28.180160    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4da1e96e-5ef6-4039-9a5e-0f1745820cc8-metrics-tls podName:4da1e96e-5ef6-4039-9a5e-0f1745820cc8 nodeName:}" failed. No retries permitted until 2026-07-09 14:55:28.680146957 +0000 UTC m=+36.522679881 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4da1e96e-5ef6-4039-9a5e-0f1745820cc8-metrics-tls") pod "dns-default-tjbtl" (UID: "4da1e96e-5ef6-4039-9a5e-0f1745820cc8") : secret "dns-default-metrics-tls" not found
Jul 09 14:55:28.180222 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.180157    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c006160e-a992-4ef4-86d2-a0ecd918f582-nginx-conf\") pod \"networking-console-plugin-6cf856758c-qkh9h\" (UID: \"c006160e-a992-4ef4-86d2-a0ecd918f582\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-qkh9h"
Jul 09 14:55:28.180799 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.180630    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4da1e96e-5ef6-4039-9a5e-0f1745820cc8-config-volume\") pod \"dns-default-tjbtl\" (UID: \"4da1e96e-5ef6-4039-9a5e-0f1745820cc8\") " pod="openshift-dns/dns-default-tjbtl"
Jul 09 14:55:28.181312 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.181285    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/03d6966e-dce9-4725-94f4-fbeafd3f48f0-trusted-ca\") pod \"image-registry-85c46dccf6-wnfkx\" (UID: \"03d6966e-dce9-4725-94f4-fbeafd3f48f0\") " pod="openshift-image-registry/image-registry-85c46dccf6-wnfkx"
Jul 09 14:55:28.181918 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.181893    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/03d6966e-dce9-4725-94f4-fbeafd3f48f0-registry-certificates\") pod \"image-registry-85c46dccf6-wnfkx\" (UID: \"03d6966e-dce9-4725-94f4-fbeafd3f48f0\") " pod="openshift-image-registry/image-registry-85c46dccf6-wnfkx"
Jul 09 14:55:28.182764 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.182737    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b7fc356-35d5-4aae-af54-3633423b16d1-additional-service-ca\") pod \"cluster-proxy-proxy-agent-57bf8d5b48-fslzd\" (UID: \"7b7fc356-35d5-4aae-af54-3633423b16d1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57bf8d5b48-fslzd"
Jul 09 14:55:28.184438 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.184391    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/03d6966e-dce9-4725-94f4-fbeafd3f48f0-image-registry-private-configuration\") pod \"image-registry-85c46dccf6-wnfkx\" (UID: \"03d6966e-dce9-4725-94f4-fbeafd3f48f0\") " pod="openshift-image-registry/image-registry-85c46dccf6-wnfkx"
Jul 09 14:55:28.184438 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.184432    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/7b7fc356-35d5-4aae-af54-3633423b16d1-hub\") pod \"cluster-proxy-proxy-agent-57bf8d5b48-fslzd\" (UID: \"7b7fc356-35d5-4aae-af54-3633423b16d1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57bf8d5b48-fslzd"
Jul 09 14:55:28.184802 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.184778    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4033d521-7b5b-4604-b9e2-90c6793fe0e3-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5b65dc8b7d-24jr7\" (UID: \"4033d521-7b5b-4604-b9e2-90c6793fe0e3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b65dc8b7d-24jr7"
Jul 09 14:55:28.184955 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.184930    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fceb57a3-32ec-4a87-92a4-e92920e8326a-cert\") pod \"ingress-canary-bsf52\" (UID: \"fceb57a3-32ec-4a87-92a4-e92920e8326a\") " pod="openshift-ingress-canary/ingress-canary-bsf52"
Jul 09 14:55:28.185060 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.184938    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/7b7fc356-35d5-4aae-af54-3633423b16d1-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-57bf8d5b48-fslzd\" (UID: \"7b7fc356-35d5-4aae-af54-3633423b16d1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57bf8d5b48-fslzd"
Jul 09 14:55:28.185060 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.185011    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/c369b2d0-4cba-42f1-9268-689f4e694970-klusterlet-config\") pod \"klusterlet-addon-workmgr-5dc9c8f7b6-dxptp\" (UID: \"c369b2d0-4cba-42f1-9268-689f4e694970\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dc9c8f7b6-dxptp"
Jul 09 14:55:28.185334 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.185312    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/7b7fc356-35d5-4aae-af54-3633423b16d1-ca\") pod \"cluster-proxy-proxy-agent-57bf8d5b48-fslzd\" (UID: \"7b7fc356-35d5-4aae-af54-3633423b16d1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57bf8d5b48-fslzd"
Jul 09 14:55:28.185992 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.185968    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/03d6966e-dce9-4725-94f4-fbeafd3f48f0-installation-pull-secrets\") pod \"image-registry-85c46dccf6-wnfkx\" (UID: \"03d6966e-dce9-4725-94f4-fbeafd3f48f0\") " pod="openshift-image-registry/image-registry-85c46dccf6-wnfkx"
Jul 09 14:55:28.187008 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.186985    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7b7fc356-35d5-4aae-af54-3633423b16d1-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-57bf8d5b48-fslzd\" (UID: \"7b7fc356-35d5-4aae-af54-3633423b16d1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57bf8d5b48-fslzd"
Jul 09 14:55:28.190655 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.190627    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l55xq\" (UniqueName: \"kubernetes.io/projected/4033d521-7b5b-4604-b9e2-90c6793fe0e3-kube-api-access-l55xq\") pod \"managed-serviceaccount-addon-agent-5b65dc8b7d-24jr7\" (UID: \"4033d521-7b5b-4604-b9e2-90c6793fe0e3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b65dc8b7d-24jr7"
Jul 09 14:55:28.191194 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.191149    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vzzn\" (UniqueName: \"kubernetes.io/projected/c369b2d0-4cba-42f1-9268-689f4e694970-kube-api-access-4vzzn\") pod \"klusterlet-addon-workmgr-5dc9c8f7b6-dxptp\" (UID: \"c369b2d0-4cba-42f1-9268-689f4e694970\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dc9c8f7b6-dxptp"
Jul 09 14:55:28.192374 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.192353    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/03d6966e-dce9-4725-94f4-fbeafd3f48f0-bound-sa-token\") pod \"image-registry-85c46dccf6-wnfkx\" (UID: \"03d6966e-dce9-4725-94f4-fbeafd3f48f0\") " pod="openshift-image-registry/image-registry-85c46dccf6-wnfkx"
Jul 09 14:55:28.192794 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.192762    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgv6b\" (UniqueName: \"kubernetes.io/projected/7b7fc356-35d5-4aae-af54-3633423b16d1-kube-api-access-rgv6b\") pod \"cluster-proxy-proxy-agent-57bf8d5b48-fslzd\" (UID: \"7b7fc356-35d5-4aae-af54-3633423b16d1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57bf8d5b48-fslzd"
Jul 09 14:55:28.193156 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.193136    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ps27z\" (UniqueName: \"kubernetes.io/projected/03d6966e-dce9-4725-94f4-fbeafd3f48f0-kube-api-access-ps27z\") pod \"image-registry-85c46dccf6-wnfkx\" (UID: \"03d6966e-dce9-4725-94f4-fbeafd3f48f0\") " pod="openshift-image-registry/image-registry-85c46dccf6-wnfkx"
Jul 09 14:55:28.193942 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.193921    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gb8r\" (UniqueName: \"kubernetes.io/projected/4da1e96e-5ef6-4039-9a5e-0f1745820cc8-kube-api-access-8gb8r\") pod \"dns-default-tjbtl\" (UID: \"4da1e96e-5ef6-4039-9a5e-0f1745820cc8\") " pod="openshift-dns/dns-default-tjbtl"
Jul 09 14:55:28.194571 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.194547    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2g8l\" (UniqueName: \"kubernetes.io/projected/fceb57a3-32ec-4a87-92a4-e92920e8326a-kube-api-access-l2g8l\") pod \"ingress-canary-bsf52\" (UID: \"fceb57a3-32ec-4a87-92a4-e92920e8326a\") " pod="openshift-ingress-canary/ingress-canary-bsf52"
Jul 09 14:55:28.276732 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.276676    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dc9c8f7b6-dxptp"
Jul 09 14:55:28.288186 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.288156    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:28.300900 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.300875    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b65dc8b7d-24jr7"
Jul 09 14:55:28.311376 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.311354    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f6rbl"
Jul 09 14:55:28.311460 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.311415    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jpn9b"
Jul 09 14:55:28.311531 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.311504    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fs6ww"
Jul 09 14:55:28.314563 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.314541    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9rvwx\""
Jul 09 14:55:28.314652 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.314569    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 09 14:55:28.314652 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.314608    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 09 14:55:28.314934 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.314915    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 09 14:55:28.315030 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.314986    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kmw8t\""
Jul 09 14:55:28.315127 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.315114    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 09 14:55:28.316890 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.316699    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57bf8d5b48-fslzd"
Jul 09 14:55:28.335126 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.335102    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bsf52"
Jul 09 14:55:28.683722 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.683676    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4da1e96e-5ef6-4039-9a5e-0f1745820cc8-metrics-tls\") pod \"dns-default-tjbtl\" (UID: \"4da1e96e-5ef6-4039-9a5e-0f1745820cc8\") " pod="openshift-dns/dns-default-tjbtl"
Jul 09 14:55:28.683902 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.683771    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/03d6966e-dce9-4725-94f4-fbeafd3f48f0-registry-tls\") pod \"image-registry-85c46dccf6-wnfkx\" (UID: \"03d6966e-dce9-4725-94f4-fbeafd3f48f0\") " pod="openshift-image-registry/image-registry-85c46dccf6-wnfkx"
Jul 09 14:55:28.683902 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:28.683832    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c006160e-a992-4ef4-86d2-a0ecd918f582-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-qkh9h\" (UID: \"c006160e-a992-4ef4-86d2-a0ecd918f582\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-qkh9h"
Jul 09 14:55:28.683902 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:28.683841    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 14:55:28.684054 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:28.683904    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4da1e96e-5ef6-4039-9a5e-0f1745820cc8-metrics-tls podName:4da1e96e-5ef6-4039-9a5e-0f1745820cc8 nodeName:}" failed. No retries permitted until 2026-07-09 14:55:29.683886162 +0000 UTC m=+37.526419078 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4da1e96e-5ef6-4039-9a5e-0f1745820cc8-metrics-tls") pod "dns-default-tjbtl" (UID: "4da1e96e-5ef6-4039-9a5e-0f1745820cc8") : secret "dns-default-metrics-tls" not found
Jul 09 14:55:28.684054 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:28.683932    2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 09 14:55:28.684054 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:28.683958    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 14:55:28.684054 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:28.683977    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c006160e-a992-4ef4-86d2-a0ecd918f582-networking-console-plugin-cert podName:c006160e-a992-4ef4-86d2-a0ecd918f582 nodeName:}" failed. No retries permitted until 2026-07-09 14:55:29.683966959 +0000 UTC m=+37.526499874 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c006160e-a992-4ef4-86d2-a0ecd918f582-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-qkh9h" (UID: "c006160e-a992-4ef4-86d2-a0ecd918f582") : secret "networking-console-plugin-cert" not found
Jul 09 14:55:28.684054 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:28.683978    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85c46dccf6-wnfkx: secret "image-registry-tls" not found
Jul 09 14:55:28.684054 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:28.684036    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03d6966e-dce9-4725-94f4-fbeafd3f48f0-registry-tls podName:03d6966e-dce9-4725-94f4-fbeafd3f48f0 nodeName:}" failed. No retries permitted until 2026-07-09 14:55:29.68401732 +0000 UTC m=+37.526550251 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/03d6966e-dce9-4725-94f4-fbeafd3f48f0-registry-tls") pod "image-registry-85c46dccf6-wnfkx" (UID: "03d6966e-dce9-4725-94f4-fbeafd3f48f0") : secret "image-registry-tls" not found
Jul 09 14:55:29.299467 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:29.299430    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dc9c8f7b6-dxptp"]
Jul 09 14:55:29.301410 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:29.301387    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bsf52"]
Jul 09 14:55:29.305628 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:29.305609    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b65dc8b7d-24jr7"]
Jul 09 14:55:29.308620 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:29.308601    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57bf8d5b48-fslzd"]
Jul 09 14:55:29.328227 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:55:29.328204    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc369b2d0_4cba_42f1_9268_689f4e694970.slice/crio-93b5d44e764081ae2aaaf623f25fcb433e2c732cef174d167dabcf361ef671dd WatchSource:0}: Error finding container 93b5d44e764081ae2aaaf623f25fcb433e2c732cef174d167dabcf361ef671dd: Status 404 returned error can't find the container with id 93b5d44e764081ae2aaaf623f25fcb433e2c732cef174d167dabcf361ef671dd
Jul 09 14:55:29.328808 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:55:29.328761    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfceb57a3_32ec_4a87_92a4_e92920e8326a.slice/crio-74c428d8e1b07d1e841f27ba04619c62160c1409c18347435537dd00b798f295 WatchSource:0}: Error finding container 74c428d8e1b07d1e841f27ba04619c62160c1409c18347435537dd00b798f295: Status 404 returned error can't find the container with id 74c428d8e1b07d1e841f27ba04619c62160c1409c18347435537dd00b798f295
Jul 09 14:55:29.330497 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:55:29.330284    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4033d521_7b5b_4604_b9e2_90c6793fe0e3.slice/crio-d9cdba5c78e8baf6b9f39a7813a1dd2069b740fa25a74966b5a012ad59987c17 WatchSource:0}: Error finding container d9cdba5c78e8baf6b9f39a7813a1dd2069b740fa25a74966b5a012ad59987c17: Status 404 returned error can't find the container with id d9cdba5c78e8baf6b9f39a7813a1dd2069b740fa25a74966b5a012ad59987c17
Jul 09 14:55:29.330668 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:55:29.330638    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7b7fc356_35d5_4aae_af54_3633423b16d1.slice/crio-ce317ab18c406f5b3075d8bc657ed43bf135d3a93fbf722979e820d08c98d078 WatchSource:0}: Error finding container ce317ab18c406f5b3075d8bc657ed43bf135d3a93fbf722979e820d08c98d078: Status 404 returned error can't find the container with id ce317ab18c406f5b3075d8bc657ed43bf135d3a93fbf722979e820d08c98d078
Jul 09 14:55:29.470586 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:29.470413    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lhnsd" event={"ID":"779ead75-a855-4c93-bfdf-c38546b8a181","Type":"ContainerStarted","Data":"3d0bc4b37573979bd303b571ba628bb4feca8cf597ed5139bcbb55b1b70acbc9"}
Jul 09 14:55:29.471516 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:29.471490    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dc9c8f7b6-dxptp" event={"ID":"c369b2d0-4cba-42f1-9268-689f4e694970","Type":"ContainerStarted","Data":"93b5d44e764081ae2aaaf623f25fcb433e2c732cef174d167dabcf361ef671dd"}
Jul 09 14:55:29.472647 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:29.472623    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b65dc8b7d-24jr7" event={"ID":"4033d521-7b5b-4604-b9e2-90c6793fe0e3","Type":"ContainerStarted","Data":"d9cdba5c78e8baf6b9f39a7813a1dd2069b740fa25a74966b5a012ad59987c17"}
Jul 09 14:55:29.473639 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:29.473620    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57bf8d5b48-fslzd" event={"ID":"7b7fc356-35d5-4aae-af54-3633423b16d1","Type":"ContainerStarted","Data":"ce317ab18c406f5b3075d8bc657ed43bf135d3a93fbf722979e820d08c98d078"}
Jul 09 14:55:29.474635 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:29.474611    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bsf52" event={"ID":"fceb57a3-32ec-4a87-92a4-e92920e8326a","Type":"ContainerStarted","Data":"74c428d8e1b07d1e841f27ba04619c62160c1409c18347435537dd00b798f295"}
Jul 09 14:55:29.693084 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:29.692992    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/03d6966e-dce9-4725-94f4-fbeafd3f48f0-registry-tls\") pod \"image-registry-85c46dccf6-wnfkx\" (UID: \"03d6966e-dce9-4725-94f4-fbeafd3f48f0\") " pod="openshift-image-registry/image-registry-85c46dccf6-wnfkx"
Jul 09 14:55:29.693084 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:29.693062    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c006160e-a992-4ef4-86d2-a0ecd918f582-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-qkh9h\" (UID: \"c006160e-a992-4ef4-86d2-a0ecd918f582\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-qkh9h"
Jul 09 14:55:29.693296 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:29.693116    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4da1e96e-5ef6-4039-9a5e-0f1745820cc8-metrics-tls\") pod \"dns-default-tjbtl\" (UID: \"4da1e96e-5ef6-4039-9a5e-0f1745820cc8\") " pod="openshift-dns/dns-default-tjbtl"
Jul 09 14:55:29.693296 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:29.693165    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 14:55:29.693296 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:29.693189    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85c46dccf6-wnfkx: secret "image-registry-tls" not found
Jul 09 14:55:29.693296 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:29.693203    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 14:55:29.693296 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:29.693201    2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 09 14:55:29.693296 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:29.693253    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03d6966e-dce9-4725-94f4-fbeafd3f48f0-registry-tls podName:03d6966e-dce9-4725-94f4-fbeafd3f48f0 nodeName:}" failed. No retries permitted until 2026-07-09 14:55:31.69323079 +0000 UTC m=+39.535763712 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/03d6966e-dce9-4725-94f4-fbeafd3f48f0-registry-tls") pod "image-registry-85c46dccf6-wnfkx" (UID: "03d6966e-dce9-4725-94f4-fbeafd3f48f0") : secret "image-registry-tls" not found
Jul 09 14:55:29.693296 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:29.693275    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c006160e-a992-4ef4-86d2-a0ecd918f582-networking-console-plugin-cert podName:c006160e-a992-4ef4-86d2-a0ecd918f582 nodeName:}" failed. No retries permitted until 2026-07-09 14:55:31.69325942 +0000 UTC m=+39.535792335 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c006160e-a992-4ef4-86d2-a0ecd918f582-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-qkh9h" (UID: "c006160e-a992-4ef4-86d2-a0ecd918f582") : secret "networking-console-plugin-cert" not found
Jul 09 14:55:29.693296 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:29.693292    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4da1e96e-5ef6-4039-9a5e-0f1745820cc8-metrics-tls podName:4da1e96e-5ef6-4039-9a5e-0f1745820cc8 nodeName:}" failed. No retries permitted until 2026-07-09 14:55:31.693283242 +0000 UTC m=+39.535816156 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4da1e96e-5ef6-4039-9a5e-0f1745820cc8-metrics-tls") pod "dns-default-tjbtl" (UID: "4da1e96e-5ef6-4039-9a5e-0f1745820cc8") : secret "dns-default-metrics-tls" not found
Jul 09 14:55:30.485616 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:30.485577    2575 generic.go:356] "Generic (PLEG): container finished" podID="779ead75-a855-4c93-bfdf-c38546b8a181" containerID="3d0bc4b37573979bd303b571ba628bb4feca8cf597ed5139bcbb55b1b70acbc9" exitCode=0
Jul 09 14:55:30.486081 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:30.485659    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lhnsd" event={"ID":"779ead75-a855-4c93-bfdf-c38546b8a181","Type":"ContainerDied","Data":"3d0bc4b37573979bd303b571ba628bb4feca8cf597ed5139bcbb55b1b70acbc9"}
Jul 09 14:55:31.495620 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:31.495409    2575 generic.go:356] "Generic (PLEG): container finished" podID="779ead75-a855-4c93-bfdf-c38546b8a181" containerID="e14b23c1fbdab6329f4d65bc20f93c03f4ab4b3d6de629f3af7c2e46f80fc883" exitCode=0
Jul 09 14:55:31.495620 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:31.495483    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lhnsd" event={"ID":"779ead75-a855-4c93-bfdf-c38546b8a181","Type":"ContainerDied","Data":"e14b23c1fbdab6329f4d65bc20f93c03f4ab4b3d6de629f3af7c2e46f80fc883"}
Jul 09 14:55:31.715952 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:31.715911    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c006160e-a992-4ef4-86d2-a0ecd918f582-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-qkh9h\" (UID: \"c006160e-a992-4ef4-86d2-a0ecd918f582\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-qkh9h"
Jul 09 14:55:31.716131 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:31.716001    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4da1e96e-5ef6-4039-9a5e-0f1745820cc8-metrics-tls\") pod \"dns-default-tjbtl\" (UID: \"4da1e96e-5ef6-4039-9a5e-0f1745820cc8\") " pod="openshift-dns/dns-default-tjbtl"
Jul 09 14:55:31.716131 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:31.716062    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/03d6966e-dce9-4725-94f4-fbeafd3f48f0-registry-tls\") pod \"image-registry-85c46dccf6-wnfkx\" (UID: \"03d6966e-dce9-4725-94f4-fbeafd3f48f0\") " pod="openshift-image-registry/image-registry-85c46dccf6-wnfkx"
Jul 09 14:55:31.716131 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:31.716074    2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 09 14:55:31.716291 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:31.716155    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c006160e-a992-4ef4-86d2-a0ecd918f582-networking-console-plugin-cert podName:c006160e-a992-4ef4-86d2-a0ecd918f582 nodeName:}" failed. No retries permitted until 2026-07-09 14:55:35.716132667 +0000 UTC m=+43.558665581 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c006160e-a992-4ef4-86d2-a0ecd918f582-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-qkh9h" (UID: "c006160e-a992-4ef4-86d2-a0ecd918f582") : secret "networking-console-plugin-cert" not found
Jul 09 14:55:31.716291 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:31.716217    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 14:55:31.716291 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:31.716234    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85c46dccf6-wnfkx: secret "image-registry-tls" not found
Jul 09 14:55:31.716291 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:31.716280    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03d6966e-dce9-4725-94f4-fbeafd3f48f0-registry-tls podName:03d6966e-dce9-4725-94f4-fbeafd3f48f0 nodeName:}" failed. No retries permitted until 2026-07-09 14:55:35.716265356 +0000 UTC m=+43.558798289 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/03d6966e-dce9-4725-94f4-fbeafd3f48f0-registry-tls") pod "image-registry-85c46dccf6-wnfkx" (UID: "03d6966e-dce9-4725-94f4-fbeafd3f48f0") : secret "image-registry-tls" not found
Jul 09 14:55:31.716504 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:31.716345    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 14:55:31.716504 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:31.716378    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4da1e96e-5ef6-4039-9a5e-0f1745820cc8-metrics-tls podName:4da1e96e-5ef6-4039-9a5e-0f1745820cc8 nodeName:}" failed. No retries permitted until 2026-07-09 14:55:35.716367078 +0000 UTC m=+43.558900003 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4da1e96e-5ef6-4039-9a5e-0f1745820cc8-metrics-tls") pod "dns-default-tjbtl" (UID: "4da1e96e-5ef6-4039-9a5e-0f1745820cc8") : secret "dns-default-metrics-tls" not found
Jul 09 14:55:33.786626 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:33.786569    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:33.886772 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:33.886592    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:34.706011 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:34.705975    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:34.823163 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:34.823128    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:34.914280 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:34.914240    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:35.016078 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:35.016008    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:35.090948 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:35.090911    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:35.516896 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:35.516855    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:35.597529 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:35.597495    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:35.756007 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:35.755975    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/03d6966e-dce9-4725-94f4-fbeafd3f48f0-registry-tls\") pod \"image-registry-85c46dccf6-wnfkx\" (UID: \"03d6966e-dce9-4725-94f4-fbeafd3f48f0\") " pod="openshift-image-registry/image-registry-85c46dccf6-wnfkx"
Jul 09 14:55:35.756202 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:35.756042    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c006160e-a992-4ef4-86d2-a0ecd918f582-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-qkh9h\" (UID: \"c006160e-a992-4ef4-86d2-a0ecd918f582\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-qkh9h"
Jul 09 14:55:35.756202 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:35.756094    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4da1e96e-5ef6-4039-9a5e-0f1745820cc8-metrics-tls\") pod \"dns-default-tjbtl\" (UID: \"4da1e96e-5ef6-4039-9a5e-0f1745820cc8\") " pod="openshift-dns/dns-default-tjbtl"
Jul 09 14:55:35.756202 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:35.756136    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 14:55:35.756202 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:35.756157    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85c46dccf6-wnfkx: secret "image-registry-tls" not found
Jul 09 14:55:35.756202 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:35.756190    2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 09 14:55:35.756437 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:35.756189    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 14:55:35.756437 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:35.756248    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03d6966e-dce9-4725-94f4-fbeafd3f48f0-registry-tls podName:03d6966e-dce9-4725-94f4-fbeafd3f48f0 nodeName:}" failed. No retries permitted until 2026-07-09 14:55:43.756194937 +0000 UTC m=+51.598727849 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/03d6966e-dce9-4725-94f4-fbeafd3f48f0-registry-tls") pod "image-registry-85c46dccf6-wnfkx" (UID: "03d6966e-dce9-4725-94f4-fbeafd3f48f0") : secret "image-registry-tls" not found
Jul 09 14:55:35.756437 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:35.756271    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c006160e-a992-4ef4-86d2-a0ecd918f582-networking-console-plugin-cert podName:c006160e-a992-4ef4-86d2-a0ecd918f582 nodeName:}" failed. No retries permitted until 2026-07-09 14:55:43.756260703 +0000 UTC m=+51.598793614 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c006160e-a992-4ef4-86d2-a0ecd918f582-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-qkh9h" (UID: "c006160e-a992-4ef4-86d2-a0ecd918f582") : secret "networking-console-plugin-cert" not found
Jul 09 14:55:35.756437 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:35.756288    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4da1e96e-5ef6-4039-9a5e-0f1745820cc8-metrics-tls podName:4da1e96e-5ef6-4039-9a5e-0f1745820cc8 nodeName:}" failed. No retries permitted until 2026-07-09 14:55:43.756279978 +0000 UTC m=+51.598812889 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4da1e96e-5ef6-4039-9a5e-0f1745820cc8-metrics-tls") pod "dns-default-tjbtl" (UID: "4da1e96e-5ef6-4039-9a5e-0f1745820cc8") : secret "dns-default-metrics-tls" not found
Jul 09 14:55:35.905604 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:35.905515    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:35.994725 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:35.994673    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:37.513181 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:37.513077    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dc9c8f7b6-dxptp" event={"ID":"c369b2d0-4cba-42f1-9268-689f4e694970","Type":"ContainerStarted","Data":"f192b2cc79a8f928a945e23134c33d0184c3828a6eef1099c01de65552c28f4a"}
Jul 09 14:55:37.513631 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:37.513277    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dc9c8f7b6-dxptp"
Jul 09 14:55:37.514786 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:37.514704    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b65dc8b7d-24jr7" event={"ID":"4033d521-7b5b-4604-b9e2-90c6793fe0e3","Type":"ContainerStarted","Data":"0fb9da514832c53d00d4f9b24470c1fb28d85f4744c4e9d64bb6b622273a14ed"}
Jul 09 14:55:37.515188 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:37.515165    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dc9c8f7b6-dxptp"
Jul 09 14:55:37.516654 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:37.516636    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57bf8d5b48-fslzd" event={"ID":"7b7fc356-35d5-4aae-af54-3633423b16d1","Type":"ContainerStarted","Data":"78099aaa0ac367e46b894ce95e43f73c78890b0ba7a3fbded04205a604ad2308"}
Jul 09 14:55:37.516780 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:37.516663    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57bf8d5b48-fslzd" event={"ID":"7b7fc356-35d5-4aae-af54-3633423b16d1","Type":"ContainerStarted","Data":"f72e423f498a55831bf33c5a0c27b26a95b1893f0bb9aa2e814add7fb73d29a4"}
Jul 09 14:55:37.516780 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:37.516679    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57bf8d5b48-fslzd" event={"ID":"7b7fc356-35d5-4aae-af54-3633423b16d1","Type":"ContainerStarted","Data":"f13a9a20cfafd22cd4a9006d7844d43862335610104f14f795f2c0af2dd3edd6"}
Jul 09 14:55:37.518002 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:37.517981    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bsf52" event={"ID":"fceb57a3-32ec-4a87-92a4-e92920e8326a","Type":"ContainerStarted","Data":"041d24284a691ad9ec259056954e33bbadfcecd94dd5ae960328fd1337834cda"}
Jul 09 14:55:37.521336 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:37.521317    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lhnsd" event={"ID":"779ead75-a855-4c93-bfdf-c38546b8a181","Type":"ContainerStarted","Data":"ec9a9d386091f5249107e066e7f5b7d6e5ff311e6f26b70317338da7035a1749"}
Jul 09 14:55:37.535990 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:37.535945    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dc9c8f7b6-dxptp" podStartSLOduration=24.921179207 podStartE2EDuration="32.535933525s" totalImagesPullingTime="7.614754318s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:55:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:55:37.535921167 +0000 UTC m=+45.378454111" watchObservedRunningTime="2026-07-09 14:55:37.535933525 +0000 UTC m=+45.378466457"
Jul 09 14:55:37.552675 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:37.552632    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b65dc8b7d-24jr7" podStartSLOduration=24.955294502 podStartE2EDuration="32.552617671s" totalImagesPullingTime="7.597323169s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:55:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:55:37.552488759 +0000 UTC m=+45.395021700" watchObservedRunningTime="2026-07-09 14:55:37.552617671 +0000 UTC m=+45.395150603"
Jul 09 14:55:37.572943 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:37.572903    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57bf8d5b48-fslzd" podStartSLOduration=24.975020061 podStartE2EDuration="32.572890804s" totalImagesPullingTime="7.597870743s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:55:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:55:37.572281325 +0000 UTC m=+45.414814281" watchObservedRunningTime="2026-07-09 14:55:37.572890804 +0000 UTC m=+45.415423735"
Jul 09 14:55:37.607720 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:37.607663    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-bsf52" podStartSLOduration=3.009430531 podStartE2EDuration="10.607649349s" totalImagesPullingTime="7.598218818s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:55:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:55:37.60707871 +0000 UTC m=+45.449611643" watchObservedRunningTime="2026-07-09 14:55:37.607649349 +0000 UTC m=+45.450182297"
Jul 09 14:55:37.631478 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:37.631435    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-lhnsd" podStartSLOduration=12.389239369 podStartE2EDuration="44.631421477s" totalImagesPullingTime="32.242182108s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:54:53 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:55:37.631111028 +0000 UTC m=+45.473643959" watchObservedRunningTime="2026-07-09 14:55:37.631421477 +0000 UTC m=+45.473954409"
Jul 09 14:55:37.920449 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:37.920413    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:38.221539 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:38.221465    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:38.338262 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:38.338230    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:43.814537 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:43.814503    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4da1e96e-5ef6-4039-9a5e-0f1745820cc8-metrics-tls\") pod \"dns-default-tjbtl\" (UID: \"4da1e96e-5ef6-4039-9a5e-0f1745820cc8\") " pod="openshift-dns/dns-default-tjbtl"
Jul 09 14:55:43.814956 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:43.814562    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/03d6966e-dce9-4725-94f4-fbeafd3f48f0-registry-tls\") pod \"image-registry-85c46dccf6-wnfkx\" (UID: \"03d6966e-dce9-4725-94f4-fbeafd3f48f0\") " pod="openshift-image-registry/image-registry-85c46dccf6-wnfkx"
Jul 09 14:55:43.814956 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:43.814607    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c006160e-a992-4ef4-86d2-a0ecd918f582-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-qkh9h\" (UID: \"c006160e-a992-4ef4-86d2-a0ecd918f582\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-qkh9h"
Jul 09 14:55:43.814956 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:43.814673    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 14:55:43.814956 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:43.814736    2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 09 14:55:43.814956 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:43.814741    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 14:55:43.814956 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:43.814757    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85c46dccf6-wnfkx: secret "image-registry-tls" not found
Jul 09 14:55:43.814956 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:43.814763    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4da1e96e-5ef6-4039-9a5e-0f1745820cc8-metrics-tls podName:4da1e96e-5ef6-4039-9a5e-0f1745820cc8 nodeName:}" failed. No retries permitted until 2026-07-09 14:55:59.81474706 +0000 UTC m=+67.657279969 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4da1e96e-5ef6-4039-9a5e-0f1745820cc8-metrics-tls") pod "dns-default-tjbtl" (UID: "4da1e96e-5ef6-4039-9a5e-0f1745820cc8") : secret "dns-default-metrics-tls" not found
Jul 09 14:55:43.814956 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:43.814810    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03d6966e-dce9-4725-94f4-fbeafd3f48f0-registry-tls podName:03d6966e-dce9-4725-94f4-fbeafd3f48f0 nodeName:}" failed. No retries permitted until 2026-07-09 14:55:59.814794358 +0000 UTC m=+67.657327285 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/03d6966e-dce9-4725-94f4-fbeafd3f48f0-registry-tls") pod "image-registry-85c46dccf6-wnfkx" (UID: "03d6966e-dce9-4725-94f4-fbeafd3f48f0") : secret "image-registry-tls" not found
Jul 09 14:55:43.814956 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:43.814825    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c006160e-a992-4ef4-86d2-a0ecd918f582-networking-console-plugin-cert podName:c006160e-a992-4ef4-86d2-a0ecd918f582 nodeName:}" failed. No retries permitted until 2026-07-09 14:55:59.814818401 +0000 UTC m=+67.657351317 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c006160e-a992-4ef4-86d2-a0ecd918f582-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-qkh9h" (UID: "c006160e-a992-4ef4-86d2-a0ecd918f582") : secret "networking-console-plugin-cert" not found
Jul 09 14:55:46.313061 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:46.313030    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:46.414286 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:46.414246    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:48.194065 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:48.194027    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:48.289997 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:48.289951    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:53.266237 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:53.266207    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:54.464782 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:54.464752    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zx64x"
Jul 09 14:55:54.664878 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:54.664838    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:54.766024 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:54.765942    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:57.395393 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:57.395357    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:57.486655 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:57.486608    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:57.581678 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:57.581645    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:57.683399 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:57.683315    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:58.416548 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:58.416518    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:58.426656 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:58.426635    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c37b4281-e19b-453c-aca5-f3fa37933b67-metrics-certs\") pod \"network-metrics-daemon-jpn9b\" (UID: \"c37b4281-e19b-453c-aca5-f3fa37933b67\") " pod="openshift-multus/network-metrics-daemon-jpn9b"
Jul 09 14:55:58.426749 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:58.426735    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bf25b5cc-fd7d-4383-ae3f-6a2fc1df007e-original-pull-secret\") pod \"global-pull-secret-syncer-f6rbl\" (UID: \"bf25b5cc-fd7d-4383-ae3f-6a2fc1df007e\") " pod="kube-system/global-pull-secret-syncer-f6rbl"
Jul 09 14:55:58.429768 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:58.429747    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 09 14:55:58.429866 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:58.429752    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 09 14:55:58.437144 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:58.437128    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 09 14:55:58.437197 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:58.437182    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c37b4281-e19b-453c-aca5-f3fa37933b67-metrics-certs podName:c37b4281-e19b-453c-aca5-f3fa37933b67 nodeName:}" failed. No retries permitted until 2026-07-09 14:57:02.437168204 +0000 UTC m=+130.279701117 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c37b4281-e19b-453c-aca5-f3fa37933b67-metrics-certs") pod "network-metrics-daemon-jpn9b" (UID: "c37b4281-e19b-453c-aca5-f3fa37933b67") : secret "metrics-daemon-secret" not found
Jul 09 14:55:58.440192 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:58.440171    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bf25b5cc-fd7d-4383-ae3f-6a2fc1df007e-original-pull-secret\") pod \"global-pull-secret-syncer-f6rbl\" (UID: \"bf25b5cc-fd7d-4383-ae3f-6a2fc1df007e\") " pod="kube-system/global-pull-secret-syncer-f6rbl"
Jul 09 14:55:58.518207 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:58.518170    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:58.527060 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:58.527029    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjx7d\" (UniqueName: \"kubernetes.io/projected/ae071a8e-6ae7-4330-b5e8-776283e86b63-kube-api-access-rjx7d\") pod \"network-check-target-fs6ww\" (UID: \"ae071a8e-6ae7-4330-b5e8-776283e86b63\") " pod="openshift-network-diagnostics/network-check-target-fs6ww"
Jul 09 14:55:58.530289 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:58.530270    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 09 14:55:58.540618 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:58.540598    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 09 14:55:58.550329 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:58.550302    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjx7d\" (UniqueName: \"kubernetes.io/projected/ae071a8e-6ae7-4330-b5e8-776283e86b63-kube-api-access-rjx7d\") pod \"network-check-target-fs6ww\" (UID: \"ae071a8e-6ae7-4330-b5e8-776283e86b63\") " pod="openshift-network-diagnostics/network-check-target-fs6ww"
Jul 09 14:55:58.624107 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:58.624069    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f6rbl"
Jul 09 14:55:58.641802 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:58.641780    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kmw8t\""
Jul 09 14:55:58.648977 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:58.648953    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fs6ww"
Jul 09 14:55:58.758269 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:58.758236    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-f6rbl"]
Jul 09 14:55:58.761287 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:55:58.761261    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf25b5cc_fd7d_4383_ae3f_6a2fc1df007e.slice/crio-4115ed579b410402ac1005a5e095ab6aac7a6ee5204d5305e1697721eb26ce29 WatchSource:0}: Error finding container 4115ed579b410402ac1005a5e095ab6aac7a6ee5204d5305e1697721eb26ce29: Status 404 returned error can't find the container with id 4115ed579b410402ac1005a5e095ab6aac7a6ee5204d5305e1697721eb26ce29
Jul 09 14:55:58.779002 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:58.778983    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fs6ww"]
Jul 09 14:55:58.782357 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:55:58.782328    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae071a8e_6ae7_4330_b5e8_776283e86b63.slice/crio-c4f12e45e897f252558bc0bc2a008ff9ec11570bb219d842834d237aa4314828 WatchSource:0}: Error finding container c4f12e45e897f252558bc0bc2a008ff9ec11570bb219d842834d237aa4314828: Status 404 returned error can't find the container with id c4f12e45e897f252558bc0bc2a008ff9ec11570bb219d842834d237aa4314828
Jul 09 14:55:58.866759 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:58.866723    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:58.952253 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:58.952164    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:59.586461 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:59.586418    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fs6ww" event={"ID":"ae071a8e-6ae7-4330-b5e8-776283e86b63","Type":"ContainerStarted","Data":"c4f12e45e897f252558bc0bc2a008ff9ec11570bb219d842834d237aa4314828"}
Jul 09 14:55:59.587736 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:59.587696    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-f6rbl" event={"ID":"bf25b5cc-fd7d-4383-ae3f-6a2fc1df007e","Type":"ContainerStarted","Data":"4115ed579b410402ac1005a5e095ab6aac7a6ee5204d5305e1697721eb26ce29"}
Jul 09 14:55:59.836268 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:59.835902    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4da1e96e-5ef6-4039-9a5e-0f1745820cc8-metrics-tls\") pod \"dns-default-tjbtl\" (UID: \"4da1e96e-5ef6-4039-9a5e-0f1745820cc8\") " pod="openshift-dns/dns-default-tjbtl"
Jul 09 14:55:59.836268 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:59.835994    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/03d6966e-dce9-4725-94f4-fbeafd3f48f0-registry-tls\") pod \"image-registry-85c46dccf6-wnfkx\" (UID: \"03d6966e-dce9-4725-94f4-fbeafd3f48f0\") " pod="openshift-image-registry/image-registry-85c46dccf6-wnfkx"
Jul 09 14:55:59.836268 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:55:59.836044    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c006160e-a992-4ef4-86d2-a0ecd918f582-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-qkh9h\" (UID: \"c006160e-a992-4ef4-86d2-a0ecd918f582\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-qkh9h"
Jul 09 14:55:59.836268 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:59.836071    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 14:55:59.836268 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:59.836124    2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 09 14:55:59.836268 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:59.836141    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4da1e96e-5ef6-4039-9a5e-0f1745820cc8-metrics-tls podName:4da1e96e-5ef6-4039-9a5e-0f1745820cc8 nodeName:}" failed. No retries permitted until 2026-07-09 14:56:31.836123112 +0000 UTC m=+99.678656034 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4da1e96e-5ef6-4039-9a5e-0f1745820cc8-metrics-tls") pod "dns-default-tjbtl" (UID: "4da1e96e-5ef6-4039-9a5e-0f1745820cc8") : secret "dns-default-metrics-tls" not found
Jul 09 14:55:59.836268 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:59.836160    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c006160e-a992-4ef4-86d2-a0ecd918f582-networking-console-plugin-cert podName:c006160e-a992-4ef4-86d2-a0ecd918f582 nodeName:}" failed. No retries permitted until 2026-07-09 14:56:31.83615083 +0000 UTC m=+99.678683746 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c006160e-a992-4ef4-86d2-a0ecd918f582-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-qkh9h" (UID: "c006160e-a992-4ef4-86d2-a0ecd918f582") : secret "networking-console-plugin-cert" not found
Jul 09 14:55:59.836268 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:59.836194    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 14:55:59.836268 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:59.836203    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85c46dccf6-wnfkx: secret "image-registry-tls" not found
Jul 09 14:55:59.836268 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:55:59.836242    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03d6966e-dce9-4725-94f4-fbeafd3f48f0-registry-tls podName:03d6966e-dce9-4725-94f4-fbeafd3f48f0 nodeName:}" failed. No retries permitted until 2026-07-09 14:56:31.836230543 +0000 UTC m=+99.678763458 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/03d6966e-dce9-4725-94f4-fbeafd3f48f0-registry-tls") pod "image-registry-85c46dccf6-wnfkx" (UID: "03d6966e-dce9-4725-94f4-fbeafd3f48f0") : secret "image-registry-tls" not found
Jul 09 14:56:00.343533 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:56:00.343496    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:56:02.244675 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:56:02.244632    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:56:02.323526 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:56:02.323491    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:56:04.405189 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:56:04.405149    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:56:04.502016 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:56:04.501987    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:56:04.607320 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:56:04.607279    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fs6ww" event={"ID":"ae071a8e-6ae7-4330-b5e8-776283e86b63","Type":"ContainerStarted","Data":"4613f3c6ff8628a907e44d416c6b95680c3e736ae62fad380e26d50111f235ca"}
Jul 09 14:56:04.607498 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:56:04.607430    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-fs6ww"
Jul 09 14:56:04.608797 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:56:04.608773    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-f6rbl" event={"ID":"bf25b5cc-fd7d-4383-ae3f-6a2fc1df007e","Type":"ContainerStarted","Data":"99f41c9f4650219b4ec85f7ed3d34602ed51a74a540f3d158ba5a0939eadd739"}
Jul 09 14:56:04.633881 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:56:04.633828    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-fs6ww" podStartSLOduration=66.542201935 podStartE2EDuration="1m11.633815742s" totalImagesPullingTime="5.091613807s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:54:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:56:04.633648953 +0000 UTC m=+72.476181885" watchObservedRunningTime="2026-07-09 14:56:04.633815742 +0000 UTC m=+72.476348674"
Jul 09 14:56:04.662829 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:56:04.662749    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-f6rbl" podStartSLOduration=66.550348639 podStartE2EDuration="1m11.662732062s" totalImagesPullingTime="5.112383423s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:54:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:56:04.662600815 +0000 UTC m=+72.505133747" watchObservedRunningTime="2026-07-09 14:56:04.662732062 +0000 UTC m=+72.505264998"
Jul 09 14:56:10.082008 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:56:10.081970    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:56:10.182201 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:56:10.182157    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:56:13.459550 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:56:13.459511    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:56:13.528436 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:56:13.528397    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:56:13.591203 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:56:13.591176    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:56:14.808431 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:56:14.808393    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:56:14.909768 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:56:14.909627    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:56:24.250383 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:56:24.250352    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:56:24.335722 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:56:24.335687    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:56:31.888357 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:56:31.888306    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c006160e-a992-4ef4-86d2-a0ecd918f582-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-qkh9h\" (UID: \"c006160e-a992-4ef4-86d2-a0ecd918f582\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-qkh9h"
Jul 09 14:56:31.888852 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:56:31.888363    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4da1e96e-5ef6-4039-9a5e-0f1745820cc8-metrics-tls\") pod \"dns-default-tjbtl\" (UID: \"4da1e96e-5ef6-4039-9a5e-0f1745820cc8\") " pod="openshift-dns/dns-default-tjbtl"
Jul 09 14:56:31.888852 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:56:31.888418    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/03d6966e-dce9-4725-94f4-fbeafd3f48f0-registry-tls\") pod \"image-registry-85c46dccf6-wnfkx\" (UID: \"03d6966e-dce9-4725-94f4-fbeafd3f48f0\") " pod="openshift-image-registry/image-registry-85c46dccf6-wnfkx"
Jul 09 14:56:31.888852 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:56:31.888477    2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 09 14:56:31.888852 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:56:31.888523    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 14:56:31.888852 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:56:31.888539    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c006160e-a992-4ef4-86d2-a0ecd918f582-networking-console-plugin-cert podName:c006160e-a992-4ef4-86d2-a0ecd918f582 nodeName:}" failed. No retries permitted until 2026-07-09 14:57:35.888520246 +0000 UTC m=+163.731053170 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c006160e-a992-4ef4-86d2-a0ecd918f582-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-qkh9h" (UID: "c006160e-a992-4ef4-86d2-a0ecd918f582") : secret "networking-console-plugin-cert" not found
Jul 09 14:56:31.888852 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:56:31.888576    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4da1e96e-5ef6-4039-9a5e-0f1745820cc8-metrics-tls podName:4da1e96e-5ef6-4039-9a5e-0f1745820cc8 nodeName:}" failed. No retries permitted until 2026-07-09 14:57:35.888562256 +0000 UTC m=+163.731095166 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4da1e96e-5ef6-4039-9a5e-0f1745820cc8-metrics-tls") pod "dns-default-tjbtl" (UID: "4da1e96e-5ef6-4039-9a5e-0f1745820cc8") : secret "dns-default-metrics-tls" not found
Jul 09 14:56:31.888852 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:56:31.888585    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 14:56:31.888852 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:56:31.888601    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85c46dccf6-wnfkx: secret "image-registry-tls" not found
Jul 09 14:56:31.888852 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:56:31.888651    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03d6966e-dce9-4725-94f4-fbeafd3f48f0-registry-tls podName:03d6966e-dce9-4725-94f4-fbeafd3f48f0 nodeName:}" failed. No retries permitted until 2026-07-09 14:57:35.888639749 +0000 UTC m=+163.731172659 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/03d6966e-dce9-4725-94f4-fbeafd3f48f0-registry-tls") pod "image-registry-85c46dccf6-wnfkx" (UID: "03d6966e-dce9-4725-94f4-fbeafd3f48f0") : secret "image-registry-tls" not found
Jul 09 14:56:35.454232 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:56:35.454187    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:56:35.614234 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:56:35.614204    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-fs6ww"
Jul 09 14:56:36.749283 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:56:36.749243    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:02.507252 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:02.507197    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c37b4281-e19b-453c-aca5-f3fa37933b67-metrics-certs\") pod \"network-metrics-daemon-jpn9b\" (UID: \"c37b4281-e19b-453c-aca5-f3fa37933b67\") " pod="openshift-multus/network-metrics-daemon-jpn9b"
Jul 09 14:57:02.507865 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:57:02.507414    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 09 14:57:02.507865 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:57:02.507536    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c37b4281-e19b-453c-aca5-f3fa37933b67-metrics-certs podName:c37b4281-e19b-453c-aca5-f3fa37933b67 nodeName:}" failed. No retries permitted until 2026-07-09 14:59:04.50751552 +0000 UTC m=+252.350048453 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c37b4281-e19b-453c-aca5-f3fa37933b67-metrics-certs") pod "network-metrics-daemon-jpn9b" (UID: "c37b4281-e19b-453c-aca5-f3fa37933b67") : secret "metrics-daemon-secret" not found
Jul 09 14:57:10.939794 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:10.939741    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:11.040058 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:11.040020    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:13.385486 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:13.385453    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:13.447042 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:13.447006    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:14.591045 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:14.591008    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:14.685411 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:14.685379    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-c9s8h"]
Jul 09 14:57:14.688370 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:14.688337    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:14.688556 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:14.688537    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-c9s8h"
Jul 09 14:57:14.693579 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:14.693554    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 09 14:57:14.693700 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:14.693607    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 09 14:57:14.693700 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:14.693554    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 09 14:57:14.694352 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:14.694337    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 09 14:57:14.694429 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:14.694342    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-dh2jv\""
Jul 09 14:57:14.755412 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:14.755377    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-c9s8h"]
Jul 09 14:57:14.765262 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:14.765230    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:14.802365 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:14.802336    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fb0b26b0-9130-42ae-87a4-421786e8f65b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c9s8h\" (UID: \"fb0b26b0-9130-42ae-87a4-421786e8f65b\") " pod="openshift-insights/insights-runtime-extractor-c9s8h"
Jul 09 14:57:14.802365 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:14.802366    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msrh9\" (UniqueName: \"kubernetes.io/projected/fb0b26b0-9130-42ae-87a4-421786e8f65b-kube-api-access-msrh9\") pod \"insights-runtime-extractor-c9s8h\" (UID: \"fb0b26b0-9130-42ae-87a4-421786e8f65b\") " pod="openshift-insights/insights-runtime-extractor-c9s8h"
Jul 09 14:57:14.802513 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:14.802390    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fb0b26b0-9130-42ae-87a4-421786e8f65b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c9s8h\" (UID: \"fb0b26b0-9130-42ae-87a4-421786e8f65b\") " pod="openshift-insights/insights-runtime-extractor-c9s8h"
Jul 09 14:57:14.802513 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:14.802503    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fb0b26b0-9130-42ae-87a4-421786e8f65b-crio-socket\") pod \"insights-runtime-extractor-c9s8h\" (UID: \"fb0b26b0-9130-42ae-87a4-421786e8f65b\") " pod="openshift-insights/insights-runtime-extractor-c9s8h"
Jul 09 14:57:14.802588 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:14.802546    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fb0b26b0-9130-42ae-87a4-421786e8f65b-data-volume\") pod \"insights-runtime-extractor-c9s8h\" (UID: \"fb0b26b0-9130-42ae-87a4-421786e8f65b\") " pod="openshift-insights/insights-runtime-extractor-c9s8h"
Jul 09 14:57:14.903801 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:14.903767    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fb0b26b0-9130-42ae-87a4-421786e8f65b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c9s8h\" (UID: \"fb0b26b0-9130-42ae-87a4-421786e8f65b\") " pod="openshift-insights/insights-runtime-extractor-c9s8h"
Jul 09 14:57:14.903983 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:14.903814    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msrh9\" (UniqueName: \"kubernetes.io/projected/fb0b26b0-9130-42ae-87a4-421786e8f65b-kube-api-access-msrh9\") pod \"insights-runtime-extractor-c9s8h\" (UID: \"fb0b26b0-9130-42ae-87a4-421786e8f65b\") " pod="openshift-insights/insights-runtime-extractor-c9s8h"
Jul 09 14:57:14.903983 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:14.903839    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fb0b26b0-9130-42ae-87a4-421786e8f65b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c9s8h\" (UID: \"fb0b26b0-9130-42ae-87a4-421786e8f65b\") " pod="openshift-insights/insights-runtime-extractor-c9s8h"
Jul 09 14:57:14.903983 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:14.903893    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fb0b26b0-9130-42ae-87a4-421786e8f65b-crio-socket\") pod \"insights-runtime-extractor-c9s8h\" (UID: \"fb0b26b0-9130-42ae-87a4-421786e8f65b\") " pod="openshift-insights/insights-runtime-extractor-c9s8h"
Jul 09 14:57:14.903983 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:57:14.903903    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 14:57:14.903983 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:14.903927    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fb0b26b0-9130-42ae-87a4-421786e8f65b-data-volume\") pod \"insights-runtime-extractor-c9s8h\" (UID: \"fb0b26b0-9130-42ae-87a4-421786e8f65b\") " pod="openshift-insights/insights-runtime-extractor-c9s8h"
Jul 09 14:57:14.903983 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:57:14.903985    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fb0b26b0-9130-42ae-87a4-421786e8f65b-kube-rbac-proxy-cm podName:fb0b26b0-9130-42ae-87a4-421786e8f65b nodeName:}" failed. No retries permitted until 2026-07-09 14:57:15.403963 +0000 UTC m=+143.246495913 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fb0b26b0-9130-42ae-87a4-421786e8f65b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-c9s8h" (UID: "fb0b26b0-9130-42ae-87a4-421786e8f65b") : configmap "kube-rbac-proxy" not found
Jul 09 14:57:14.904234 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:57:14.904004    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 14:57:14.904234 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:14.904019    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fb0b26b0-9130-42ae-87a4-421786e8f65b-crio-socket\") pod \"insights-runtime-extractor-c9s8h\" (UID: \"fb0b26b0-9130-42ae-87a4-421786e8f65b\") " pod="openshift-insights/insights-runtime-extractor-c9s8h"
Jul 09 14:57:14.904234 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:57:14.904065    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb0b26b0-9130-42ae-87a4-421786e8f65b-insights-runtime-extractor-tls podName:fb0b26b0-9130-42ae-87a4-421786e8f65b nodeName:}" failed. No retries permitted until 2026-07-09 14:57:15.404048332 +0000 UTC m=+143.246581243 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fb0b26b0-9130-42ae-87a4-421786e8f65b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-c9s8h" (UID: "fb0b26b0-9130-42ae-87a4-421786e8f65b") : secret "insights-runtime-extractor-tls" not found
Jul 09 14:57:14.904330 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:14.904236    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fb0b26b0-9130-42ae-87a4-421786e8f65b-data-volume\") pod \"insights-runtime-extractor-c9s8h\" (UID: \"fb0b26b0-9130-42ae-87a4-421786e8f65b\") " pod="openshift-insights/insights-runtime-extractor-c9s8h"
Jul 09 14:57:14.913219 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:14.913193    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-msrh9\" (UniqueName: \"kubernetes.io/projected/fb0b26b0-9130-42ae-87a4-421786e8f65b-kube-api-access-msrh9\") pod \"insights-runtime-extractor-c9s8h\" (UID: \"fb0b26b0-9130-42ae-87a4-421786e8f65b\") " pod="openshift-insights/insights-runtime-extractor-c9s8h"
Jul 09 14:57:14.983515 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:14.983480    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:15.085894 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:15.085860    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:15.209247 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:15.209149    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:15.304819 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:15.304790    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:15.408106 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:15.408074    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fb0b26b0-9130-42ae-87a4-421786e8f65b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c9s8h\" (UID: \"fb0b26b0-9130-42ae-87a4-421786e8f65b\") " pod="openshift-insights/insights-runtime-extractor-c9s8h"
Jul 09 14:57:15.408267 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:15.408113    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fb0b26b0-9130-42ae-87a4-421786e8f65b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c9s8h\" (UID: \"fb0b26b0-9130-42ae-87a4-421786e8f65b\") " pod="openshift-insights/insights-runtime-extractor-c9s8h"
Jul 09 14:57:15.408267 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:57:15.408190    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 14:57:15.408267 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:57:15.408258    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fb0b26b0-9130-42ae-87a4-421786e8f65b-kube-rbac-proxy-cm podName:fb0b26b0-9130-42ae-87a4-421786e8f65b nodeName:}" failed. No retries permitted until 2026-07-09 14:57:16.408242102 +0000 UTC m=+144.250775011 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fb0b26b0-9130-42ae-87a4-421786e8f65b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-c9s8h" (UID: "fb0b26b0-9130-42ae-87a4-421786e8f65b") : configmap "kube-rbac-proxy" not found
Jul 09 14:57:15.408394 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:57:15.408313    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 14:57:15.408394 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:57:15.408365    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb0b26b0-9130-42ae-87a4-421786e8f65b-insights-runtime-extractor-tls podName:fb0b26b0-9130-42ae-87a4-421786e8f65b nodeName:}" failed. No retries permitted until 2026-07-09 14:57:16.408353714 +0000 UTC m=+144.250886624 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fb0b26b0-9130-42ae-87a4-421786e8f65b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-c9s8h" (UID: "fb0b26b0-9130-42ae-87a4-421786e8f65b") : secret "insights-runtime-extractor-tls" not found
Jul 09 14:57:15.682181 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:15.682144    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:15.782768 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:15.782729    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:16.415865 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:16.415820    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fb0b26b0-9130-42ae-87a4-421786e8f65b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c9s8h\" (UID: \"fb0b26b0-9130-42ae-87a4-421786e8f65b\") " pod="openshift-insights/insights-runtime-extractor-c9s8h"
Jul 09 14:57:16.415865 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:16.415871    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fb0b26b0-9130-42ae-87a4-421786e8f65b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c9s8h\" (UID: \"fb0b26b0-9130-42ae-87a4-421786e8f65b\") " pod="openshift-insights/insights-runtime-extractor-c9s8h"
Jul 09 14:57:16.416163 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:57:16.415957    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 14:57:16.416163 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:57:16.415973    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 14:57:16.416163 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:57:16.416027    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fb0b26b0-9130-42ae-87a4-421786e8f65b-kube-rbac-proxy-cm podName:fb0b26b0-9130-42ae-87a4-421786e8f65b nodeName:}" failed. No retries permitted until 2026-07-09 14:57:18.416006365 +0000 UTC m=+146.258539295 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fb0b26b0-9130-42ae-87a4-421786e8f65b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-c9s8h" (UID: "fb0b26b0-9130-42ae-87a4-421786e8f65b") : configmap "kube-rbac-proxy" not found
Jul 09 14:57:16.416163 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:57:16.416042    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb0b26b0-9130-42ae-87a4-421786e8f65b-insights-runtime-extractor-tls podName:fb0b26b0-9130-42ae-87a4-421786e8f65b nodeName:}" failed. No retries permitted until 2026-07-09 14:57:18.416036146 +0000 UTC m=+146.258569056 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fb0b26b0-9130-42ae-87a4-421786e8f65b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-c9s8h" (UID: "fb0b26b0-9130-42ae-87a4-421786e8f65b") : secret "insights-runtime-extractor-tls" not found
Jul 09 14:57:16.877962 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:16.877889    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xmx5q_fcff5fbe-84d3-47a1-9cde-4db751cbaae6/dns-node-resolver/0.log"
Jul 09 14:57:17.390916 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:17.390883    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:17.484468 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:17.484432    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:17.877805 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:17.877733    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zxwhs_030200a1-2c06-4390-ab1b-d3e79bd705f2/node-ca/0.log"
Jul 09 14:57:18.313320 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:18.313291    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:18.430953 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:18.430917    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fb0b26b0-9130-42ae-87a4-421786e8f65b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c9s8h\" (UID: \"fb0b26b0-9130-42ae-87a4-421786e8f65b\") " pod="openshift-insights/insights-runtime-extractor-c9s8h"
Jul 09 14:57:18.431118 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:18.430961    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fb0b26b0-9130-42ae-87a4-421786e8f65b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c9s8h\" (UID: \"fb0b26b0-9130-42ae-87a4-421786e8f65b\") " pod="openshift-insights/insights-runtime-extractor-c9s8h"
Jul 09 14:57:18.431118 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:57:18.431047    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 14:57:18.431118 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:57:18.431112    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 14:57:18.431213 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:57:18.431135    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fb0b26b0-9130-42ae-87a4-421786e8f65b-kube-rbac-proxy-cm podName:fb0b26b0-9130-42ae-87a4-421786e8f65b nodeName:}" failed. No retries permitted until 2026-07-09 14:57:22.431115642 +0000 UTC m=+150.273648598 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fb0b26b0-9130-42ae-87a4-421786e8f65b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-c9s8h" (UID: "fb0b26b0-9130-42ae-87a4-421786e8f65b") : configmap "kube-rbac-proxy" not found
Jul 09 14:57:18.431213 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:57:18.431153    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb0b26b0-9130-42ae-87a4-421786e8f65b-insights-runtime-extractor-tls podName:fb0b26b0-9130-42ae-87a4-421786e8f65b nodeName:}" failed. No retries permitted until 2026-07-09 14:57:22.43114487 +0000 UTC m=+150.273677785 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fb0b26b0-9130-42ae-87a4-421786e8f65b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-c9s8h" (UID: "fb0b26b0-9130-42ae-87a4-421786e8f65b") : secret "insights-runtime-extractor-tls" not found
Jul 09 14:57:18.477859 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:18.477834    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bsf52_fceb57a3-32ec-4a87-92a4-e92920e8326a/serve-healthcheck-canary/0.log"
Jul 09 14:57:19.050990 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:19.050944    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:19.149699 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:19.149664    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:19.251730 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:19.251681    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:19.381804 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:19.381768    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:19.931380 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:19.931346    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:20.531668 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:20.531634    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:21.153116 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:21.153068    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:21.327942 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:21.327908    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:21.534566 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:21.534477    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:21.919328 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:21.919295    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:22.007363 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:22.007332    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:22.458469 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:22.458430    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fb0b26b0-9130-42ae-87a4-421786e8f65b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c9s8h\" (UID: \"fb0b26b0-9130-42ae-87a4-421786e8f65b\") " pod="openshift-insights/insights-runtime-extractor-c9s8h"
Jul 09 14:57:22.458655 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:22.458487    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fb0b26b0-9130-42ae-87a4-421786e8f65b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c9s8h\" (UID: \"fb0b26b0-9130-42ae-87a4-421786e8f65b\") " pod="openshift-insights/insights-runtime-extractor-c9s8h"
Jul 09 14:57:22.458655 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:57:22.458606    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 14:57:22.458655 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:57:22.458622    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 14:57:22.458828 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:57:22.458688    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb0b26b0-9130-42ae-87a4-421786e8f65b-insights-runtime-extractor-tls podName:fb0b26b0-9130-42ae-87a4-421786e8f65b nodeName:}" failed. No retries permitted until 2026-07-09 14:57:30.458669677 +0000 UTC m=+158.301202606 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fb0b26b0-9130-42ae-87a4-421786e8f65b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-c9s8h" (UID: "fb0b26b0-9130-42ae-87a4-421786e8f65b") : secret "insights-runtime-extractor-tls" not found
Jul 09 14:57:22.458828 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:57:22.458725    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fb0b26b0-9130-42ae-87a4-421786e8f65b-kube-rbac-proxy-cm podName:fb0b26b0-9130-42ae-87a4-421786e8f65b nodeName:}" failed. No retries permitted until 2026-07-09 14:57:30.458699253 +0000 UTC m=+158.301232166 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fb0b26b0-9130-42ae-87a4-421786e8f65b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-c9s8h" (UID: "fb0b26b0-9130-42ae-87a4-421786e8f65b") : configmap "kube-rbac-proxy" not found
Jul 09 14:57:22.639245 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:22.639217    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:22.935319 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:22.935287    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:23.141680 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:23.141636    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:23.243205 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:23.243109    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:23.341696 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:23.341661    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:23.728578 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:23.728540    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:23.925946 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:23.925910    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:23.996364 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:23.996277    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:24.319356 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:24.319262    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:25.127875 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:25.127844    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:25.332120 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:25.332085    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:25.523666 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:25.523631    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:25.597029 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:25.596987    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:25.727824 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:25.727790    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:26.929581 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:26.929548    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:27.128846 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:27.128813    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:27.327869 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:27.327777    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:27.534959 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:27.534917    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:27.737116 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:27.737073    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:27.811523 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:27.811494    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:28.722274 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:28.722238    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:28.822842 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:28.822802    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:28.922659 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:28.922617    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:29.151147 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:29.151115    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:29.324151 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:29.324118    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:29.527688 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:29.527610    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:29.607434 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:29.607400    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:29.724080 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:29.724047    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:30.132562 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:30.132506    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:30.526020 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:30.525940    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fb0b26b0-9130-42ae-87a4-421786e8f65b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c9s8h\" (UID: \"fb0b26b0-9130-42ae-87a4-421786e8f65b\") " pod="openshift-insights/insights-runtime-extractor-c9s8h"
Jul 09 14:57:30.526020 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:30.525980    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fb0b26b0-9130-42ae-87a4-421786e8f65b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c9s8h\" (UID: \"fb0b26b0-9130-42ae-87a4-421786e8f65b\") " pod="openshift-insights/insights-runtime-extractor-c9s8h"
Jul 09 14:57:30.526447 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:30.526411    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fb0b26b0-9130-42ae-87a4-421786e8f65b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c9s8h\" (UID: \"fb0b26b0-9130-42ae-87a4-421786e8f65b\") " pod="openshift-insights/insights-runtime-extractor-c9s8h"
Jul 09 14:57:30.528109 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:30.528091    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fb0b26b0-9130-42ae-87a4-421786e8f65b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c9s8h\" (UID: \"fb0b26b0-9130-42ae-87a4-421786e8f65b\") " pod="openshift-insights/insights-runtime-extractor-c9s8h"
Jul 09 14:57:30.599364 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:30.599336    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-c9s8h"
Jul 09 14:57:30.724035 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:30.724005    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-c9s8h"]
Jul 09 14:57:30.726747 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:57:30.726697    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb0b26b0_9130_42ae_87a4_421786e8f65b.slice/crio-e9f5d21efe1add7323e54a4bfe0dafa5822a31ffa8033ad92103a407b744d3be WatchSource:0}: Error finding container e9f5d21efe1add7323e54a4bfe0dafa5822a31ffa8033ad92103a407b744d3be: Status 404 returned error can't find the container with id e9f5d21efe1add7323e54a4bfe0dafa5822a31ffa8033ad92103a407b744d3be
Jul 09 14:57:30.857175 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:30.857098    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-c9s8h" event={"ID":"fb0b26b0-9130-42ae-87a4-421786e8f65b","Type":"ContainerStarted","Data":"e9f5d21efe1add7323e54a4bfe0dafa5822a31ffa8033ad92103a407b744d3be"}
Jul 09 14:57:30.987347 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:57:30.987304    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-85c46dccf6-wnfkx" podUID="03d6966e-dce9-4725-94f4-fbeafd3f48f0"
Jul 09 14:57:31.023614 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:57:31.023583    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6cf856758c-qkh9h" podUID="c006160e-a992-4ef4-86d2-a0ecd918f582"
Jul 09 14:57:31.029777 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:57:31.029755    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-tjbtl" podUID="4da1e96e-5ef6-4039-9a5e-0f1745820cc8"
Jul 09 14:57:31.332451 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:57:31.332404    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-jpn9b" podUID="c37b4281-e19b-453c-aca5-f3fa37933b67"
Jul 09 14:57:31.859949 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:31.859918    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tjbtl"
Jul 09 14:57:31.860384 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:31.859924    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85c46dccf6-wnfkx"
Jul 09 14:57:31.860384 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:31.859924    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-qkh9h"
Jul 09 14:57:34.870464 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:34.870430    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-c9s8h" event={"ID":"fb0b26b0-9130-42ae-87a4-421786e8f65b","Type":"ContainerStarted","Data":"67bc497e54e7ab36d526b0aad8257c375882f32316d68a9f01a7f0ec55fbe62e"}
Jul 09 14:57:35.046118 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:35.046091    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:35.147817 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:35.147789    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:35.248330 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:35.248301    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:35.547543 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:35.547462    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:35.727678 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:35.727640    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:35.829314 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:35.829222    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:35.876429 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:35.876391    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-c9s8h" event={"ID":"fb0b26b0-9130-42ae-87a4-421786e8f65b","Type":"ContainerStarted","Data":"87afd1acf4cccf8bcaa8d4d314785ebf6f9b00293f60ae6c7f7c032e0209c246"}
Jul 09 14:57:35.929897 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:35.929861    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:35.967771 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:35.967731    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/03d6966e-dce9-4725-94f4-fbeafd3f48f0-registry-tls\") pod \"image-registry-85c46dccf6-wnfkx\" (UID: \"03d6966e-dce9-4725-94f4-fbeafd3f48f0\") " pod="openshift-image-registry/image-registry-85c46dccf6-wnfkx"
Jul 09 14:57:35.967949 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:35.967810    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c006160e-a992-4ef4-86d2-a0ecd918f582-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-qkh9h\" (UID: \"c006160e-a992-4ef4-86d2-a0ecd918f582\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-qkh9h"
Jul 09 14:57:35.967949 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:35.967861    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4da1e96e-5ef6-4039-9a5e-0f1745820cc8-metrics-tls\") pod \"dns-default-tjbtl\" (UID: \"4da1e96e-5ef6-4039-9a5e-0f1745820cc8\") " pod="openshift-dns/dns-default-tjbtl"
Jul 09 14:57:35.970576 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:35.970541    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4da1e96e-5ef6-4039-9a5e-0f1745820cc8-metrics-tls\") pod \"dns-default-tjbtl\" (UID: \"4da1e96e-5ef6-4039-9a5e-0f1745820cc8\") " pod="openshift-dns/dns-default-tjbtl"
Jul 09 14:57:35.970576 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:35.970555    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/03d6966e-dce9-4725-94f4-fbeafd3f48f0-registry-tls\") pod \"image-registry-85c46dccf6-wnfkx\" (UID: \"03d6966e-dce9-4725-94f4-fbeafd3f48f0\") " pod="openshift-image-registry/image-registry-85c46dccf6-wnfkx"
Jul 09 14:57:35.970801 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:35.970617    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c006160e-a992-4ef4-86d2-a0ecd918f582-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-qkh9h\" (UID: \"c006160e-a992-4ef4-86d2-a0ecd918f582\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-qkh9h"
Jul 09 14:57:35.996900 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:35.996840    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:36.063890 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:36.063859    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-74p4g\""
Jul 09 14:57:36.063890 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:36.063866    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-gfkwb\""
Jul 09 14:57:36.064111 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:36.063909    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mn998\""
Jul 09 14:57:36.071375 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:36.071348    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-qkh9h"
Jul 09 14:57:36.071375 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:36.071366    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tjbtl"
Jul 09 14:57:36.071572 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:36.071390    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85c46dccf6-wnfkx"
Jul 09 14:57:36.236825 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:36.236690    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-qkh9h"]
Jul 09 14:57:36.239769 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:57:36.239607    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc006160e_a992_4ef4_86d2_a0ecd918f582.slice/crio-94d770eb7fe6aa55cdbdee4608d395288999c92220b56acb9d24cb39c6db35a1 WatchSource:0}: Error finding container 94d770eb7fe6aa55cdbdee4608d395288999c92220b56acb9d24cb39c6db35a1: Status 404 returned error can't find the container with id 94d770eb7fe6aa55cdbdee4608d395288999c92220b56acb9d24cb39c6db35a1
Jul 09 14:57:36.261993 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:36.261961    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-85c46dccf6-wnfkx"]
Jul 09 14:57:36.264940 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:57:36.264910    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03d6966e_dce9_4725_94f4_fbeafd3f48f0.slice/crio-16c8adae078c009b01620e7408381a9341205a3b777d4fb7bf3419a23f09d316 WatchSource:0}: Error finding container 16c8adae078c009b01620e7408381a9341205a3b777d4fb7bf3419a23f09d316: Status 404 returned error can't find the container with id 16c8adae078c009b01620e7408381a9341205a3b777d4fb7bf3419a23f09d316
Jul 09 14:57:36.465124 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:36.465079    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tjbtl"]
Jul 09 14:57:36.468205 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:57:36.468176    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4da1e96e_5ef6_4039_9a5e_0f1745820cc8.slice/crio-615c1e9e8bd52a11b7ad97c2e7427b140d0e159e15d6494fa0a39961bcd793de WatchSource:0}: Error finding container 615c1e9e8bd52a11b7ad97c2e7427b140d0e159e15d6494fa0a39961bcd793de: Status 404 returned error can't find the container with id 615c1e9e8bd52a11b7ad97c2e7427b140d0e159e15d6494fa0a39961bcd793de
Jul 09 14:57:36.532106 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:36.532065    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:36.757836 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:36.757673    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:36.881089 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:36.881050    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-85c46dccf6-wnfkx" event={"ID":"03d6966e-dce9-4725-94f4-fbeafd3f48f0","Type":"ContainerStarted","Data":"a24a9493572fea69b34f88a9f0603c8dc872f88e35e7e10ad1086014fc8f57a5"}
Jul 09 14:57:36.881513 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:36.881148    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-85c46dccf6-wnfkx" event={"ID":"03d6966e-dce9-4725-94f4-fbeafd3f48f0","Type":"ContainerStarted","Data":"16c8adae078c009b01620e7408381a9341205a3b777d4fb7bf3419a23f09d316"}
Jul 09 14:57:36.881513 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:36.881179    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-85c46dccf6-wnfkx"
Jul 09 14:57:36.882381 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:36.882357    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tjbtl" event={"ID":"4da1e96e-5ef6-4039-9a5e-0f1745820cc8","Type":"ContainerStarted","Data":"615c1e9e8bd52a11b7ad97c2e7427b140d0e159e15d6494fa0a39961bcd793de"}
Jul 09 14:57:36.883505 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:36.883481    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-qkh9h" event={"ID":"c006160e-a992-4ef4-86d2-a0ecd918f582","Type":"ContainerStarted","Data":"94d770eb7fe6aa55cdbdee4608d395288999c92220b56acb9d24cb39c6db35a1"}
Jul 09 14:57:36.908195 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:36.908001    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-85c46dccf6-wnfkx" podStartSLOduration=163.907982775 podStartE2EDuration="2m43.907982775s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:54:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:57:36.907498941 +0000 UTC m=+164.750031900" watchObservedRunningTime="2026-07-09 14:57:36.907982775 +0000 UTC m=+164.750515708"
Jul 09 14:57:37.213092 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:37.213059    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:37.353057 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:37.353016    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:37.417814 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:37.417778    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:37.514343 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:37.514249    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dc9c8f7b6-dxptp" podUID="c369b2d0-4cba-42f1-9268-689f4e694970" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.6:8000/readyz\": dial tcp 10.132.0.6:8000: connect: connection refused"
Jul 09 14:57:37.890362 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:37.890305    2575 generic.go:356] "Generic (PLEG): container finished" podID="c369b2d0-4cba-42f1-9268-689f4e694970" containerID="f192b2cc79a8f928a945e23134c33d0184c3828a6eef1099c01de65552c28f4a" exitCode=1
Jul 09 14:57:37.890846 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:37.890401    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dc9c8f7b6-dxptp" event={"ID":"c369b2d0-4cba-42f1-9268-689f4e694970","Type":"ContainerDied","Data":"f192b2cc79a8f928a945e23134c33d0184c3828a6eef1099c01de65552c28f4a"}
Jul 09 14:57:37.890846 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:37.890825    2575 scope.go:117] "RemoveContainer" containerID="f192b2cc79a8f928a945e23134c33d0184c3828a6eef1099c01de65552c28f4a"
Jul 09 14:57:37.892995 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:37.892964    2575 generic.go:356] "Generic (PLEG): container finished" podID="4033d521-7b5b-4604-b9e2-90c6793fe0e3" containerID="0fb9da514832c53d00d4f9b24470c1fb28d85f4744c4e9d64bb6b622273a14ed" exitCode=255
Jul 09 14:57:37.893091 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:37.892997    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b65dc8b7d-24jr7" event={"ID":"4033d521-7b5b-4604-b9e2-90c6793fe0e3","Type":"ContainerDied","Data":"0fb9da514832c53d00d4f9b24470c1fb28d85f4744c4e9d64bb6b622273a14ed"}
Jul 09 14:57:37.893387 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:37.893344    2575 scope.go:117] "RemoveContainer" containerID="0fb9da514832c53d00d4f9b24470c1fb28d85f4744c4e9d64bb6b622273a14ed"
Jul 09 14:57:37.896537 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:37.896514    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-c9s8h" event={"ID":"fb0b26b0-9130-42ae-87a4-421786e8f65b","Type":"ContainerStarted","Data":"51b8301b3565177a0f237c6c4db4f9b0a6091a730dc95b71e5b95c6669952727"}
Jul 09 14:57:37.954498 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:37.954015    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-c9s8h" podStartSLOduration=17.150305001 podStartE2EDuration="23.953994817s" totalImagesPullingTime="6.803689816s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:57:14 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:57:37.953480272 +0000 UTC m=+165.796013238" watchObservedRunningTime="2026-07-09 14:57:37.953994817 +0000 UTC m=+165.796527750"
Jul 09 14:57:38.124392 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:38.124172    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:38.194418 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:38.194338    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:38.277371 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:38.277269    2575 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dc9c8f7b6-dxptp"
Jul 09 14:57:38.301611 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:38.301568    2575 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b65dc8b7d-24jr7"
Jul 09 14:57:38.902444 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:38.902405    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dc9c8f7b6-dxptp" event={"ID":"c369b2d0-4cba-42f1-9268-689f4e694970","Type":"ContainerStarted","Data":"0eaeae47d81af1a0d4863a79ebea287e0be368a414d0af9ea6d7f7e827a14954"}
Jul 09 14:57:38.902922 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:38.902569    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dc9c8f7b6-dxptp"
Jul 09 14:57:38.903622 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:38.903599    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dc9c8f7b6-dxptp"
Jul 09 14:57:38.904656 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:38.904632    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b65dc8b7d-24jr7" event={"ID":"4033d521-7b5b-4604-b9e2-90c6793fe0e3","Type":"ContainerStarted","Data":"6a85155fa3da574df83cb67f2d75e12206482f366d0e24a25c54512320ec1c83"}
Jul 09 14:57:38.906335 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:38.906305    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-qkh9h" event={"ID":"c006160e-a992-4ef4-86d2-a0ecd918f582","Type":"ContainerStarted","Data":"221f83a29b3591b8eb6c0efd9dc817509e6c1c9d093533f05cea33551b63d4a7"}
Jul 09 14:57:38.961550 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:38.961496    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-qkh9h" podStartSLOduration=156.812971024 podStartE2EDuration="2m38.961477225s" totalImagesPullingTime="2.148506201s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:55:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:57:38.96130433 +0000 UTC m=+166.803837261" watchObservedRunningTime="2026-07-09 14:57:38.961477225 +0000 UTC m=+166.804010156"
Jul 09 14:57:39.911377 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:39.911338    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tjbtl" event={"ID":"4da1e96e-5ef6-4039-9a5e-0f1745820cc8","Type":"ContainerStarted","Data":"a1c068a3cf988befea7aeb1a3590424f617c1e373f3e2d48afb971370b5874c7"}
Jul 09 14:57:39.911821 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:39.911396    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tjbtl" event={"ID":"4da1e96e-5ef6-4039-9a5e-0f1745820cc8","Type":"ContainerStarted","Data":"52b51d10f64ec6179457e9c4093348ea391834f97080cbea219edace19857fec"}
Jul 09 14:57:39.934999 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:39.934952    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-tjbtl" podStartSLOduration=130.355059236 podStartE2EDuration="2m12.934938473s" totalImagesPullingTime="2.579879237s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:55:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:57:39.934078613 +0000 UTC m=+167.776611545" watchObservedRunningTime="2026-07-09 14:57:39.934938473 +0000 UTC m=+167.777471409"
Jul 09 14:57:40.337596 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:40.337512    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:40.427614 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:40.427583    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:40.526138 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:40.526081    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:40.630641 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:40.630560    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:40.734971 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:40.734939    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:40.838792 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:40.838751    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:40.915075 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:40.915045    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-tjbtl"
Jul 09 14:57:42.311056 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:42.311008    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jpn9b"
Jul 09 14:57:42.942155 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:42.942122    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:43.032679 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:43.032629    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:43.150839 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:43.150802    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:44.929014 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:44.928932    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:45.763868 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:45.763830    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:45.828551 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:45.828515    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:47.136890 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:47.136848    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:47.357115 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:47.357078    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:47.439664 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:47.439592    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-6mt7n"]
Jul 09 14:57:47.442873 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:47.442853    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6mt7n"
Jul 09 14:57:47.445779 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:47.445664    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 09 14:57:47.445779 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:47.445695    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 09 14:57:47.446421 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:47.446401    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:47.446961 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:47.446937    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 09 14:57:47.447181 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:47.447162    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-qkgqz\""
Jul 09 14:57:47.447275 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:47.447162    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 09 14:57:47.447275 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:47.447163    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 09 14:57:47.447275 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:47.447201    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 09 14:57:47.555867 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:47.555822    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b6696c4f-26a8-4c56-a9aa-7818569be962-node-exporter-textfile\") pod \"node-exporter-6mt7n\" (UID: \"b6696c4f-26a8-4c56-a9aa-7818569be962\") " pod="openshift-monitoring/node-exporter-6mt7n"
Jul 09 14:57:47.555867 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:47.555872    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b6696c4f-26a8-4c56-a9aa-7818569be962-node-exporter-wtmp\") pod \"node-exporter-6mt7n\" (UID: \"b6696c4f-26a8-4c56-a9aa-7818569be962\") " pod="openshift-monitoring/node-exporter-6mt7n"
Jul 09 14:57:47.556080 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:47.555900    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b6696c4f-26a8-4c56-a9aa-7818569be962-node-exporter-accelerators-collector-config\") pod \"node-exporter-6mt7n\" (UID: \"b6696c4f-26a8-4c56-a9aa-7818569be962\") " pod="openshift-monitoring/node-exporter-6mt7n"
Jul 09 14:57:47.556080 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:47.555937    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b6696c4f-26a8-4c56-a9aa-7818569be962-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6mt7n\" (UID: \"b6696c4f-26a8-4c56-a9aa-7818569be962\") " pod="openshift-monitoring/node-exporter-6mt7n"
Jul 09 14:57:47.556080 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:47.556017    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b6696c4f-26a8-4c56-a9aa-7818569be962-sys\") pod \"node-exporter-6mt7n\" (UID: \"b6696c4f-26a8-4c56-a9aa-7818569be962\") " pod="openshift-monitoring/node-exporter-6mt7n"
Jul 09 14:57:47.556080 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:47.556059    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b6696c4f-26a8-4c56-a9aa-7818569be962-root\") pod \"node-exporter-6mt7n\" (UID: \"b6696c4f-26a8-4c56-a9aa-7818569be962\") " pod="openshift-monitoring/node-exporter-6mt7n"
Jul 09 14:57:47.556205 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:47.556082    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qk56n\" (UniqueName: \"kubernetes.io/projected/b6696c4f-26a8-4c56-a9aa-7818569be962-kube-api-access-qk56n\") pod \"node-exporter-6mt7n\" (UID: \"b6696c4f-26a8-4c56-a9aa-7818569be962\") " pod="openshift-monitoring/node-exporter-6mt7n"
Jul 09 14:57:47.556205 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:47.556112    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b6696c4f-26a8-4c56-a9aa-7818569be962-metrics-client-ca\") pod \"node-exporter-6mt7n\" (UID: \"b6696c4f-26a8-4c56-a9aa-7818569be962\") " pod="openshift-monitoring/node-exporter-6mt7n"
Jul 09 14:57:47.556205 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:47.556135    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b6696c4f-26a8-4c56-a9aa-7818569be962-node-exporter-tls\") pod \"node-exporter-6mt7n\" (UID: \"b6696c4f-26a8-4c56-a9aa-7818569be962\") " pod="openshift-monitoring/node-exporter-6mt7n"
Jul 09 14:57:47.656636 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:47.656600    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b6696c4f-26a8-4c56-a9aa-7818569be962-sys\") pod \"node-exporter-6mt7n\" (UID: \"b6696c4f-26a8-4c56-a9aa-7818569be962\") " pod="openshift-monitoring/node-exporter-6mt7n"
Jul 09 14:57:47.656636 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:47.656637    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b6696c4f-26a8-4c56-a9aa-7818569be962-root\") pod \"node-exporter-6mt7n\" (UID: \"b6696c4f-26a8-4c56-a9aa-7818569be962\") " pod="openshift-monitoring/node-exporter-6mt7n"
Jul 09 14:57:47.656852 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:47.656656    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qk56n\" (UniqueName: \"kubernetes.io/projected/b6696c4f-26a8-4c56-a9aa-7818569be962-kube-api-access-qk56n\") pod \"node-exporter-6mt7n\" (UID: \"b6696c4f-26a8-4c56-a9aa-7818569be962\") " pod="openshift-monitoring/node-exporter-6mt7n"
Jul 09 14:57:47.656852 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:47.656747    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b6696c4f-26a8-4c56-a9aa-7818569be962-sys\") pod \"node-exporter-6mt7n\" (UID: \"b6696c4f-26a8-4c56-a9aa-7818569be962\") " pod="openshift-monitoring/node-exporter-6mt7n"
Jul 09 14:57:47.656852 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:47.656778    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b6696c4f-26a8-4c56-a9aa-7818569be962-metrics-client-ca\") pod \"node-exporter-6mt7n\" (UID: \"b6696c4f-26a8-4c56-a9aa-7818569be962\") " pod="openshift-monitoring/node-exporter-6mt7n"
Jul 09 14:57:47.656852 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:47.656809    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b6696c4f-26a8-4c56-a9aa-7818569be962-node-exporter-tls\") pod \"node-exporter-6mt7n\" (UID: \"b6696c4f-26a8-4c56-a9aa-7818569be962\") " pod="openshift-monitoring/node-exporter-6mt7n"
Jul 09 14:57:47.656852 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:47.656747    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b6696c4f-26a8-4c56-a9aa-7818569be962-root\") pod \"node-exporter-6mt7n\" (UID: \"b6696c4f-26a8-4c56-a9aa-7818569be962\") " pod="openshift-monitoring/node-exporter-6mt7n"
Jul 09 14:57:47.656852 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:47.656851    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b6696c4f-26a8-4c56-a9aa-7818569be962-node-exporter-textfile\") pod \"node-exporter-6mt7n\" (UID: \"b6696c4f-26a8-4c56-a9aa-7818569be962\") " pod="openshift-monitoring/node-exporter-6mt7n"
Jul 09 14:57:47.657101 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:47.656873    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b6696c4f-26a8-4c56-a9aa-7818569be962-node-exporter-wtmp\") pod \"node-exporter-6mt7n\" (UID: \"b6696c4f-26a8-4c56-a9aa-7818569be962\") " pod="openshift-monitoring/node-exporter-6mt7n"
Jul 09 14:57:47.657101 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:47.656898    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b6696c4f-26a8-4c56-a9aa-7818569be962-node-exporter-accelerators-collector-config\") pod \"node-exporter-6mt7n\" (UID: \"b6696c4f-26a8-4c56-a9aa-7818569be962\") " pod="openshift-monitoring/node-exporter-6mt7n"
Jul 09 14:57:47.657101 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:47.656933    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b6696c4f-26a8-4c56-a9aa-7818569be962-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6mt7n\" (UID: \"b6696c4f-26a8-4c56-a9aa-7818569be962\") " pod="openshift-monitoring/node-exporter-6mt7n"
Jul 09 14:57:47.657101 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:47.657089    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b6696c4f-26a8-4c56-a9aa-7818569be962-node-exporter-wtmp\") pod \"node-exporter-6mt7n\" (UID: \"b6696c4f-26a8-4c56-a9aa-7818569be962\") " pod="openshift-monitoring/node-exporter-6mt7n"
Jul 09 14:57:47.657272 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:47.657249    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b6696c4f-26a8-4c56-a9aa-7818569be962-node-exporter-textfile\") pod \"node-exporter-6mt7n\" (UID: \"b6696c4f-26a8-4c56-a9aa-7818569be962\") " pod="openshift-monitoring/node-exporter-6mt7n"
Jul 09 14:57:47.657449 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:47.657423    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b6696c4f-26a8-4c56-a9aa-7818569be962-metrics-client-ca\") pod \"node-exporter-6mt7n\" (UID: \"b6696c4f-26a8-4c56-a9aa-7818569be962\") " pod="openshift-monitoring/node-exporter-6mt7n"
Jul 09 14:57:47.657449 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:47.657434    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b6696c4f-26a8-4c56-a9aa-7818569be962-node-exporter-accelerators-collector-config\") pod \"node-exporter-6mt7n\" (UID: \"b6696c4f-26a8-4c56-a9aa-7818569be962\") " pod="openshift-monitoring/node-exporter-6mt7n"
Jul 09 14:57:47.659205 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:47.659186    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b6696c4f-26a8-4c56-a9aa-7818569be962-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6mt7n\" (UID: \"b6696c4f-26a8-4c56-a9aa-7818569be962\") " pod="openshift-monitoring/node-exporter-6mt7n"
Jul 09 14:57:47.659363 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:47.659344    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b6696c4f-26a8-4c56-a9aa-7818569be962-node-exporter-tls\") pod \"node-exporter-6mt7n\" (UID: \"b6696c4f-26a8-4c56-a9aa-7818569be962\") " pod="openshift-monitoring/node-exporter-6mt7n"
Jul 09 14:57:47.669486 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:47.669456    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qk56n\" (UniqueName: \"kubernetes.io/projected/b6696c4f-26a8-4c56-a9aa-7818569be962-kube-api-access-qk56n\") pod \"node-exporter-6mt7n\" (UID: \"b6696c4f-26a8-4c56-a9aa-7818569be962\") " pod="openshift-monitoring/node-exporter-6mt7n"
Jul 09 14:57:47.671463 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:47.671427    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:47.752227 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:47.752144    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6mt7n"
Jul 09 14:57:47.762391 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:57:47.762366    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6696c4f_26a8_4c56_a9aa_7818569be962.slice/crio-efcc3f9d7c0dfcd7601162e93e14650303557288ba84ba0a5a280278e124a3d5 WatchSource:0}: Error finding container efcc3f9d7c0dfcd7601162e93e14650303557288ba84ba0a5a280278e124a3d5: Status 404 returned error can't find the container with id efcc3f9d7c0dfcd7601162e93e14650303557288ba84ba0a5a280278e124a3d5
Jul 09 14:57:47.772151 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:47.772122    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:47.873080 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:47.873040    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:47.938532 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:47.938499    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6mt7n" event={"ID":"b6696c4f-26a8-4c56-a9aa-7818569be962","Type":"ContainerStarted","Data":"efcc3f9d7c0dfcd7601162e93e14650303557288ba84ba0a5a280278e124a3d5"}
Jul 09 14:57:48.373204 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:48.373168    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:48.509258 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:48.509206    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:48.677463 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:48.677439    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:48.777049 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:48.777024    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:48.943942 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:48.943910    2575 generic.go:356] "Generic (PLEG): container finished" podID="b6696c4f-26a8-4c56-a9aa-7818569be962" containerID="2cf76166d6b0d6a48bb11574bd321a6fe7bb8548ba4d4afacbdc4635d6193de7" exitCode=0
Jul 09 14:57:48.944118 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:48.943964    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6mt7n" event={"ID":"b6696c4f-26a8-4c56-a9aa-7818569be962","Type":"ContainerDied","Data":"2cf76166d6b0d6a48bb11574bd321a6fe7bb8548ba4d4afacbdc4635d6193de7"}
Jul 09 14:57:49.948679 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:49.948638    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6mt7n" event={"ID":"b6696c4f-26a8-4c56-a9aa-7818569be962","Type":"ContainerStarted","Data":"f59d9d5c27d664befa27d1e897750583f593114aeb269385b114945eb8409446"}
Jul 09 14:57:49.949081 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:49.948690    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6mt7n" event={"ID":"b6696c4f-26a8-4c56-a9aa-7818569be962","Type":"ContainerStarted","Data":"86ef4e9a420c1b533f1218eeea83038e2f2351f105d581cd577e8eea20a2af94"}
Jul 09 14:57:49.972079 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:49.972034    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-6mt7n" podStartSLOduration=2.061642979 podStartE2EDuration="2.972020219s" totalImagesPullingTime="848.100915ms" totalInitContainerRuntime="62.276325ms" isStatefulPod=true podCreationTimestamp="2026-07-09 14:57:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:57:49.970913544 +0000 UTC m=+177.813446495" watchObservedRunningTime="2026-07-09 14:57:49.972020219 +0000 UTC m=+177.814553150"
Jul 09 14:57:50.185886 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:50.185855    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:50.283601 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:50.283523    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:50.419892 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:50.419849    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:50.500502 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:50.500470    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:50.573970 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:50.573894    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:50.722429 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:50.722398    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:50.919799 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:50.919772    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-tjbtl"
Jul 09 14:57:51.138408 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:51.138373    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:52.196723 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:52.196672    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:52.267503 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:52.267473    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:52.331232 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:52.331198    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:53.719910 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:53.719873    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:56.076395 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:56.076361    2575 patch_prober.go:28] interesting pod/image-registry-85c46dccf6-wnfkx container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 09 14:57:56.076794 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:56.076413    2575 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-85c46dccf6-wnfkx" podUID="03d6966e-dce9-4725-94f4-fbeafd3f48f0" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 09 14:57:57.901256 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:57.901222    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-85c46dccf6-wnfkx"
Jul 09 14:57:58.166530 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:58.166445    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:58.266071 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:57:58.266035    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:58:00.074188 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:58:00.074152    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:58:00.138978 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:58:00.138944    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:58:02.703115 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:58:02.701163    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-85c46dccf6-wnfkx"]
Jul 09 14:58:02.807753 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:58:02.807719    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:58:02.924425 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:58:02.924387    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:58:02.988818 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:58:02.988703    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:58:03.831346 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:58:03.831315    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:58:03.932058 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:58:03.932027    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:58:07.159998 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:58:07.159962    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:58:07.230967 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:58:07.230932    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:58:08.318218 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:58:08.318186    2575 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57bf8d5b48-fslzd" podUID="7b7fc356-35d5-4aae-af54-3633423b16d1" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 09 14:58:08.797098 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:58:08.797051    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:58:08.871312 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:58:08.871279    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:58:09.001580 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:58:09.001544    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:58:09.103233 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:58:09.103146    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:58:10.134174 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:58:10.134143    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:58:12.470477 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:58:12.470445    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:58:12.533251 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:58:12.533200    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:58:13.963654 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:58:13.963623    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:58:18.321736 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:58:18.319519    2575 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57bf8d5b48-fslzd" podUID="7b7fc356-35d5-4aae-af54-3633423b16d1" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 09 14:58:20.872881 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:58:20.872849    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:58:20.984063 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:58:20.984023    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:58:23.135383 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:58:23.135347    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:58:23.204421 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:58:23.204378    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:58:27.723464 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:58:27.723394    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-85c46dccf6-wnfkx" podUID="03d6966e-dce9-4725-94f4-fbeafd3f48f0" containerName="registry" containerID="cri-o://a24a9493572fea69b34f88a9f0603c8dc872f88e35e7e10ad1086014fc8f57a5" gracePeriod=30
Jul 09 14:58:27.962365 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:58:27.962340    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85c46dccf6-wnfkx"
Jul 09 14:58:28.052912 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:58:28.052828    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ps27z\" (UniqueName: \"kubernetes.io/projected/03d6966e-dce9-4725-94f4-fbeafd3f48f0-kube-api-access-ps27z\") pod \"03d6966e-dce9-4725-94f4-fbeafd3f48f0\" (UID: \"03d6966e-dce9-4725-94f4-fbeafd3f48f0\") "
Jul 09 14:58:28.052912 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:58:28.052870    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/03d6966e-dce9-4725-94f4-fbeafd3f48f0-registry-tls\") pod \"03d6966e-dce9-4725-94f4-fbeafd3f48f0\" (UID: \"03d6966e-dce9-4725-94f4-fbeafd3f48f0\") "
Jul 09 14:58:28.052912 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:58:28.052905    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/03d6966e-dce9-4725-94f4-fbeafd3f48f0-image-registry-private-configuration\") pod \"03d6966e-dce9-4725-94f4-fbeafd3f48f0\" (UID: \"03d6966e-dce9-4725-94f4-fbeafd3f48f0\") "
Jul 09 14:58:28.053184 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:58:28.053077    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/03d6966e-dce9-4725-94f4-fbeafd3f48f0-bound-sa-token\") pod \"03d6966e-dce9-4725-94f4-fbeafd3f48f0\" (UID: \"03d6966e-dce9-4725-94f4-fbeafd3f48f0\") "
Jul 09 14:58:28.053184 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:58:28.053126    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/03d6966e-dce9-4725-94f4-fbeafd3f48f0-registry-certificates\") pod \"03d6966e-dce9-4725-94f4-fbeafd3f48f0\" (UID: \"03d6966e-dce9-4725-94f4-fbeafd3f48f0\") "
Jul 09 14:58:28.053184 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:58:28.053154    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/03d6966e-dce9-4725-94f4-fbeafd3f48f0-trusted-ca\") pod \"03d6966e-dce9-4725-94f4-fbeafd3f48f0\" (UID: \"03d6966e-dce9-4725-94f4-fbeafd3f48f0\") "
Jul 09 14:58:28.053348 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:58:28.053194    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/03d6966e-dce9-4725-94f4-fbeafd3f48f0-installation-pull-secrets\") pod \"03d6966e-dce9-4725-94f4-fbeafd3f48f0\" (UID: \"03d6966e-dce9-4725-94f4-fbeafd3f48f0\") "
Jul 09 14:58:28.053348 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:58:28.053250    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/03d6966e-dce9-4725-94f4-fbeafd3f48f0-ca-trust-extracted\") pod \"03d6966e-dce9-4725-94f4-fbeafd3f48f0\" (UID: \"03d6966e-dce9-4725-94f4-fbeafd3f48f0\") "
Jul 09 14:58:28.053845 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:58:28.053760    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03d6966e-dce9-4725-94f4-fbeafd3f48f0-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "03d6966e-dce9-4725-94f4-fbeafd3f48f0" (UID: "03d6966e-dce9-4725-94f4-fbeafd3f48f0"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 14:58:28.053845 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:58:28.053772    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03d6966e-dce9-4725-94f4-fbeafd3f48f0-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "03d6966e-dce9-4725-94f4-fbeafd3f48f0" (UID: "03d6966e-dce9-4725-94f4-fbeafd3f48f0"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 14:58:28.055379 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:58:28.055349    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03d6966e-dce9-4725-94f4-fbeafd3f48f0-kube-api-access-ps27z" (OuterVolumeSpecName: "kube-api-access-ps27z") pod "03d6966e-dce9-4725-94f4-fbeafd3f48f0" (UID: "03d6966e-dce9-4725-94f4-fbeafd3f48f0"). InnerVolumeSpecName "kube-api-access-ps27z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 14:58:28.055493 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:58:28.055465    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03d6966e-dce9-4725-94f4-fbeafd3f48f0-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "03d6966e-dce9-4725-94f4-fbeafd3f48f0" (UID: "03d6966e-dce9-4725-94f4-fbeafd3f48f0"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 14:58:28.055493 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:58:28.055476    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03d6966e-dce9-4725-94f4-fbeafd3f48f0-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "03d6966e-dce9-4725-94f4-fbeafd3f48f0" (UID: "03d6966e-dce9-4725-94f4-fbeafd3f48f0"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 14:58:28.055577 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:58:28.055496    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03d6966e-dce9-4725-94f4-fbeafd3f48f0-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "03d6966e-dce9-4725-94f4-fbeafd3f48f0" (UID: "03d6966e-dce9-4725-94f4-fbeafd3f48f0"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 14:58:28.055747 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:58:28.055724    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03d6966e-dce9-4725-94f4-fbeafd3f48f0-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "03d6966e-dce9-4725-94f4-fbeafd3f48f0" (UID: "03d6966e-dce9-4725-94f4-fbeafd3f48f0"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 14:58:28.062007 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:58:28.061984    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03d6966e-dce9-4725-94f4-fbeafd3f48f0-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "03d6966e-dce9-4725-94f4-fbeafd3f48f0" (UID: "03d6966e-dce9-4725-94f4-fbeafd3f48f0"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 14:58:28.069542 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:58:28.069520    2575 generic.go:356] "Generic (PLEG): container finished" podID="03d6966e-dce9-4725-94f4-fbeafd3f48f0" containerID="a24a9493572fea69b34f88a9f0603c8dc872f88e35e7e10ad1086014fc8f57a5" exitCode=0
Jul 09 14:58:28.069629 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:58:28.069562    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85c46dccf6-wnfkx"
Jul 09 14:58:28.069629 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:58:28.069588    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-85c46dccf6-wnfkx" event={"ID":"03d6966e-dce9-4725-94f4-fbeafd3f48f0","Type":"ContainerDied","Data":"a24a9493572fea69b34f88a9f0603c8dc872f88e35e7e10ad1086014fc8f57a5"}
Jul 09 14:58:28.069697 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:58:28.069627    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-85c46dccf6-wnfkx" event={"ID":"03d6966e-dce9-4725-94f4-fbeafd3f48f0","Type":"ContainerDied","Data":"16c8adae078c009b01620e7408381a9341205a3b777d4fb7bf3419a23f09d316"}
Jul 09 14:58:28.069697 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:58:28.069662    2575 scope.go:117] "RemoveContainer" containerID="a24a9493572fea69b34f88a9f0603c8dc872f88e35e7e10ad1086014fc8f57a5"
Jul 09 14:58:28.077773 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:58:28.077754    2575 scope.go:117] "RemoveContainer" containerID="a24a9493572fea69b34f88a9f0603c8dc872f88e35e7e10ad1086014fc8f57a5"
Jul 09 14:58:28.078025 ip-10-0-137-94 kubenswrapper[2575]: E0709 14:58:28.078008    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a24a9493572fea69b34f88a9f0603c8dc872f88e35e7e10ad1086014fc8f57a5\": container with ID starting with a24a9493572fea69b34f88a9f0603c8dc872f88e35e7e10ad1086014fc8f57a5 not found: ID does not exist" containerID="a24a9493572fea69b34f88a9f0603c8dc872f88e35e7e10ad1086014fc8f57a5"
Jul 09 14:58:28.078075 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:58:28.078032    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a24a9493572fea69b34f88a9f0603c8dc872f88e35e7e10ad1086014fc8f57a5"} err="failed to get container status \"a24a9493572fea69b34f88a9f0603c8dc872f88e35e7e10ad1086014fc8f57a5\": rpc error: code = NotFound desc = could not find container \"a24a9493572fea69b34f88a9f0603c8dc872f88e35e7e10ad1086014fc8f57a5\": container with ID starting with a24a9493572fea69b34f88a9f0603c8dc872f88e35e7e10ad1086014fc8f57a5 not found: ID does not exist"
Jul 09 14:58:28.092331 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:58:28.092303    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-85c46dccf6-wnfkx"]
Jul 09 14:58:28.096295 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:58:28.096274    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-85c46dccf6-wnfkx"]
Jul 09 14:58:28.154726 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:58:28.154680    2575 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/03d6966e-dce9-4725-94f4-fbeafd3f48f0-ca-trust-extracted\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 14:58:28.154726 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:58:28.154703    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ps27z\" (UniqueName: \"kubernetes.io/projected/03d6966e-dce9-4725-94f4-fbeafd3f48f0-kube-api-access-ps27z\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 14:58:28.154897 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:58:28.154746    2575 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/03d6966e-dce9-4725-94f4-fbeafd3f48f0-registry-tls\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 14:58:28.154897 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:58:28.154759    2575 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/03d6966e-dce9-4725-94f4-fbeafd3f48f0-image-registry-private-configuration\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 14:58:28.154897 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:58:28.154769    2575 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/03d6966e-dce9-4725-94f4-fbeafd3f48f0-bound-sa-token\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 14:58:28.154897 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:58:28.154776    2575 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/03d6966e-dce9-4725-94f4-fbeafd3f48f0-registry-certificates\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 14:58:28.154897 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:58:28.154784    2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/03d6966e-dce9-4725-94f4-fbeafd3f48f0-trusted-ca\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 14:58:28.154897 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:58:28.154794    2575 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/03d6966e-dce9-4725-94f4-fbeafd3f48f0-installation-pull-secrets\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 14:58:28.318848 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:58:28.318764    2575 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57bf8d5b48-fslzd" podUID="7b7fc356-35d5-4aae-af54-3633423b16d1" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 09 14:58:28.318848 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:58:28.318844    2575 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57bf8d5b48-fslzd"
Jul 09 14:58:28.319393 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:58:28.319375    2575 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"78099aaa0ac367e46b894ce95e43f73c78890b0ba7a3fbded04205a604ad2308"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57bf8d5b48-fslzd" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Jul 09 14:58:28.319431 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:58:28.319416    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57bf8d5b48-fslzd" podUID="7b7fc356-35d5-4aae-af54-3633423b16d1" containerName="service-proxy" containerID="cri-o://78099aaa0ac367e46b894ce95e43f73c78890b0ba7a3fbded04205a604ad2308" gracePeriod=30
Jul 09 14:58:28.728229 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:58:28.728196    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:58:28.799606 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:58:28.799554    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:58:29.075122 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:58:29.075044    2575 generic.go:356] "Generic (PLEG): container finished" podID="7b7fc356-35d5-4aae-af54-3633423b16d1" containerID="78099aaa0ac367e46b894ce95e43f73c78890b0ba7a3fbded04205a604ad2308" exitCode=2
Jul 09 14:58:29.075264 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:58:29.075117    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57bf8d5b48-fslzd" event={"ID":"7b7fc356-35d5-4aae-af54-3633423b16d1","Type":"ContainerDied","Data":"78099aaa0ac367e46b894ce95e43f73c78890b0ba7a3fbded04205a604ad2308"}
Jul 09 14:58:29.075264 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:58:29.075173    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57bf8d5b48-fslzd" event={"ID":"7b7fc356-35d5-4aae-af54-3633423b16d1","Type":"ContainerStarted","Data":"72a2b1e53d6760e6476131ccae0ba17b6b5d54de7d9d8f4c0c975ed69b46ef76"}
Jul 09 14:58:29.315090 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:58:29.315058    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03d6966e-dce9-4725-94f4-fbeafd3f48f0" path="/var/lib/kubelet/pods/03d6966e-dce9-4725-94f4-fbeafd3f48f0/volumes"
Jul 09 14:58:31.608028 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:58:31.607984    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:58:31.763041 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:58:31.763010    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:58:31.862387 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:58:31.862303    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:58:32.898176 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:58:32.898137    2575 patch_prober.go:28] interesting pod/image-registry-85c46dccf6-wnfkx container/registry namespace/openshift-image-registry: Readiness probe status=failure output="Get \"https://10.132.0.7:5000/healthz\": context deadline exceeded" start-of-body=
Jul 09 14:58:32.898549 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:58:32.898193    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-85c46dccf6-wnfkx" podUID="03d6966e-dce9-4725-94f4-fbeafd3f48f0" containerName="registry" probeResult="failure" output="Get \"https://10.132.0.7:5000/healthz\": context deadline exceeded"
Jul 09 14:58:38.114527 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:58:38.114497    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:58:38.181580 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:58:38.181543    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:58:41.024207 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:58:41.024174    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:58:41.092054 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:58:41.092020    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:59:04.513844 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:59:04.513806    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c37b4281-e19b-453c-aca5-f3fa37933b67-metrics-certs\") pod \"network-metrics-daemon-jpn9b\" (UID: \"c37b4281-e19b-453c-aca5-f3fa37933b67\") " pod="openshift-multus/network-metrics-daemon-jpn9b"
Jul 09 14:59:04.516120 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:59:04.516096    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c37b4281-e19b-453c-aca5-f3fa37933b67-metrics-certs\") pod \"network-metrics-daemon-jpn9b\" (UID: \"c37b4281-e19b-453c-aca5-f3fa37933b67\") " pod="openshift-multus/network-metrics-daemon-jpn9b"
Jul 09 14:59:04.566837 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:59:04.566801    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:59:04.815041 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:59:04.814966    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9rvwx\""
Jul 09 14:59:04.823048 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:59:04.823028    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jpn9b"
Jul 09 14:59:04.968816 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:59:04.968684    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jpn9b"]
Jul 09 14:59:04.971226 ip-10-0-137-94 kubenswrapper[2575]: W0709 14:59:04.971204    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc37b4281_e19b_453c_aca5_f3fa37933b67.slice/crio-15693be8a035eb671f74576fdd1a90a9b173381632d5968a97015df0431e5eab WatchSource:0}: Error finding container 15693be8a035eb671f74576fdd1a90a9b173381632d5968a97015df0431e5eab: Status 404 returned error can't find the container with id 15693be8a035eb671f74576fdd1a90a9b173381632d5968a97015df0431e5eab
Jul 09 14:59:05.187349 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:59:05.187316    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jpn9b" event={"ID":"c37b4281-e19b-453c-aca5-f3fa37933b67","Type":"ContainerStarted","Data":"15693be8a035eb671f74576fdd1a90a9b173381632d5968a97015df0431e5eab"}
Jul 09 14:59:06.192701 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:59:06.192665    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jpn9b" event={"ID":"c37b4281-e19b-453c-aca5-f3fa37933b67","Type":"ContainerStarted","Data":"9b364277d2cc09a6098d9346fb154cbcc3ebf15d6a1782ab2e4088618f586008"}
Jul 09 14:59:06.193101 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:59:06.192729    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jpn9b" event={"ID":"c37b4281-e19b-453c-aca5-f3fa37933b67","Type":"ContainerStarted","Data":"d7bda8e1a1187c60d317962ba09445190c51eaf7d9590b88f700c970a68355cc"}
Jul 09 14:59:06.215034 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:59:06.214966    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-jpn9b" podStartSLOduration=252.218853682 podStartE2EDuration="4m13.214946673s" totalImagesPullingTime="996.092991ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:54:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:59:06.213317008 +0000 UTC m=+254.055849941" watchObservedRunningTime="2026-07-09 14:59:06.214946673 +0000 UTC m=+254.057479606"
Jul 09 14:59:06.319835 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:59:06.319754    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:59:06.381255 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:59:06.381226    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:59:06.726444 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:59:06.726408    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:59:06.873581 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:59:06.873547    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:59:06.993051 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:59:06.992970    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:59:15.929101 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:59:15.929016    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:59:16.905216 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:59:16.905178    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:59:27.386085 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:59:27.386045    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:59:27.488257 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:59:27.488224    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:59:27.564095 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:59:27.564060    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:59:42.260416 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:59:42.260364    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 14:59:52.620023 ip-10-0-137-94 kubenswrapper[2575]: I0709 14:59:52.619994    2575 kubelet.go:1648] "Image garbage collection succeeded"
Jul 09 15:00:22.021989 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:00:22.021943    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:00:22.123934 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:00:22.123906    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:00:34.081814 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:00:34.081772    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:00:34.180011 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:00:34.179980    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:00:35.318591 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:00:35.318554    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:00:36.041015 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:00:36.040970    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:00:38.122142 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:00:38.122101    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:00:38.218975 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:00:38.218942    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:00:46.647448 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:00:46.647343    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:00:46.759277 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:00:46.759220    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:00:47.909108 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:00:47.909077    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:00:56.957460 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:00:56.957419    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:00:57.054126 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:00:57.054093    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:01:24.057877 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:01:24.057836    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:01:24.429939 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:01:24.429907    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:01:27.679196 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:01:27.679160    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:01:27.823114 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:01:27.823079    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:01:29.485558 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:01:29.485519    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:01:29.587635 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:01:29.587597    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:01:30.130385 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:01:30.130350    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:01:30.257238 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:01:30.257209    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:01:30.445076 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:01:30.445048    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9w2v2"]
Jul 09 15:01:30.445287 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:01:30.445275    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03d6966e-dce9-4725-94f4-fbeafd3f48f0" containerName="registry"
Jul 09 15:01:30.445329 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:01:30.445289    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="03d6966e-dce9-4725-94f4-fbeafd3f48f0" containerName="registry"
Jul 09 15:01:30.445367 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:01:30.445328    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="03d6966e-dce9-4725-94f4-fbeafd3f48f0" containerName="registry"
Jul 09 15:01:30.448180 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:01:30.448165    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9w2v2"
Jul 09 15:01:30.450900 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:01:30.450877    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 09 15:01:30.451371 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:01:30.451350    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 09 15:01:30.451702 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:01:30.451395    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-lqt8x\""
Jul 09 15:01:30.461250 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:01:30.461226    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9w2v2"]
Jul 09 15:01:30.567638 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:01:30.567603    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/96f282bb-b51a-4fdd-8771-1be6f70e6c9e-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9w2v2\" (UID: \"96f282bb-b51a-4fdd-8771-1be6f70e6c9e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9w2v2"
Jul 09 15:01:30.567638 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:01:30.567637    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/96f282bb-b51a-4fdd-8771-1be6f70e6c9e-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9w2v2\" (UID: \"96f282bb-b51a-4fdd-8771-1be6f70e6c9e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9w2v2"
Jul 09 15:01:30.568061 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:01:30.567683    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwn7l\" (UniqueName: \"kubernetes.io/projected/96f282bb-b51a-4fdd-8771-1be6f70e6c9e-kube-api-access-bwn7l\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9w2v2\" (UID: \"96f282bb-b51a-4fdd-8771-1be6f70e6c9e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9w2v2"
Jul 09 15:01:30.668380 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:01:30.668349    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/96f282bb-b51a-4fdd-8771-1be6f70e6c9e-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9w2v2\" (UID: \"96f282bb-b51a-4fdd-8771-1be6f70e6c9e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9w2v2"
Jul 09 15:01:30.668380 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:01:30.668383    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/96f282bb-b51a-4fdd-8771-1be6f70e6c9e-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9w2v2\" (UID: \"96f282bb-b51a-4fdd-8771-1be6f70e6c9e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9w2v2"
Jul 09 15:01:30.668583 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:01:30.668428    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwn7l\" (UniqueName: \"kubernetes.io/projected/96f282bb-b51a-4fdd-8771-1be6f70e6c9e-kube-api-access-bwn7l\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9w2v2\" (UID: \"96f282bb-b51a-4fdd-8771-1be6f70e6c9e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9w2v2"
Jul 09 15:01:30.668768 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:01:30.668749    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/96f282bb-b51a-4fdd-8771-1be6f70e6c9e-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9w2v2\" (UID: \"96f282bb-b51a-4fdd-8771-1be6f70e6c9e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9w2v2"
Jul 09 15:01:30.668808 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:01:30.668783    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/96f282bb-b51a-4fdd-8771-1be6f70e6c9e-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9w2v2\" (UID: \"96f282bb-b51a-4fdd-8771-1be6f70e6c9e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9w2v2"
Jul 09 15:01:30.678933 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:01:30.678914    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwn7l\" (UniqueName: \"kubernetes.io/projected/96f282bb-b51a-4fdd-8771-1be6f70e6c9e-kube-api-access-bwn7l\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9w2v2\" (UID: \"96f282bb-b51a-4fdd-8771-1be6f70e6c9e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9w2v2"
Jul 09 15:01:30.758981 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:01:30.758892    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9w2v2"
Jul 09 15:01:30.888145 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:01:30.888113    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9w2v2"]
Jul 09 15:01:30.891298 ip-10-0-137-94 kubenswrapper[2575]: W0709 15:01:30.891272    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96f282bb_b51a_4fdd_8771_1be6f70e6c9e.slice/crio-ffa3932248daa580bc79de65e931bcafd933b4a8142b33f688a4734fafd21126 WatchSource:0}: Error finding container ffa3932248daa580bc79de65e931bcafd933b4a8142b33f688a4734fafd21126: Status 404 returned error can't find the container with id ffa3932248daa580bc79de65e931bcafd933b4a8142b33f688a4734fafd21126
Jul 09 15:01:30.893188 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:01:30.893171    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 15:01:31.643424 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:01:31.643389    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9w2v2" event={"ID":"96f282bb-b51a-4fdd-8771-1be6f70e6c9e","Type":"ContainerStarted","Data":"ffa3932248daa580bc79de65e931bcafd933b4a8142b33f688a4734fafd21126"}
Jul 09 15:01:32.485916 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:01:32.485881    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:01:32.565649 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:01:32.565597    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:01:34.667382 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:01:34.667340    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:01:34.767168 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:01:34.767128    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:01:37.665423 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:01:37.665382    2575 generic.go:356] "Generic (PLEG): container finished" podID="96f282bb-b51a-4fdd-8771-1be6f70e6c9e" containerID="c317d51733e1d9da3b9847a6fcd912fc6b79da117efe4c02083ee4275bd5bfb7" exitCode=0
Jul 09 15:01:37.665799 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:01:37.665469    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9w2v2" event={"ID":"96f282bb-b51a-4fdd-8771-1be6f70e6c9e","Type":"ContainerDied","Data":"c317d51733e1d9da3b9847a6fcd912fc6b79da117efe4c02083ee4275bd5bfb7"}
Jul 09 15:01:40.303794 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:01:40.303742    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:01:40.362598 ip-10-0-137-94 kubenswrapper[2575]: E0709 15:01:40.362552    2575 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: writing blob: storing blob to file \"/var/tmp/container_images_storage3869891256/1\": happened during read: unexpected EOF (while reconnecting: Get \"https://cdn01.quay.io/quayio-production-s3/sha256/8e/8ed306a9eb2cdc7b5db57788b7a70b8d6dae2ecfc602b7662ac4cebb197a1841?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIATAAF2YHTGR23ZTE6%2F20260709%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20260709T150139Z&X-Amz-Expires=600&X-Amz-SignedHeaders=host&X-Amz-Signature=74611a489616c11c6b462490bdebb9c725ee8e51e9f225b3de5e8a7713e91dca&region=us-east-1&namespace=redhat-prod&username=redhat-prod+registry_proxy&repo_name=leader-worker-set----lws-operator-bundle&akamai_signature=exp=1783610199~hmac=d112d89dd5917ec2012f4ac9cd8f96a8e9d9dbe4fde8095f984aba82056d721a\": EOF); artifact err: provided artifact is a container image" image="registry.redhat.io/leader-worker-set/lws-operator-bundle@sha256:f641cf3b2d6659e26eb0ae49c67a3416152a2fbc2f26f490889a2bd169b9ea06"
Jul 09 15:01:40.362787 ip-10-0-137-94 kubenswrapper[2575]: E0709 15:01:40.362671    2575 kuberuntime_manager.go:1459] "Unhandled Error" err="init container pull start failed in pod 77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9w2v2_openshift-marketplace(96f282bb-b51a-4fdd-8771-1be6f70e6c9e): ErrImagePull: unable to pull image or OCI artifact: pull image err: writing blob: storing blob to file \"/var/tmp/container_images_storage3869891256/1\": happened during read: unexpected EOF (while reconnecting: Get \"https://cdn01.quay.io/quayio-production-s3/sha256/8e/8ed306a9eb2cdc7b5db57788b7a70b8d6dae2ecfc602b7662ac4cebb197a1841?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIATAAF2YHTGR23ZTE6%2F20260709%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20260709T150139Z&X-Amz-Expires=600&X-Amz-SignedHeaders=host&X-Amz-Signature=74611a489616c11c6b462490bdebb9c725ee8e51e9f225b3de5e8a7713e91dca&region=us-east-1&namespace=redhat-prod&username=redhat-prod+registry_proxy&repo_name=leader-worker-set----lws-operator-bundle&akamai_signature=exp=1783610199~hmac=d112d89dd5917ec2012f4ac9cd8f96a8e9d9dbe4fde8095f984aba82056d721a\": EOF); artifact err: provided artifact is a container image" logger="UnhandledError"
Jul 09 15:01:40.362787 ip-10-0-137-94 kubenswrapper[2575]: E0709 15:01:40.362748    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"pull\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: writing blob: storing blob to file \\\"/var/tmp/container_images_storage3869891256/1\\\": happened during read: unexpected EOF (while reconnecting: Get \\\"https://cdn01.quay.io/quayio-production-s3/sha256/8e/8ed306a9eb2cdc7b5db57788b7a70b8d6dae2ecfc602b7662ac4cebb197a1841?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIATAAF2YHTGR23ZTE6%2F20260709%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20260709T150139Z&X-Amz-Expires=600&X-Amz-SignedHeaders=host&X-Amz-Signature=74611a489616c11c6b462490bdebb9c725ee8e51e9f225b3de5e8a7713e91dca&region=us-east-1&namespace=redhat-prod&username=redhat-prod+registry_proxy&repo_name=leader-worker-set----lws-operator-bundle&akamai_signature=exp=1783610199~hmac=d112d89dd5917ec2012f4ac9cd8f96a8e9d9dbe4fde8095f984aba82056d721a\\\": EOF); artifact err: provided artifact is a container image\"" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9w2v2" podUID="96f282bb-b51a-4fdd-8771-1be6f70e6c9e"
Jul 09 15:01:40.676382 ip-10-0-137-94 kubenswrapper[2575]: E0709 15:01:40.676334    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"pull\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/leader-worker-set/lws-operator-bundle@sha256:f641cf3b2d6659e26eb0ae49c67a3416152a2fbc2f26f490889a2bd169b9ea06\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: writing blob: storing blob to file \\\"/var/tmp/container_images_storage3869891256/1\\\": happened during read: unexpected EOF (while reconnecting: Get \\\"https://cdn01.quay.io/quayio-production-s3/sha256/8e/8ed306a9eb2cdc7b5db57788b7a70b8d6dae2ecfc602b7662ac4cebb197a1841?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIATAAF2YHTGR23ZTE6%2F20260709%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20260709T150139Z&X-Amz-Expires=600&X-Amz-SignedHeaders=host&X-Amz-Signature=74611a489616c11c6b462490bdebb9c725ee8e51e9f225b3de5e8a7713e91dca&region=us-east-1&namespace=redhat-prod&username=redhat-prod+registry_proxy&repo_name=leader-worker-set----lws-operator-bundle&akamai_signature=exp=1783610199~hmac=d112d89dd5917ec2012f4ac9cd8f96a8e9d9dbe4fde8095f984aba82056d721a\\\": EOF); artifact err: provided artifact is a container image\"" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9w2v2" podUID="96f282bb-b51a-4fdd-8771-1be6f70e6c9e"
Jul 09 15:01:43.841033 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:01:43.840998    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:01:43.907742 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:01:43.907674    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:01:56.730005 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:01:56.729917    2575 generic.go:356] "Generic (PLEG): container finished" podID="96f282bb-b51a-4fdd-8771-1be6f70e6c9e" containerID="c48ed2f80dc3928775e91ba65d813018d3c39273c81ff6623814cce080b6865d" exitCode=0
Jul 09 15:01:56.730005 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:01:56.729958    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9w2v2" event={"ID":"96f282bb-b51a-4fdd-8771-1be6f70e6c9e","Type":"ContainerDied","Data":"c48ed2f80dc3928775e91ba65d813018d3c39273c81ff6623814cce080b6865d"}
Jul 09 15:02:06.771493 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:06.771458    2575 generic.go:356] "Generic (PLEG): container finished" podID="96f282bb-b51a-4fdd-8771-1be6f70e6c9e" containerID="72ca09d260adbe16c09df473b9c3d59e94d3b22308f3fdfc2d671b78b5c403a5" exitCode=0
Jul 09 15:02:06.771859 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:06.771537    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9w2v2" event={"ID":"96f282bb-b51a-4fdd-8771-1be6f70e6c9e","Type":"ContainerDied","Data":"72ca09d260adbe16c09df473b9c3d59e94d3b22308f3fdfc2d671b78b5c403a5"}
Jul 09 15:02:07.902169 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:07.902143    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9w2v2"
Jul 09 15:02:08.035002 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:08.034907    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bwn7l\" (UniqueName: \"kubernetes.io/projected/96f282bb-b51a-4fdd-8771-1be6f70e6c9e-kube-api-access-bwn7l\") pod \"96f282bb-b51a-4fdd-8771-1be6f70e6c9e\" (UID: \"96f282bb-b51a-4fdd-8771-1be6f70e6c9e\") "
Jul 09 15:02:08.035002 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:08.034960    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/96f282bb-b51a-4fdd-8771-1be6f70e6c9e-bundle\") pod \"96f282bb-b51a-4fdd-8771-1be6f70e6c9e\" (UID: \"96f282bb-b51a-4fdd-8771-1be6f70e6c9e\") "
Jul 09 15:02:08.035229 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:08.035083    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/96f282bb-b51a-4fdd-8771-1be6f70e6c9e-util\") pod \"96f282bb-b51a-4fdd-8771-1be6f70e6c9e\" (UID: \"96f282bb-b51a-4fdd-8771-1be6f70e6c9e\") "
Jul 09 15:02:08.035428 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:08.035403    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96f282bb-b51a-4fdd-8771-1be6f70e6c9e-bundle" (OuterVolumeSpecName: "bundle") pod "96f282bb-b51a-4fdd-8771-1be6f70e6c9e" (UID: "96f282bb-b51a-4fdd-8771-1be6f70e6c9e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:02:08.037204 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:08.037181    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96f282bb-b51a-4fdd-8771-1be6f70e6c9e-kube-api-access-bwn7l" (OuterVolumeSpecName: "kube-api-access-bwn7l") pod "96f282bb-b51a-4fdd-8771-1be6f70e6c9e" (UID: "96f282bb-b51a-4fdd-8771-1be6f70e6c9e"). InnerVolumeSpecName "kube-api-access-bwn7l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:02:08.039080 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:08.039058    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96f282bb-b51a-4fdd-8771-1be6f70e6c9e-util" (OuterVolumeSpecName: "util") pod "96f282bb-b51a-4fdd-8771-1be6f70e6c9e" (UID: "96f282bb-b51a-4fdd-8771-1be6f70e6c9e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:02:08.135516 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:08.135476    2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/96f282bb-b51a-4fdd-8771-1be6f70e6c9e-bundle\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:02:08.135516 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:08.135507    2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/96f282bb-b51a-4fdd-8771-1be6f70e6c9e-util\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:02:08.135516 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:08.135516    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bwn7l\" (UniqueName: \"kubernetes.io/projected/96f282bb-b51a-4fdd-8771-1be6f70e6c9e-kube-api-access-bwn7l\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:02:08.779867 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:08.779841    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9w2v2"
Jul 09 15:02:08.780042 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:08.779839    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9w2v2" event={"ID":"96f282bb-b51a-4fdd-8771-1be6f70e6c9e","Type":"ContainerDied","Data":"ffa3932248daa580bc79de65e931bcafd933b4a8142b33f688a4734fafd21126"}
Jul 09 15:02:08.780042 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:08.779960    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ffa3932248daa580bc79de65e931bcafd933b4a8142b33f688a4734fafd21126"
Jul 09 15:02:12.569093 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:12.569061    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:02:12.668959 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:12.668924    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:02:14.573042 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:14.573012    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-sg8r9"]
Jul 09 15:02:14.573397 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:14.573237    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96f282bb-b51a-4fdd-8771-1be6f70e6c9e" containerName="extract"
Jul 09 15:02:14.573397 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:14.573247    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="96f282bb-b51a-4fdd-8771-1be6f70e6c9e" containerName="extract"
Jul 09 15:02:14.573397 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:14.573257    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96f282bb-b51a-4fdd-8771-1be6f70e6c9e" containerName="util"
Jul 09 15:02:14.573397 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:14.573263    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="96f282bb-b51a-4fdd-8771-1be6f70e6c9e" containerName="util"
Jul 09 15:02:14.573397 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:14.573273    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96f282bb-b51a-4fdd-8771-1be6f70e6c9e" containerName="pull"
Jul 09 15:02:14.573397 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:14.573278    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="96f282bb-b51a-4fdd-8771-1be6f70e6c9e" containerName="pull"
Jul 09 15:02:14.573397 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:14.573316    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="96f282bb-b51a-4fdd-8771-1be6f70e6c9e" containerName="extract"
Jul 09 15:02:14.576229 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:14.576212    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-sg8r9"
Jul 09 15:02:14.578538 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:14.578517    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 09 15:02:14.579385 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:14.579367    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 09 15:02:14.579475 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:14.579384    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-rhfv9\""
Jul 09 15:02:14.586478 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:14.586396    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-sg8r9"]
Jul 09 15:02:14.680050 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:14.680015    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/95ebf602-4df7-4fed-b4cf-d65a2623f6f3-tmp\") pod \"openshift-lws-operator-fd8ccff4c-sg8r9\" (UID: \"95ebf602-4df7-4fed-b4cf-d65a2623f6f3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-sg8r9"
Jul 09 15:02:14.680214 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:14.680078    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlpqg\" (UniqueName: \"kubernetes.io/projected/95ebf602-4df7-4fed-b4cf-d65a2623f6f3-kube-api-access-hlpqg\") pod \"openshift-lws-operator-fd8ccff4c-sg8r9\" (UID: \"95ebf602-4df7-4fed-b4cf-d65a2623f6f3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-sg8r9"
Jul 09 15:02:14.781272 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:14.781230    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/95ebf602-4df7-4fed-b4cf-d65a2623f6f3-tmp\") pod \"openshift-lws-operator-fd8ccff4c-sg8r9\" (UID: \"95ebf602-4df7-4fed-b4cf-d65a2623f6f3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-sg8r9"
Jul 09 15:02:14.781407 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:14.781308    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlpqg\" (UniqueName: \"kubernetes.io/projected/95ebf602-4df7-4fed-b4cf-d65a2623f6f3-kube-api-access-hlpqg\") pod \"openshift-lws-operator-fd8ccff4c-sg8r9\" (UID: \"95ebf602-4df7-4fed-b4cf-d65a2623f6f3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-sg8r9"
Jul 09 15:02:14.781623 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:14.781603    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/95ebf602-4df7-4fed-b4cf-d65a2623f6f3-tmp\") pod \"openshift-lws-operator-fd8ccff4c-sg8r9\" (UID: \"95ebf602-4df7-4fed-b4cf-d65a2623f6f3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-sg8r9"
Jul 09 15:02:14.789541 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:14.789510    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlpqg\" (UniqueName: \"kubernetes.io/projected/95ebf602-4df7-4fed-b4cf-d65a2623f6f3-kube-api-access-hlpqg\") pod \"openshift-lws-operator-fd8ccff4c-sg8r9\" (UID: \"95ebf602-4df7-4fed-b4cf-d65a2623f6f3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-sg8r9"
Jul 09 15:02:14.885055 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:14.884997    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-sg8r9"
Jul 09 15:02:15.005604 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:15.005437    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-sg8r9"]
Jul 09 15:02:15.008119 ip-10-0-137-94 kubenswrapper[2575]: W0709 15:02:15.008087    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod95ebf602_4df7_4fed_b4cf_d65a2623f6f3.slice/crio-e196934115a3bc12b67e8e2b3d15338406d2fddd16ecefdb0af29b60832b15e4 WatchSource:0}: Error finding container e196934115a3bc12b67e8e2b3d15338406d2fddd16ecefdb0af29b60832b15e4: Status 404 returned error can't find the container with id e196934115a3bc12b67e8e2b3d15338406d2fddd16ecefdb0af29b60832b15e4
Jul 09 15:02:15.804252 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:15.804215    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-sg8r9" event={"ID":"95ebf602-4df7-4fed-b4cf-d65a2623f6f3","Type":"ContainerStarted","Data":"e196934115a3bc12b67e8e2b3d15338406d2fddd16ecefdb0af29b60832b15e4"}
Jul 09 15:02:17.813030 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:17.812988    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-sg8r9" event={"ID":"95ebf602-4df7-4fed-b4cf-d65a2623f6f3","Type":"ContainerStarted","Data":"ba16c99e467dcbfc2ee4f4b9537f36af931338a85e85d9ecba643912141f4cb2"}
Jul 09 15:02:17.834096 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:17.834047    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-sg8r9" podStartSLOduration=1.796404983 podStartE2EDuration="3.834031331s" totalImagesPullingTime="2.037626348s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:02:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:02:17.832585517 +0000 UTC m=+445.675118460" watchObservedRunningTime="2026-07-09 15:02:17.834031331 +0000 UTC m=+445.676564263"
Jul 09 15:02:18.521358 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:18.521316    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:02:18.620125 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:18.620058    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:02:20.373965 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:20.373929    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:02:25.845665 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:25.845613    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:02:25.911018 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:25.910976    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:02:37.318127 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:37.318092    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:02:37.421801 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:37.421757    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:02:38.163853 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:38.163819    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:02:38.745587 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:38.745551    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-69d458487d-75frk"]
Jul 09 15:02:38.796456 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:38.796429    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-69d458487d-75frk"]
Jul 09 15:02:38.796601 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:38.796524    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-69d458487d-75frk"
Jul 09 15:02:38.808465 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:38.808442    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-28fml\""
Jul 09 15:02:38.821519 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:38.821494    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 09 15:02:38.821972 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:38.821951    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 09 15:02:38.822078 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:38.821980    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 09 15:02:38.822078 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:38.822005    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 09 15:02:38.860838 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:38.860800    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3a9dc5e2-12a0-4235-ac1d-e425d48fd107-apiservice-cert\") pod \"opendatahub-operator-controller-manager-69d458487d-75frk\" (UID: \"3a9dc5e2-12a0-4235-ac1d-e425d48fd107\") " pod="opendatahub/opendatahub-operator-controller-manager-69d458487d-75frk"
Jul 09 15:02:38.860838 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:38.860839    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a9dc5e2-12a0-4235-ac1d-e425d48fd107-tmp\") pod \"opendatahub-operator-controller-manager-69d458487d-75frk\" (UID: \"3a9dc5e2-12a0-4235-ac1d-e425d48fd107\") " pod="opendatahub/opendatahub-operator-controller-manager-69d458487d-75frk"
Jul 09 15:02:38.861039 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:38.860871    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3a9dc5e2-12a0-4235-ac1d-e425d48fd107-manifests\") pod \"opendatahub-operator-controller-manager-69d458487d-75frk\" (UID: \"3a9dc5e2-12a0-4235-ac1d-e425d48fd107\") " pod="opendatahub/opendatahub-operator-controller-manager-69d458487d-75frk"
Jul 09 15:02:38.861039 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:38.860896    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lppvs\" (UniqueName: \"kubernetes.io/projected/3a9dc5e2-12a0-4235-ac1d-e425d48fd107-kube-api-access-lppvs\") pod \"opendatahub-operator-controller-manager-69d458487d-75frk\" (UID: \"3a9dc5e2-12a0-4235-ac1d-e425d48fd107\") " pod="opendatahub/opendatahub-operator-controller-manager-69d458487d-75frk"
Jul 09 15:02:38.861039 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:38.860917    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3a9dc5e2-12a0-4235-ac1d-e425d48fd107-webhook-cert\") pod \"opendatahub-operator-controller-manager-69d458487d-75frk\" (UID: \"3a9dc5e2-12a0-4235-ac1d-e425d48fd107\") " pod="opendatahub/opendatahub-operator-controller-manager-69d458487d-75frk"
Jul 09 15:02:38.961757 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:38.961702    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3a9dc5e2-12a0-4235-ac1d-e425d48fd107-apiservice-cert\") pod \"opendatahub-operator-controller-manager-69d458487d-75frk\" (UID: \"3a9dc5e2-12a0-4235-ac1d-e425d48fd107\") " pod="opendatahub/opendatahub-operator-controller-manager-69d458487d-75frk"
Jul 09 15:02:38.961915 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:38.961768    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a9dc5e2-12a0-4235-ac1d-e425d48fd107-tmp\") pod \"opendatahub-operator-controller-manager-69d458487d-75frk\" (UID: \"3a9dc5e2-12a0-4235-ac1d-e425d48fd107\") " pod="opendatahub/opendatahub-operator-controller-manager-69d458487d-75frk"
Jul 09 15:02:38.961915 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:38.961817    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3a9dc5e2-12a0-4235-ac1d-e425d48fd107-manifests\") pod \"opendatahub-operator-controller-manager-69d458487d-75frk\" (UID: \"3a9dc5e2-12a0-4235-ac1d-e425d48fd107\") " pod="opendatahub/opendatahub-operator-controller-manager-69d458487d-75frk"
Jul 09 15:02:38.961915 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:38.961856    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lppvs\" (UniqueName: \"kubernetes.io/projected/3a9dc5e2-12a0-4235-ac1d-e425d48fd107-kube-api-access-lppvs\") pod \"opendatahub-operator-controller-manager-69d458487d-75frk\" (UID: \"3a9dc5e2-12a0-4235-ac1d-e425d48fd107\") " pod="opendatahub/opendatahub-operator-controller-manager-69d458487d-75frk"
Jul 09 15:02:38.961915 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:38.961892    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3a9dc5e2-12a0-4235-ac1d-e425d48fd107-webhook-cert\") pod \"opendatahub-operator-controller-manager-69d458487d-75frk\" (UID: \"3a9dc5e2-12a0-4235-ac1d-e425d48fd107\") " pod="opendatahub/opendatahub-operator-controller-manager-69d458487d-75frk"
Jul 09 15:02:38.962332 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:38.962306    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3a9dc5e2-12a0-4235-ac1d-e425d48fd107-manifests\") pod \"opendatahub-operator-controller-manager-69d458487d-75frk\" (UID: \"3a9dc5e2-12a0-4235-ac1d-e425d48fd107\") " pod="opendatahub/opendatahub-operator-controller-manager-69d458487d-75frk"
Jul 09 15:02:38.964084 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:38.964062    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a9dc5e2-12a0-4235-ac1d-e425d48fd107-tmp\") pod \"opendatahub-operator-controller-manager-69d458487d-75frk\" (UID: \"3a9dc5e2-12a0-4235-ac1d-e425d48fd107\") " pod="opendatahub/opendatahub-operator-controller-manager-69d458487d-75frk"
Jul 09 15:02:38.964206 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:38.964183    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3a9dc5e2-12a0-4235-ac1d-e425d48fd107-webhook-cert\") pod \"opendatahub-operator-controller-manager-69d458487d-75frk\" (UID: \"3a9dc5e2-12a0-4235-ac1d-e425d48fd107\") " pod="opendatahub/opendatahub-operator-controller-manager-69d458487d-75frk"
Jul 09 15:02:38.964288 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:38.964270    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3a9dc5e2-12a0-4235-ac1d-e425d48fd107-apiservice-cert\") pod \"opendatahub-operator-controller-manager-69d458487d-75frk\" (UID: \"3a9dc5e2-12a0-4235-ac1d-e425d48fd107\") " pod="opendatahub/opendatahub-operator-controller-manager-69d458487d-75frk"
Jul 09 15:02:38.971634 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:38.971609    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lppvs\" (UniqueName: \"kubernetes.io/projected/3a9dc5e2-12a0-4235-ac1d-e425d48fd107-kube-api-access-lppvs\") pod \"opendatahub-operator-controller-manager-69d458487d-75frk\" (UID: \"3a9dc5e2-12a0-4235-ac1d-e425d48fd107\") " pod="opendatahub/opendatahub-operator-controller-manager-69d458487d-75frk"
Jul 09 15:02:39.105905 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:39.105819    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-69d458487d-75frk"
Jul 09 15:02:39.270764 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:39.270726    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-69d458487d-75frk"]
Jul 09 15:02:39.275128 ip-10-0-137-94 kubenswrapper[2575]: W0709 15:02:39.275088    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a9dc5e2_12a0_4235_ac1d_e425d48fd107.slice/crio-84e6ff6af00947236fdcf16d819ad8acddc2dcc39cf8faea795c9384b0f245bc WatchSource:0}: Error finding container 84e6ff6af00947236fdcf16d819ad8acddc2dcc39cf8faea795c9384b0f245bc: Status 404 returned error can't find the container with id 84e6ff6af00947236fdcf16d819ad8acddc2dcc39cf8faea795c9384b0f245bc
Jul 09 15:02:39.589139 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:39.589108    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:02:39.692484 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:39.692449    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:02:39.889617 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:39.889581    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69d458487d-75frk" event={"ID":"3a9dc5e2-12a0-4235-ac1d-e425d48fd107","Type":"ContainerStarted","Data":"84e6ff6af00947236fdcf16d819ad8acddc2dcc39cf8faea795c9384b0f245bc"}
Jul 09 15:02:42.904162 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:42.904124    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69d458487d-75frk" event={"ID":"3a9dc5e2-12a0-4235-ac1d-e425d48fd107","Type":"ContainerStarted","Data":"ba1f03281dc2a84166fab12dce08be496ecc4bef8a0a23fd0b12ce0dffd28b67"}
Jul 09 15:02:43.908560 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:43.908529    2575 generic.go:356] "Generic (PLEG): container finished" podID="3a9dc5e2-12a0-4235-ac1d-e425d48fd107" containerID="ba1f03281dc2a84166fab12dce08be496ecc4bef8a0a23fd0b12ce0dffd28b67" exitCode=0
Jul 09 15:02:43.908962 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:43.908592    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69d458487d-75frk" event={"ID":"3a9dc5e2-12a0-4235-ac1d-e425d48fd107","Type":"ContainerDied","Data":"ba1f03281dc2a84166fab12dce08be496ecc4bef8a0a23fd0b12ce0dffd28b67"}
Jul 09 15:02:45.917037 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:45.916996    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69d458487d-75frk" event={"ID":"3a9dc5e2-12a0-4235-ac1d-e425d48fd107","Type":"ContainerStarted","Data":"d532a32219a3f530a7e5e3c09d1d59c7cdf8c6eb614cce00f2d3c6ce20b1e2ce"}
Jul 09 15:02:45.917489 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:45.917119    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-69d458487d-75frk"
Jul 09 15:02:45.954926 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:45.954871    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-69d458487d-75frk" podStartSLOduration=2.447544059 podStartE2EDuration="7.954853206s" totalImagesPullingTime="4.424585618s" totalInitContainerRuntime="1.082723529s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:02:38 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:02:45.95307041 +0000 UTC m=+473.795603342" watchObservedRunningTime="2026-07-09 15:02:45.954853206 +0000 UTC m=+473.797386151"
Jul 09 15:02:50.008326 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:50.008282    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:02:50.204261 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:50.204220    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:02:50.294947 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:50.294870    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:02:52.015864 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:52.015825    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:02:52.116670 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:52.116633    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:02:56.922917 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:56.922890    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-69d458487d-75frk"
Jul 09 15:02:59.746356 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:59.746319    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:02:59.944580 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:02:59.944549    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:03:00.153089 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:00.153056    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:03:00.308153 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:00.308121    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-8d68d4884-swz9s"]
Jul 09 15:03:00.317584 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:00.317556    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-8d68d4884-swz9s"
Jul 09 15:03:00.320451 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:00.320425    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 09 15:03:00.320451 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:00.320444    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 09 15:03:00.321473 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:00.321452    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-7bvmw\""
Jul 09 15:03:00.321619 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:00.321497    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 09 15:03:00.321619 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:00.321501    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 09 15:03:00.323620 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:00.323597    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-8d68d4884-swz9s"]
Jul 09 15:03:00.358261 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:00.358229    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:03:00.415568 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:00.415503    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/904241fe-9e22-47b8-beca-a9df45ab3f25-tls-certs\") pod \"kube-auth-proxy-8d68d4884-swz9s\" (UID: \"904241fe-9e22-47b8-beca-a9df45ab3f25\") " pod="openshift-ingress/kube-auth-proxy-8d68d4884-swz9s"
Jul 09 15:03:00.415568 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:00.415560    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2tmc\" (UniqueName: \"kubernetes.io/projected/904241fe-9e22-47b8-beca-a9df45ab3f25-kube-api-access-q2tmc\") pod \"kube-auth-proxy-8d68d4884-swz9s\" (UID: \"904241fe-9e22-47b8-beca-a9df45ab3f25\") " pod="openshift-ingress/kube-auth-proxy-8d68d4884-swz9s"
Jul 09 15:03:00.415757 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:00.415594    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/904241fe-9e22-47b8-beca-a9df45ab3f25-tmp\") pod \"kube-auth-proxy-8d68d4884-swz9s\" (UID: \"904241fe-9e22-47b8-beca-a9df45ab3f25\") " pod="openshift-ingress/kube-auth-proxy-8d68d4884-swz9s"
Jul 09 15:03:00.428950 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:00.428926    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-wlr8v"]
Jul 09 15:03:00.432100 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:00.432086    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-wlr8v"
Jul 09 15:03:00.435428 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:00.435410    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-gxqkj\""
Jul 09 15:03:00.436120 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:00.436098    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 09 15:03:00.446853 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:00.446830    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-wlr8v"]
Jul 09 15:03:00.492492 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:00.492467    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:03:00.516202 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:00.516177    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/904241fe-9e22-47b8-beca-a9df45ab3f25-tmp\") pod \"kube-auth-proxy-8d68d4884-swz9s\" (UID: \"904241fe-9e22-47b8-beca-a9df45ab3f25\") " pod="openshift-ingress/kube-auth-proxy-8d68d4884-swz9s"
Jul 09 15:03:00.516335 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:00.516236    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/904241fe-9e22-47b8-beca-a9df45ab3f25-tls-certs\") pod \"kube-auth-proxy-8d68d4884-swz9s\" (UID: \"904241fe-9e22-47b8-beca-a9df45ab3f25\") " pod="openshift-ingress/kube-auth-proxy-8d68d4884-swz9s"
Jul 09 15:03:00.516335 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:00.516268    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/135669fd-b0a8-4f26-933a-55c836e8b908-cert\") pod \"odh-model-controller-7998c67dc4-wlr8v\" (UID: \"135669fd-b0a8-4f26-933a-55c836e8b908\") " pod="opendatahub/odh-model-controller-7998c67dc4-wlr8v"
Jul 09 15:03:00.516335 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:00.516303    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fvm9\" (UniqueName: \"kubernetes.io/projected/135669fd-b0a8-4f26-933a-55c836e8b908-kube-api-access-6fvm9\") pod \"odh-model-controller-7998c67dc4-wlr8v\" (UID: \"135669fd-b0a8-4f26-933a-55c836e8b908\") " pod="opendatahub/odh-model-controller-7998c67dc4-wlr8v"
Jul 09 15:03:00.516496 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:00.516347    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2tmc\" (UniqueName: \"kubernetes.io/projected/904241fe-9e22-47b8-beca-a9df45ab3f25-kube-api-access-q2tmc\") pod \"kube-auth-proxy-8d68d4884-swz9s\" (UID: \"904241fe-9e22-47b8-beca-a9df45ab3f25\") " pod="openshift-ingress/kube-auth-proxy-8d68d4884-swz9s"
Jul 09 15:03:00.518834 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:00.518809    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/904241fe-9e22-47b8-beca-a9df45ab3f25-tls-certs\") pod \"kube-auth-proxy-8d68d4884-swz9s\" (UID: \"904241fe-9e22-47b8-beca-a9df45ab3f25\") " pod="openshift-ingress/kube-auth-proxy-8d68d4884-swz9s"
Jul 09 15:03:00.518920 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:00.518810    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/904241fe-9e22-47b8-beca-a9df45ab3f25-tmp\") pod \"kube-auth-proxy-8d68d4884-swz9s\" (UID: \"904241fe-9e22-47b8-beca-a9df45ab3f25\") " pod="openshift-ingress/kube-auth-proxy-8d68d4884-swz9s"
Jul 09 15:03:00.534374 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:00.534350    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2tmc\" (UniqueName: \"kubernetes.io/projected/904241fe-9e22-47b8-beca-a9df45ab3f25-kube-api-access-q2tmc\") pod \"kube-auth-proxy-8d68d4884-swz9s\" (UID: \"904241fe-9e22-47b8-beca-a9df45ab3f25\") " pod="openshift-ingress/kube-auth-proxy-8d68d4884-swz9s"
Jul 09 15:03:00.610524 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:00.610479    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:03:00.617382 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:00.617361    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/135669fd-b0a8-4f26-933a-55c836e8b908-cert\") pod \"odh-model-controller-7998c67dc4-wlr8v\" (UID: \"135669fd-b0a8-4f26-933a-55c836e8b908\") " pod="opendatahub/odh-model-controller-7998c67dc4-wlr8v"
Jul 09 15:03:00.617486 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:00.617396    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fvm9\" (UniqueName: \"kubernetes.io/projected/135669fd-b0a8-4f26-933a-55c836e8b908-kube-api-access-6fvm9\") pod \"odh-model-controller-7998c67dc4-wlr8v\" (UID: \"135669fd-b0a8-4f26-933a-55c836e8b908\") " pod="opendatahub/odh-model-controller-7998c67dc4-wlr8v"
Jul 09 15:03:00.617536 ip-10-0-137-94 kubenswrapper[2575]: E0709 15:03:00.617518    2575 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 09 15:03:00.617609 ip-10-0-137-94 kubenswrapper[2575]: E0709 15:03:00.617597    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/135669fd-b0a8-4f26-933a-55c836e8b908-cert podName:135669fd-b0a8-4f26-933a-55c836e8b908 nodeName:}" failed. No retries permitted until 2026-07-09 15:03:01.117579492 +0000 UTC m=+488.960112425 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/135669fd-b0a8-4f26-933a-55c836e8b908-cert") pod "odh-model-controller-7998c67dc4-wlr8v" (UID: "135669fd-b0a8-4f26-933a-55c836e8b908") : secret "odh-model-controller-webhook-cert" not found
Jul 09 15:03:00.627005 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:00.626985    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-8d68d4884-swz9s"
Jul 09 15:03:00.631791 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:00.631768    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fvm9\" (UniqueName: \"kubernetes.io/projected/135669fd-b0a8-4f26-933a-55c836e8b908-kube-api-access-6fvm9\") pod \"odh-model-controller-7998c67dc4-wlr8v\" (UID: \"135669fd-b0a8-4f26-933a-55c836e8b908\") " pod="opendatahub/odh-model-controller-7998c67dc4-wlr8v"
Jul 09 15:03:00.801883 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:00.801851    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-8d68d4884-swz9s"]
Jul 09 15:03:00.805224 ip-10-0-137-94 kubenswrapper[2575]: W0709 15:03:00.805197    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod904241fe_9e22_47b8_beca_a9df45ab3f25.slice/crio-bd17fd28a6269c69df2bfc5bdcae8b63792cc038c30bf4a9b1b68b8f421573a4 WatchSource:0}: Error finding container bd17fd28a6269c69df2bfc5bdcae8b63792cc038c30bf4a9b1b68b8f421573a4: Status 404 returned error can't find the container with id bd17fd28a6269c69df2bfc5bdcae8b63792cc038c30bf4a9b1b68b8f421573a4
Jul 09 15:03:00.970779 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:00.970663    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-8d68d4884-swz9s" event={"ID":"904241fe-9e22-47b8-beca-a9df45ab3f25","Type":"ContainerStarted","Data":"bd17fd28a6269c69df2bfc5bdcae8b63792cc038c30bf4a9b1b68b8f421573a4"}
Jul 09 15:03:00.971162 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:00.971140    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:03:01.120602 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:01.120555    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/135669fd-b0a8-4f26-933a-55c836e8b908-cert\") pod \"odh-model-controller-7998c67dc4-wlr8v\" (UID: \"135669fd-b0a8-4f26-933a-55c836e8b908\") " pod="opendatahub/odh-model-controller-7998c67dc4-wlr8v"
Jul 09 15:03:01.122935 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:01.122917    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/135669fd-b0a8-4f26-933a-55c836e8b908-cert\") pod \"odh-model-controller-7998c67dc4-wlr8v\" (UID: \"135669fd-b0a8-4f26-933a-55c836e8b908\") " pod="opendatahub/odh-model-controller-7998c67dc4-wlr8v"
Jul 09 15:03:01.134574 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:01.134540    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:03:01.341612 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:01.341523    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-wlr8v"
Jul 09 15:03:01.473776 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:01.473750    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-wlr8v"]
Jul 09 15:03:01.475936 ip-10-0-137-94 kubenswrapper[2575]: W0709 15:03:01.475908    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod135669fd_b0a8_4f26_933a_55c836e8b908.slice/crio-f3b83839bd5d18fbea46876a859ae7ad933b7449b1c3c53dd3a403be8c881dc9 WatchSource:0}: Error finding container f3b83839bd5d18fbea46876a859ae7ad933b7449b1c3c53dd3a403be8c881dc9: Status 404 returned error can't find the container with id f3b83839bd5d18fbea46876a859ae7ad933b7449b1c3c53dd3a403be8c881dc9
Jul 09 15:03:01.749838 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:01.749805    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:03:01.754028 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:01.753996    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-jbt8f"]
Jul 09 15:03:01.758363 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:01.758346    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-jbt8f"
Jul 09 15:03:01.761584 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:01.761554    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 09 15:03:01.761849 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:01.761832    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-vglc4\""
Jul 09 15:03:01.771284 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:01.771262    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-jbt8f"]
Jul 09 15:03:01.826635 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:01.826601    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkkl8\" (UniqueName: \"kubernetes.io/projected/c3a4351a-85e6-4fe2-aa97-6ff251a1f928-kube-api-access-lkkl8\") pod \"model-serving-api-54d89bd5fc-jbt8f\" (UID: \"c3a4351a-85e6-4fe2-aa97-6ff251a1f928\") " pod="opendatahub/model-serving-api-54d89bd5fc-jbt8f"
Jul 09 15:03:01.827043 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:01.826654    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c3a4351a-85e6-4fe2-aa97-6ff251a1f928-tls-certs\") pod \"model-serving-api-54d89bd5fc-jbt8f\" (UID: \"c3a4351a-85e6-4fe2-aa97-6ff251a1f928\") " pod="opendatahub/model-serving-api-54d89bd5fc-jbt8f"
Jul 09 15:03:01.863363 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:01.863335    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:03:01.927691 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:01.927662    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c3a4351a-85e6-4fe2-aa97-6ff251a1f928-tls-certs\") pod \"model-serving-api-54d89bd5fc-jbt8f\" (UID: \"c3a4351a-85e6-4fe2-aa97-6ff251a1f928\") " pod="opendatahub/model-serving-api-54d89bd5fc-jbt8f"
Jul 09 15:03:01.927848 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:01.927721    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkkl8\" (UniqueName: \"kubernetes.io/projected/c3a4351a-85e6-4fe2-aa97-6ff251a1f928-kube-api-access-lkkl8\") pod \"model-serving-api-54d89bd5fc-jbt8f\" (UID: \"c3a4351a-85e6-4fe2-aa97-6ff251a1f928\") " pod="opendatahub/model-serving-api-54d89bd5fc-jbt8f"
Jul 09 15:03:01.930146 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:01.930125    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c3a4351a-85e6-4fe2-aa97-6ff251a1f928-tls-certs\") pod \"model-serving-api-54d89bd5fc-jbt8f\" (UID: \"c3a4351a-85e6-4fe2-aa97-6ff251a1f928\") " pod="opendatahub/model-serving-api-54d89bd5fc-jbt8f"
Jul 09 15:03:01.945218 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:01.945197    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkkl8\" (UniqueName: \"kubernetes.io/projected/c3a4351a-85e6-4fe2-aa97-6ff251a1f928-kube-api-access-lkkl8\") pod \"model-serving-api-54d89bd5fc-jbt8f\" (UID: \"c3a4351a-85e6-4fe2-aa97-6ff251a1f928\") " pod="opendatahub/model-serving-api-54d89bd5fc-jbt8f"
Jul 09 15:03:01.975455 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:01.975428    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-wlr8v" event={"ID":"135669fd-b0a8-4f26-933a-55c836e8b908","Type":"ContainerStarted","Data":"f3b83839bd5d18fbea46876a859ae7ad933b7449b1c3c53dd3a403be8c881dc9"}
Jul 09 15:03:02.067730 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:02.067649    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-jbt8f"
Jul 09 15:03:02.125252 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:02.125221    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-4n67c"]
Jul 09 15:03:02.129000 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:02.128978    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4n67c"
Jul 09 15:03:02.132002 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:02.131973    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 09 15:03:02.132137 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:02.131998    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 09 15:03:02.132137 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:02.132059    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 09 15:03:02.132137 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:02.132088    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-dgt28\""
Jul 09 15:03:02.132336 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:02.132322    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 09 15:03:02.134685 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:02.134637    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:03:02.144790 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:02.144771    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-4n67c"]
Jul 09 15:03:02.208545 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:02.208393    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-jbt8f"]
Jul 09 15:03:02.211181 ip-10-0-137-94 kubenswrapper[2575]: W0709 15:03:02.211152    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3a4351a_85e6_4fe2_aa97_6ff251a1f928.slice/crio-344204f75b70fc3d378312bfd69adb8b0f0264763e7d89c041e59d6695ce3a2f WatchSource:0}: Error finding container 344204f75b70fc3d378312bfd69adb8b0f0264763e7d89c041e59d6695ce3a2f: Status 404 returned error can't find the container with id 344204f75b70fc3d378312bfd69adb8b0f0264763e7d89c041e59d6695ce3a2f
Jul 09 15:03:02.229788 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:02.229761    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e4143cc-a2c4-49c6-bc47-6da82d521556-istio-token\") pod \"istiod-openshift-gateway-7574459656-4n67c\" (UID: \"9e4143cc-a2c4-49c6-bc47-6da82d521556\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4n67c"
Jul 09 15:03:02.229901 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:02.229795    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9e4143cc-a2c4-49c6-bc47-6da82d521556-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-4n67c\" (UID: \"9e4143cc-a2c4-49c6-bc47-6da82d521556\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4n67c"
Jul 09 15:03:02.229901 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:02.229828    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9e4143cc-a2c4-49c6-bc47-6da82d521556-cacerts\") pod \"istiod-openshift-gateway-7574459656-4n67c\" (UID: \"9e4143cc-a2c4-49c6-bc47-6da82d521556\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4n67c"
Jul 09 15:03:02.229901 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:02.229858    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9e4143cc-a2c4-49c6-bc47-6da82d521556-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-4n67c\" (UID: \"9e4143cc-a2c4-49c6-bc47-6da82d521556\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4n67c"
Jul 09 15:03:02.230040 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:02.229934    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9e4143cc-a2c4-49c6-bc47-6da82d521556-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-4n67c\" (UID: \"9e4143cc-a2c4-49c6-bc47-6da82d521556\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4n67c"
Jul 09 15:03:02.230040 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:02.229975    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkbj4\" (UniqueName: \"kubernetes.io/projected/9e4143cc-a2c4-49c6-bc47-6da82d521556-kube-api-access-zkbj4\") pod \"istiod-openshift-gateway-7574459656-4n67c\" (UID: \"9e4143cc-a2c4-49c6-bc47-6da82d521556\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4n67c"
Jul 09 15:03:02.230040 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:02.230036    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e4143cc-a2c4-49c6-bc47-6da82d521556-local-certs\") pod \"istiod-openshift-gateway-7574459656-4n67c\" (UID: \"9e4143cc-a2c4-49c6-bc47-6da82d521556\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4n67c"
Jul 09 15:03:02.250252 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:02.250219    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:03:02.331217 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:02.331128    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e4143cc-a2c4-49c6-bc47-6da82d521556-istio-token\") pod \"istiod-openshift-gateway-7574459656-4n67c\" (UID: \"9e4143cc-a2c4-49c6-bc47-6da82d521556\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4n67c"
Jul 09 15:03:02.331217 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:02.331172    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9e4143cc-a2c4-49c6-bc47-6da82d521556-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-4n67c\" (UID: \"9e4143cc-a2c4-49c6-bc47-6da82d521556\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4n67c"
Jul 09 15:03:02.331217 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:02.331195    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9e4143cc-a2c4-49c6-bc47-6da82d521556-cacerts\") pod \"istiod-openshift-gateway-7574459656-4n67c\" (UID: \"9e4143cc-a2c4-49c6-bc47-6da82d521556\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4n67c"
Jul 09 15:03:02.331485 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:02.331315    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9e4143cc-a2c4-49c6-bc47-6da82d521556-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-4n67c\" (UID: \"9e4143cc-a2c4-49c6-bc47-6da82d521556\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4n67c"
Jul 09 15:03:02.331485 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:02.331382    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9e4143cc-a2c4-49c6-bc47-6da82d521556-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-4n67c\" (UID: \"9e4143cc-a2c4-49c6-bc47-6da82d521556\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4n67c"
Jul 09 15:03:02.331485 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:02.331470    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkbj4\" (UniqueName: \"kubernetes.io/projected/9e4143cc-a2c4-49c6-bc47-6da82d521556-kube-api-access-zkbj4\") pod \"istiod-openshift-gateway-7574459656-4n67c\" (UID: \"9e4143cc-a2c4-49c6-bc47-6da82d521556\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4n67c"
Jul 09 15:03:02.331641 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:02.331510    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e4143cc-a2c4-49c6-bc47-6da82d521556-local-certs\") pod \"istiod-openshift-gateway-7574459656-4n67c\" (UID: \"9e4143cc-a2c4-49c6-bc47-6da82d521556\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4n67c"
Jul 09 15:03:02.332052 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:02.332027    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9e4143cc-a2c4-49c6-bc47-6da82d521556-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-4n67c\" (UID: \"9e4143cc-a2c4-49c6-bc47-6da82d521556\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4n67c"
Jul 09 15:03:02.333630 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:02.333603    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9e4143cc-a2c4-49c6-bc47-6da82d521556-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-4n67c\" (UID: \"9e4143cc-a2c4-49c6-bc47-6da82d521556\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4n67c"
Jul 09 15:03:02.333630 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:02.333619    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9e4143cc-a2c4-49c6-bc47-6da82d521556-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-4n67c\" (UID: \"9e4143cc-a2c4-49c6-bc47-6da82d521556\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4n67c"
Jul 09 15:03:02.333789 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:02.333615    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e4143cc-a2c4-49c6-bc47-6da82d521556-local-certs\") pod \"istiod-openshift-gateway-7574459656-4n67c\" (UID: \"9e4143cc-a2c4-49c6-bc47-6da82d521556\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4n67c"
Jul 09 15:03:02.333789 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:02.333662    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9e4143cc-a2c4-49c6-bc47-6da82d521556-cacerts\") pod \"istiod-openshift-gateway-7574459656-4n67c\" (UID: \"9e4143cc-a2c4-49c6-bc47-6da82d521556\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4n67c"
Jul 09 15:03:02.340292 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:02.340270    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e4143cc-a2c4-49c6-bc47-6da82d521556-istio-token\") pod \"istiod-openshift-gateway-7574459656-4n67c\" (UID: \"9e4143cc-a2c4-49c6-bc47-6da82d521556\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4n67c"
Jul 09 15:03:02.340702 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:02.340685    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkbj4\" (UniqueName: \"kubernetes.io/projected/9e4143cc-a2c4-49c6-bc47-6da82d521556-kube-api-access-zkbj4\") pod \"istiod-openshift-gateway-7574459656-4n67c\" (UID: \"9e4143cc-a2c4-49c6-bc47-6da82d521556\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4n67c"
Jul 09 15:03:02.439496 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:02.439458    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4n67c"
Jul 09 15:03:02.599102 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:02.599074    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-4n67c"]
Jul 09 15:03:02.601468 ip-10-0-137-94 kubenswrapper[2575]: W0709 15:03:02.601439    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e4143cc_a2c4_49c6_bc47_6da82d521556.slice/crio-7530ba71564b15da1622b149da3db278d4832cf7c0303ab752c0c026ded83fd8 WatchSource:0}: Error finding container 7530ba71564b15da1622b149da3db278d4832cf7c0303ab752c0c026ded83fd8: Status 404 returned error can't find the container with id 7530ba71564b15da1622b149da3db278d4832cf7c0303ab752c0c026ded83fd8
Jul 09 15:03:02.982549 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:02.982497    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-jbt8f" event={"ID":"c3a4351a-85e6-4fe2-aa97-6ff251a1f928","Type":"ContainerStarted","Data":"344204f75b70fc3d378312bfd69adb8b0f0264763e7d89c041e59d6695ce3a2f"}
Jul 09 15:03:02.983904 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:02.983871    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4n67c" event={"ID":"9e4143cc-a2c4-49c6-bc47-6da82d521556","Type":"ContainerStarted","Data":"7530ba71564b15da1622b149da3db278d4832cf7c0303ab752c0c026ded83fd8"}
Jul 09 15:03:03.801599 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:03.801529    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:03:06.001520 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:06.001475    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-8d68d4884-swz9s" event={"ID":"904241fe-9e22-47b8-beca-a9df45ab3f25","Type":"ContainerStarted","Data":"49e09da6f65bd9242dee6435d039153406a7ffc3c1f38a67cb2c08d92f793604"}
Jul 09 15:03:06.003269 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:06.003241    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-wlr8v" event={"ID":"135669fd-b0a8-4f26-933a-55c836e8b908","Type":"ContainerStarted","Data":"0263bc1f99775c8e9d40dc3bceeb79d114006c3fb8a66e63840649a8cf130201"}
Jul 09 15:03:06.003403 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:06.003384    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-wlr8v"
Jul 09 15:03:06.020594 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:06.020525    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-8d68d4884-swz9s" podStartSLOduration=1.557684428 podStartE2EDuration="6.020506369s" totalImagesPullingTime="4.462821941s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:03:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:03:06.02018433 +0000 UTC m=+493.862717289" watchObservedRunningTime="2026-07-09 15:03:06.020506369 +0000 UTC m=+493.863039302"
Jul 09 15:03:06.037939 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:06.037891    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-wlr8v" podStartSLOduration=2.243480206 podStartE2EDuration="6.037876798s" totalImagesPullingTime="3.794396592s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:03:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:03:06.036614442 +0000 UTC m=+493.879147373" watchObservedRunningTime="2026-07-09 15:03:06.037876798 +0000 UTC m=+493.880409729"
Jul 09 15:03:06.959252 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:06.959221    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 15:03:06.959334 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:06.959282    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 15:03:07.008300 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:07.008258    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-jbt8f" event={"ID":"c3a4351a-85e6-4fe2-aa97-6ff251a1f928","Type":"ContainerStarted","Data":"2603f20e19ef7827e49950e3a4ff08ab9ee9948da30729da93e6af356d2a13c6"}
Jul 09 15:03:07.008656 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:07.008588    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-jbt8f"
Jul 09 15:03:07.033295 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:07.033246    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-jbt8f" podStartSLOduration=1.340873266 podStartE2EDuration="6.033228153s" totalImagesPullingTime="4.692354887s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:03:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:03:07.031813491 +0000 UTC m=+494.874346424" watchObservedRunningTime="2026-07-09 15:03:07.033228153 +0000 UTC m=+494.875761086"
Jul 09 15:03:07.666018 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:07.665980    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:03:07.786623 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:07.786588    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:03:08.014913 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:08.014827    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4n67c" event={"ID":"9e4143cc-a2c4-49c6-bc47-6da82d521556","Type":"ContainerStarted","Data":"28b28b40a5f22f40c00a4af53a16909001c67affc13dd800ee332c8a75958e94"}
Jul 09 15:03:08.015308 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:08.015065    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4n67c"
Jul 09 15:03:08.016520 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:08.016494    2575 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-4n67c container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 09 15:03:08.016617 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:08.016544    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4n67c" podUID="9e4143cc-a2c4-49c6-bc47-6da82d521556" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 09 15:03:08.054908 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:08.054856    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4n67c" podStartSLOduration=1.700139098 podStartE2EDuration="6.054842811s" totalImagesPullingTime="4.354703713s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:03:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:03:08.053100368 +0000 UTC m=+495.895633335" watchObservedRunningTime="2026-07-09 15:03:08.054842811 +0000 UTC m=+495.897375743"
Jul 09 15:03:08.595653 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:08.595626    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rt9wg"]
Jul 09 15:03:08.598917 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:08.598893    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rt9wg"
Jul 09 15:03:08.601680 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:08.601661    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-xdm6w\""
Jul 09 15:03:08.625249 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:08.625224    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rt9wg"]
Jul 09 15:03:08.684181 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:08.684149    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/522dc3ee-01e2-4682-96bc-76c238b9baf2-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4rt9wg\" (UID: \"522dc3ee-01e2-4682-96bc-76c238b9baf2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rt9wg"
Jul 09 15:03:08.684342 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:08.684199    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/522dc3ee-01e2-4682-96bc-76c238b9baf2-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4rt9wg\" (UID: \"522dc3ee-01e2-4682-96bc-76c238b9baf2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rt9wg"
Jul 09 15:03:08.684342 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:08.684216    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/522dc3ee-01e2-4682-96bc-76c238b9baf2-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4rt9wg\" (UID: \"522dc3ee-01e2-4682-96bc-76c238b9baf2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rt9wg"
Jul 09 15:03:08.684342 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:08.684306    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/522dc3ee-01e2-4682-96bc-76c238b9baf2-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4rt9wg\" (UID: \"522dc3ee-01e2-4682-96bc-76c238b9baf2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rt9wg"
Jul 09 15:03:08.684488 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:08.684360    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/522dc3ee-01e2-4682-96bc-76c238b9baf2-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4rt9wg\" (UID: \"522dc3ee-01e2-4682-96bc-76c238b9baf2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rt9wg"
Jul 09 15:03:08.684488 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:08.684436    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdpl8\" (UniqueName: \"kubernetes.io/projected/522dc3ee-01e2-4682-96bc-76c238b9baf2-kube-api-access-xdpl8\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4rt9wg\" (UID: \"522dc3ee-01e2-4682-96bc-76c238b9baf2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rt9wg"
Jul 09 15:03:08.684585 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:08.684479    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/522dc3ee-01e2-4682-96bc-76c238b9baf2-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4rt9wg\" (UID: \"522dc3ee-01e2-4682-96bc-76c238b9baf2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rt9wg"
Jul 09 15:03:08.684585 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:08.684524    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/522dc3ee-01e2-4682-96bc-76c238b9baf2-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4rt9wg\" (UID: \"522dc3ee-01e2-4682-96bc-76c238b9baf2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rt9wg"
Jul 09 15:03:08.684585 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:08.684559    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/522dc3ee-01e2-4682-96bc-76c238b9baf2-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4rt9wg\" (UID: \"522dc3ee-01e2-4682-96bc-76c238b9baf2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rt9wg"
Jul 09 15:03:08.785676 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:08.785641    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/522dc3ee-01e2-4682-96bc-76c238b9baf2-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4rt9wg\" (UID: \"522dc3ee-01e2-4682-96bc-76c238b9baf2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rt9wg"
Jul 09 15:03:08.785676 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:08.785677    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/522dc3ee-01e2-4682-96bc-76c238b9baf2-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4rt9wg\" (UID: \"522dc3ee-01e2-4682-96bc-76c238b9baf2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rt9wg"
Jul 09 15:03:08.785922 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:08.785699    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/522dc3ee-01e2-4682-96bc-76c238b9baf2-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4rt9wg\" (UID: \"522dc3ee-01e2-4682-96bc-76c238b9baf2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rt9wg"
Jul 09 15:03:08.785922 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:08.785899    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/522dc3ee-01e2-4682-96bc-76c238b9baf2-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4rt9wg\" (UID: \"522dc3ee-01e2-4682-96bc-76c238b9baf2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rt9wg"
Jul 09 15:03:08.786036 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:08.785962    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdpl8\" (UniqueName: \"kubernetes.io/projected/522dc3ee-01e2-4682-96bc-76c238b9baf2-kube-api-access-xdpl8\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4rt9wg\" (UID: \"522dc3ee-01e2-4682-96bc-76c238b9baf2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rt9wg"
Jul 09 15:03:08.786036 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:08.786001    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/522dc3ee-01e2-4682-96bc-76c238b9baf2-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4rt9wg\" (UID: \"522dc3ee-01e2-4682-96bc-76c238b9baf2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rt9wg"
Jul 09 15:03:08.786135 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:08.786037    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/522dc3ee-01e2-4682-96bc-76c238b9baf2-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4rt9wg\" (UID: \"522dc3ee-01e2-4682-96bc-76c238b9baf2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rt9wg"
Jul 09 15:03:08.786135 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:08.786064    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/522dc3ee-01e2-4682-96bc-76c238b9baf2-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4rt9wg\" (UID: \"522dc3ee-01e2-4682-96bc-76c238b9baf2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rt9wg"
Jul 09 15:03:08.786135 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:08.786066    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/522dc3ee-01e2-4682-96bc-76c238b9baf2-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4rt9wg\" (UID: \"522dc3ee-01e2-4682-96bc-76c238b9baf2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rt9wg"
Jul 09 15:03:08.786135 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:08.786102    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/522dc3ee-01e2-4682-96bc-76c238b9baf2-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4rt9wg\" (UID: \"522dc3ee-01e2-4682-96bc-76c238b9baf2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rt9wg"
Jul 09 15:03:08.786312 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:08.786210    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/522dc3ee-01e2-4682-96bc-76c238b9baf2-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4rt9wg\" (UID: \"522dc3ee-01e2-4682-96bc-76c238b9baf2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rt9wg"
Jul 09 15:03:08.786312 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:08.786218    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/522dc3ee-01e2-4682-96bc-76c238b9baf2-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4rt9wg\" (UID: \"522dc3ee-01e2-4682-96bc-76c238b9baf2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rt9wg"
Jul 09 15:03:08.786534 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:08.786514    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/522dc3ee-01e2-4682-96bc-76c238b9baf2-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4rt9wg\" (UID: \"522dc3ee-01e2-4682-96bc-76c238b9baf2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rt9wg"
Jul 09 15:03:08.786690 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:08.786664    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/522dc3ee-01e2-4682-96bc-76c238b9baf2-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4rt9wg\" (UID: \"522dc3ee-01e2-4682-96bc-76c238b9baf2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rt9wg"
Jul 09 15:03:08.788264 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:08.788238    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/522dc3ee-01e2-4682-96bc-76c238b9baf2-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4rt9wg\" (UID: \"522dc3ee-01e2-4682-96bc-76c238b9baf2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rt9wg"
Jul 09 15:03:08.788357 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:08.788317    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/522dc3ee-01e2-4682-96bc-76c238b9baf2-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4rt9wg\" (UID: \"522dc3ee-01e2-4682-96bc-76c238b9baf2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rt9wg"
Jul 09 15:03:08.806584 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:08.806553    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/522dc3ee-01e2-4682-96bc-76c238b9baf2-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4rt9wg\" (UID: \"522dc3ee-01e2-4682-96bc-76c238b9baf2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rt9wg"
Jul 09 15:03:08.808071 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:08.808050    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdpl8\" (UniqueName: \"kubernetes.io/projected/522dc3ee-01e2-4682-96bc-76c238b9baf2-kube-api-access-xdpl8\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4rt9wg\" (UID: \"522dc3ee-01e2-4682-96bc-76c238b9baf2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rt9wg"
Jul 09 15:03:08.908383 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:08.908353    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rt9wg"
Jul 09 15:03:09.019788 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:09.019759    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4n67c"
Jul 09 15:03:09.064146 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:09.064125    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rt9wg"]
Jul 09 15:03:09.065510 ip-10-0-137-94 kubenswrapper[2575]: W0709 15:03:09.065479    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod522dc3ee_01e2_4682_96bc_76c238b9baf2.slice/crio-9025b3ef0186840464423b68f04d802d89e08a3b5dc6dc14443378e90b4cf13f WatchSource:0}: Error finding container 9025b3ef0186840464423b68f04d802d89e08a3b5dc6dc14443378e90b4cf13f: Status 404 returned error can't find the container with id 9025b3ef0186840464423b68f04d802d89e08a3b5dc6dc14443378e90b4cf13f
Jul 09 15:03:09.133057 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:09.133025    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:03:09.251429 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:09.251346    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:03:10.026470 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:10.026427    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rt9wg" event={"ID":"522dc3ee-01e2-4682-96bc-76c238b9baf2","Type":"ContainerStarted","Data":"9025b3ef0186840464423b68f04d802d89e08a3b5dc6dc14443378e90b4cf13f"}
Jul 09 15:03:11.592988 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:11.592952    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 15:03:11.593219 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:11.593024    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 15:03:11.593219 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:11.593052    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 15:03:11.696525 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:11.696488    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:03:11.806255 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:11.806212    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:03:11.917478 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:11.917446    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-ktspl"]
Jul 09 15:03:11.920805 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:11.920780    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ktspl"
Jul 09 15:03:11.927701 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:11.927621    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 09 15:03:11.927944 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:11.927925    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-wbvwp\""
Jul 09 15:03:11.934427 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:11.934402    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:03:11.937951 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:11.937927    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-fq2gh"]
Jul 09 15:03:11.940971 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:11.940955    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-ktspl"]
Jul 09 15:03:11.941044 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:11.941032    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fq2gh"
Jul 09 15:03:11.951417 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:11.951394    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 09 15:03:11.959374 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:11.959352    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-48xcx\""
Jul 09 15:03:11.971566 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:11.971543    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-fq2gh"]
Jul 09 15:03:12.017266 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:12.017234    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bb5cf238-a44c-4502-b95f-6316351b7d19-cert\") pod \"kserve-controller-manager-d6f4b65b8-ktspl\" (UID: \"bb5cf238-a44c-4502-b95f-6316351b7d19\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ktspl"
Jul 09 15:03:12.017428 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:12.017299    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nl8l9\" (UniqueName: \"kubernetes.io/projected/851c3baa-0ea1-4651-b761-912e0f48701f-kube-api-access-nl8l9\") pod \"llmisvc-controller-manager-777c6bd7d5-fq2gh\" (UID: \"851c3baa-0ea1-4651-b761-912e0f48701f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fq2gh"
Jul 09 15:03:12.017428 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:12.017339    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/851c3baa-0ea1-4651-b761-912e0f48701f-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-fq2gh\" (UID: \"851c3baa-0ea1-4651-b761-912e0f48701f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fq2gh"
Jul 09 15:03:12.017428 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:12.017361    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-646ff\" (UniqueName: \"kubernetes.io/projected/bb5cf238-a44c-4502-b95f-6316351b7d19-kube-api-access-646ff\") pod \"kserve-controller-manager-d6f4b65b8-ktspl\" (UID: \"bb5cf238-a44c-4502-b95f-6316351b7d19\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ktspl"
Jul 09 15:03:12.037032 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:12.036994    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rt9wg" event={"ID":"522dc3ee-01e2-4682-96bc-76c238b9baf2","Type":"ContainerStarted","Data":"0fd92ef074aaf1cd737e521687da598f49f280b0e6023ed27f7b78d25f57f8ac"}
Jul 09 15:03:12.087623 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:12.087573    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rt9wg" podStartSLOduration=1.562477447 podStartE2EDuration="4.087558742s" totalImagesPullingTime="2.525081295s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:03:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:03:12.076797752 +0000 UTC m=+499.919330684" watchObservedRunningTime="2026-07-09 15:03:12.087558742 +0000 UTC m=+499.930091674"
Jul 09 15:03:12.118626 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:12.118592    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bb5cf238-a44c-4502-b95f-6316351b7d19-cert\") pod \"kserve-controller-manager-d6f4b65b8-ktspl\" (UID: \"bb5cf238-a44c-4502-b95f-6316351b7d19\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ktspl"
Jul 09 15:03:12.118792 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:12.118768    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nl8l9\" (UniqueName: \"kubernetes.io/projected/851c3baa-0ea1-4651-b761-912e0f48701f-kube-api-access-nl8l9\") pod \"llmisvc-controller-manager-777c6bd7d5-fq2gh\" (UID: \"851c3baa-0ea1-4651-b761-912e0f48701f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fq2gh"
Jul 09 15:03:12.118792 ip-10-0-137-94 kubenswrapper[2575]: E0709 15:03:12.118775    2575 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 09 15:03:12.118881 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:12.118802    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/851c3baa-0ea1-4651-b761-912e0f48701f-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-fq2gh\" (UID: \"851c3baa-0ea1-4651-b761-912e0f48701f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fq2gh"
Jul 09 15:03:12.118881 ip-10-0-137-94 kubenswrapper[2575]: E0709 15:03:12.118839    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb5cf238-a44c-4502-b95f-6316351b7d19-cert podName:bb5cf238-a44c-4502-b95f-6316351b7d19 nodeName:}" failed. No retries permitted until 2026-07-09 15:03:12.61881938 +0000 UTC m=+500.461352293 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/bb5cf238-a44c-4502-b95f-6316351b7d19-cert") pod "kserve-controller-manager-d6f4b65b8-ktspl" (UID: "bb5cf238-a44c-4502-b95f-6316351b7d19") : secret "kserve-webhook-server-cert" not found
Jul 09 15:03:12.118881 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:12.118863    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-646ff\" (UniqueName: \"kubernetes.io/projected/bb5cf238-a44c-4502-b95f-6316351b7d19-kube-api-access-646ff\") pod \"kserve-controller-manager-d6f4b65b8-ktspl\" (UID: \"bb5cf238-a44c-4502-b95f-6316351b7d19\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ktspl"
Jul 09 15:03:12.119029 ip-10-0-137-94 kubenswrapper[2575]: E0709 15:03:12.118887    2575 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 09 15:03:12.119029 ip-10-0-137-94 kubenswrapper[2575]: E0709 15:03:12.118937    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/851c3baa-0ea1-4651-b761-912e0f48701f-cert podName:851c3baa-0ea1-4651-b761-912e0f48701f nodeName:}" failed. No retries permitted until 2026-07-09 15:03:12.618919491 +0000 UTC m=+500.461452408 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/851c3baa-0ea1-4651-b761-912e0f48701f-cert") pod "llmisvc-controller-manager-777c6bd7d5-fq2gh" (UID: "851c3baa-0ea1-4651-b761-912e0f48701f") : secret "llmisvc-webhook-server-cert" not found
Jul 09 15:03:12.134218 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:12.134185    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nl8l9\" (UniqueName: \"kubernetes.io/projected/851c3baa-0ea1-4651-b761-912e0f48701f-kube-api-access-nl8l9\") pod \"llmisvc-controller-manager-777c6bd7d5-fq2gh\" (UID: \"851c3baa-0ea1-4651-b761-912e0f48701f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fq2gh"
Jul 09 15:03:12.135079 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:12.135058    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-646ff\" (UniqueName: \"kubernetes.io/projected/bb5cf238-a44c-4502-b95f-6316351b7d19-kube-api-access-646ff\") pod \"kserve-controller-manager-d6f4b65b8-ktspl\" (UID: \"bb5cf238-a44c-4502-b95f-6316351b7d19\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ktspl"
Jul 09 15:03:12.293430 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:12.293344    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:03:12.378641 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:12.378611    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:03:12.623109 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:12.623030    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/851c3baa-0ea1-4651-b761-912e0f48701f-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-fq2gh\" (UID: \"851c3baa-0ea1-4651-b761-912e0f48701f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fq2gh"
Jul 09 15:03:12.623109 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:12.623078    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bb5cf238-a44c-4502-b95f-6316351b7d19-cert\") pod \"kserve-controller-manager-d6f4b65b8-ktspl\" (UID: \"bb5cf238-a44c-4502-b95f-6316351b7d19\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ktspl"
Jul 09 15:03:12.625504 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:12.625479    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/851c3baa-0ea1-4651-b761-912e0f48701f-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-fq2gh\" (UID: \"851c3baa-0ea1-4651-b761-912e0f48701f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fq2gh"
Jul 09 15:03:12.625582 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:12.625479    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bb5cf238-a44c-4502-b95f-6316351b7d19-cert\") pod \"kserve-controller-manager-d6f4b65b8-ktspl\" (UID: \"bb5cf238-a44c-4502-b95f-6316351b7d19\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ktspl"
Jul 09 15:03:12.831760 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:12.831722    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ktspl"
Jul 09 15:03:12.850683 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:12.850651    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fq2gh"
Jul 09 15:03:12.909194 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:12.909166    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rt9wg"
Jul 09 15:03:12.915318 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:12.915092    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rt9wg"
Jul 09 15:03:12.973299 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:12.973260    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-ktspl"]
Jul 09 15:03:12.976512 ip-10-0-137-94 kubenswrapper[2575]: W0709 15:03:12.976485    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb5cf238_a44c_4502_b95f_6316351b7d19.slice/crio-252c4e663732f01b8e38b86d992524b733668567978ef434e3d6a44074304ae1 WatchSource:0}: Error finding container 252c4e663732f01b8e38b86d992524b733668567978ef434e3d6a44074304ae1: Status 404 returned error can't find the container with id 252c4e663732f01b8e38b86d992524b733668567978ef434e3d6a44074304ae1
Jul 09 15:03:12.996292 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:12.996267    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-fq2gh"]
Jul 09 15:03:13.000132 ip-10-0-137-94 kubenswrapper[2575]: W0709 15:03:13.000106    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod851c3baa_0ea1_4651_b761_912e0f48701f.slice/crio-2d2e5d117e50a76107295e13417b38db50a0c0dee4eb9b11867c57917fbf2d82 WatchSource:0}: Error finding container 2d2e5d117e50a76107295e13417b38db50a0c0dee4eb9b11867c57917fbf2d82: Status 404 returned error can't find the container with id 2d2e5d117e50a76107295e13417b38db50a0c0dee4eb9b11867c57917fbf2d82
Jul 09 15:03:13.042173 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:13.042132    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ktspl" event={"ID":"bb5cf238-a44c-4502-b95f-6316351b7d19","Type":"ContainerStarted","Data":"252c4e663732f01b8e38b86d992524b733668567978ef434e3d6a44074304ae1"}
Jul 09 15:03:13.043249 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:13.043225    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fq2gh" event={"ID":"851c3baa-0ea1-4651-b761-912e0f48701f","Type":"ContainerStarted","Data":"2d2e5d117e50a76107295e13417b38db50a0c0dee4eb9b11867c57917fbf2d82"}
Jul 09 15:03:13.043497 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:13.043485    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rt9wg"
Jul 09 15:03:13.044331 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:13.044313    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rt9wg"
Jul 09 15:03:13.280882 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:13.280847    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-4n67c"]
Jul 09 15:03:13.281068 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:13.281029    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4n67c" podUID="9e4143cc-a2c4-49c6-bc47-6da82d521556" containerName="discovery" containerID="cri-o://28b28b40a5f22f40c00a4af53a16909001c67affc13dd800ee332c8a75958e94" gracePeriod=30
Jul 09 15:03:13.517868 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:13.517844    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4n67c"
Jul 09 15:03:13.638196 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:13.638168    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zkbj4\" (UniqueName: \"kubernetes.io/projected/9e4143cc-a2c4-49c6-bc47-6da82d521556-kube-api-access-zkbj4\") pod \"9e4143cc-a2c4-49c6-bc47-6da82d521556\" (UID: \"9e4143cc-a2c4-49c6-bc47-6da82d521556\") "
Jul 09 15:03:13.638547 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:13.638229    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e4143cc-a2c4-49c6-bc47-6da82d521556-istio-token\") pod \"9e4143cc-a2c4-49c6-bc47-6da82d521556\" (UID: \"9e4143cc-a2c4-49c6-bc47-6da82d521556\") "
Jul 09 15:03:13.638547 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:13.638263    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9e4143cc-a2c4-49c6-bc47-6da82d521556-cacerts\") pod \"9e4143cc-a2c4-49c6-bc47-6da82d521556\" (UID: \"9e4143cc-a2c4-49c6-bc47-6da82d521556\") "
Jul 09 15:03:13.638547 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:13.638372    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9e4143cc-a2c4-49c6-bc47-6da82d521556-istio-kubeconfig\") pod \"9e4143cc-a2c4-49c6-bc47-6da82d521556\" (UID: \"9e4143cc-a2c4-49c6-bc47-6da82d521556\") "
Jul 09 15:03:13.638547 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:13.638433    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e4143cc-a2c4-49c6-bc47-6da82d521556-local-certs\") pod \"9e4143cc-a2c4-49c6-bc47-6da82d521556\" (UID: \"9e4143cc-a2c4-49c6-bc47-6da82d521556\") "
Jul 09 15:03:13.638547 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:13.638471    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9e4143cc-a2c4-49c6-bc47-6da82d521556-istio-csr-dns-cert\") pod \"9e4143cc-a2c4-49c6-bc47-6da82d521556\" (UID: \"9e4143cc-a2c4-49c6-bc47-6da82d521556\") "
Jul 09 15:03:13.638547 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:13.638498    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9e4143cc-a2c4-49c6-bc47-6da82d521556-istio-csr-ca-configmap\") pod \"9e4143cc-a2c4-49c6-bc47-6da82d521556\" (UID: \"9e4143cc-a2c4-49c6-bc47-6da82d521556\") "
Jul 09 15:03:13.639146 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:13.639092    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e4143cc-a2c4-49c6-bc47-6da82d521556-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "9e4143cc-a2c4-49c6-bc47-6da82d521556" (UID: "9e4143cc-a2c4-49c6-bc47-6da82d521556"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 15:03:13.640691 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:13.640653    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e4143cc-a2c4-49c6-bc47-6da82d521556-local-certs" (OuterVolumeSpecName: "local-certs") pod "9e4143cc-a2c4-49c6-bc47-6da82d521556" (UID: "9e4143cc-a2c4-49c6-bc47-6da82d521556"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:03:13.640824 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:13.640802    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e4143cc-a2c4-49c6-bc47-6da82d521556-cacerts" (OuterVolumeSpecName: "cacerts") pod "9e4143cc-a2c4-49c6-bc47-6da82d521556" (UID: "9e4143cc-a2c4-49c6-bc47-6da82d521556"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 15:03:13.640890 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:13.640852    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e4143cc-a2c4-49c6-bc47-6da82d521556-kube-api-access-zkbj4" (OuterVolumeSpecName: "kube-api-access-zkbj4") pod "9e4143cc-a2c4-49c6-bc47-6da82d521556" (UID: "9e4143cc-a2c4-49c6-bc47-6da82d521556"). InnerVolumeSpecName "kube-api-access-zkbj4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:03:13.640935 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:13.640908    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e4143cc-a2c4-49c6-bc47-6da82d521556-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "9e4143cc-a2c4-49c6-bc47-6da82d521556" (UID: "9e4143cc-a2c4-49c6-bc47-6da82d521556"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 15:03:13.640986 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:13.640927    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e4143cc-a2c4-49c6-bc47-6da82d521556-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "9e4143cc-a2c4-49c6-bc47-6da82d521556" (UID: "9e4143cc-a2c4-49c6-bc47-6da82d521556"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 15:03:13.641034 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:13.641000    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e4143cc-a2c4-49c6-bc47-6da82d521556-istio-token" (OuterVolumeSpecName: "istio-token") pod "9e4143cc-a2c4-49c6-bc47-6da82d521556" (UID: "9e4143cc-a2c4-49c6-bc47-6da82d521556"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:03:13.739884 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:13.739850    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zkbj4\" (UniqueName: \"kubernetes.io/projected/9e4143cc-a2c4-49c6-bc47-6da82d521556-kube-api-access-zkbj4\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:03:13.739884 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:13.739880    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e4143cc-a2c4-49c6-bc47-6da82d521556-istio-token\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:03:13.739884 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:13.739893    2575 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9e4143cc-a2c4-49c6-bc47-6da82d521556-cacerts\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:03:13.740085 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:13.739901    2575 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9e4143cc-a2c4-49c6-bc47-6da82d521556-istio-kubeconfig\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:03:13.740085 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:13.739910    2575 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e4143cc-a2c4-49c6-bc47-6da82d521556-local-certs\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:03:13.740085 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:13.739917    2575 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9e4143cc-a2c4-49c6-bc47-6da82d521556-istio-csr-dns-cert\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:03:13.740085 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:13.739924    2575 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9e4143cc-a2c4-49c6-bc47-6da82d521556-istio-csr-ca-configmap\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:03:13.920923 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:13.920829    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:03:14.031744 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:14.031687    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:03:14.049014 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:14.048980    2575 generic.go:356] "Generic (PLEG): container finished" podID="9e4143cc-a2c4-49c6-bc47-6da82d521556" containerID="28b28b40a5f22f40c00a4af53a16909001c67affc13dd800ee332c8a75958e94" exitCode=0
Jul 09 15:03:14.049163 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:14.049044    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4n67c" event={"ID":"9e4143cc-a2c4-49c6-bc47-6da82d521556","Type":"ContainerDied","Data":"28b28b40a5f22f40c00a4af53a16909001c67affc13dd800ee332c8a75958e94"}
Jul 09 15:03:14.049163 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:14.049084    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4n67c"
Jul 09 15:03:14.049163 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:14.049106    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4n67c" event={"ID":"9e4143cc-a2c4-49c6-bc47-6da82d521556","Type":"ContainerDied","Data":"7530ba71564b15da1622b149da3db278d4832cf7c0303ab752c0c026ded83fd8"}
Jul 09 15:03:14.049163 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:14.049137    2575 scope.go:117] "RemoveContainer" containerID="28b28b40a5f22f40c00a4af53a16909001c67affc13dd800ee332c8a75958e94"
Jul 09 15:03:14.058685 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:14.058646    2575 scope.go:117] "RemoveContainer" containerID="28b28b40a5f22f40c00a4af53a16909001c67affc13dd800ee332c8a75958e94"
Jul 09 15:03:14.059053 ip-10-0-137-94 kubenswrapper[2575]: E0709 15:03:14.059016    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28b28b40a5f22f40c00a4af53a16909001c67affc13dd800ee332c8a75958e94\": container with ID starting with 28b28b40a5f22f40c00a4af53a16909001c67affc13dd800ee332c8a75958e94 not found: ID does not exist" containerID="28b28b40a5f22f40c00a4af53a16909001c67affc13dd800ee332c8a75958e94"
Jul 09 15:03:14.059103 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:14.059048    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28b28b40a5f22f40c00a4af53a16909001c67affc13dd800ee332c8a75958e94"} err="failed to get container status \"28b28b40a5f22f40c00a4af53a16909001c67affc13dd800ee332c8a75958e94\": rpc error: code = NotFound desc = could not find container \"28b28b40a5f22f40c00a4af53a16909001c67affc13dd800ee332c8a75958e94\": container with ID starting with 28b28b40a5f22f40c00a4af53a16909001c67affc13dd800ee332c8a75958e94 not found: ID does not exist"
Jul 09 15:03:14.076474 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:14.076447    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-4n67c"]
Jul 09 15:03:14.079987 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:14.079937    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-4n67c"]
Jul 09 15:03:14.128858 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:14.128820    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:03:15.319457 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:15.319387    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e4143cc-a2c4-49c6-bc47-6da82d521556" path="/var/lib/kubelet/pods/9e4143cc-a2c4-49c6-bc47-6da82d521556/volumes"
Jul 09 15:03:17.011543 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:17.011513    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-wlr8v"
Jul 09 15:03:18.069404 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:18.069366    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ktspl" event={"ID":"bb5cf238-a44c-4502-b95f-6316351b7d19","Type":"ContainerStarted","Data":"1d0c9b90871d7d829d8191a023ffe8e59792ed03cb71561f14c3a8ea035346ac"}
Jul 09 15:03:18.069848 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:18.069515    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ktspl"
Jul 09 15:03:18.070930 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:18.070904    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fq2gh" event={"ID":"851c3baa-0ea1-4651-b761-912e0f48701f","Type":"ContainerStarted","Data":"862644610ea9b833979756a4e0bf399d043f3a7103bca5e3892230880b55365d"}
Jul 09 15:03:18.071043 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:18.070951    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fq2gh"
Jul 09 15:03:18.097694 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:18.097653    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ktspl" podStartSLOduration=2.977681952 podStartE2EDuration="7.097640516s" totalImagesPullingTime="4.119958564s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:03:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:03:18.095852317 +0000 UTC m=+505.938385250" watchObservedRunningTime="2026-07-09 15:03:18.097640516 +0000 UTC m=+505.940173446"
Jul 09 15:03:18.123397 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:18.123355    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fq2gh" podStartSLOduration=3.078957389 podStartE2EDuration="7.1233419s" totalImagesPullingTime="4.044384511s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:03:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:03:18.119455343 +0000 UTC m=+505.961988294" watchObservedRunningTime="2026-07-09 15:03:18.1233419 +0000 UTC m=+505.965874831"
Jul 09 15:03:19.022984 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:19.022956    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-jbt8f"
Jul 09 15:03:49.078694 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:49.078608    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fq2gh"
Jul 09 15:03:49.082060 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:03:49.082040    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ktspl"
Jul 09 15:04:01.075119 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:01.075078    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:04:01.174478 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:01.174426    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:04:01.238969 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:01.238933    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dpwwl"]
Jul 09 15:04:01.239207 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:01.239196    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e4143cc-a2c4-49c6-bc47-6da82d521556" containerName="discovery"
Jul 09 15:04:01.239251 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:01.239209    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e4143cc-a2c4-49c6-bc47-6da82d521556" containerName="discovery"
Jul 09 15:04:01.239295 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:01.239270    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e4143cc-a2c4-49c6-bc47-6da82d521556" containerName="discovery"
Jul 09 15:04:01.244774 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:01.244751    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dpwwl"
Jul 09 15:04:01.247734 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:01.247689    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 09 15:04:01.248673 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:01.248653    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 09 15:04:01.248673 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:01.248663    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-lh55r\""
Jul 09 15:04:01.256817 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:01.256788    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dpwwl"]
Jul 09 15:04:01.290819 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:01.290790    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7g6r\" (UniqueName: \"kubernetes.io/projected/a0804823-1b97-487a-beb3-dee34e0b3d25-kube-api-access-d7g6r\") pod \"kuadrant-operator-catalog-dpwwl\" (UID: \"a0804823-1b97-487a-beb3-dee34e0b3d25\") " pod="kuadrant-system/kuadrant-operator-catalog-dpwwl"
Jul 09 15:04:01.298626 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:01.298595    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:04:01.391662 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:01.391634    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7g6r\" (UniqueName: \"kubernetes.io/projected/a0804823-1b97-487a-beb3-dee34e0b3d25-kube-api-access-d7g6r\") pod \"kuadrant-operator-catalog-dpwwl\" (UID: \"a0804823-1b97-487a-beb3-dee34e0b3d25\") " pod="kuadrant-system/kuadrant-operator-catalog-dpwwl"
Jul 09 15:04:01.400763 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:01.400736    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7g6r\" (UniqueName: \"kubernetes.io/projected/a0804823-1b97-487a-beb3-dee34e0b3d25-kube-api-access-d7g6r\") pod \"kuadrant-operator-catalog-dpwwl\" (UID: \"a0804823-1b97-487a-beb3-dee34e0b3d25\") " pod="kuadrant-system/kuadrant-operator-catalog-dpwwl"
Jul 09 15:04:01.555161 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:01.555105    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dpwwl"
Jul 09 15:04:01.558309 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:01.558289    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dpwwl"]
Jul 09 15:04:01.682267 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:01.682198    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dpwwl"]
Jul 09 15:04:01.685276 ip-10-0-137-94 kubenswrapper[2575]: W0709 15:04:01.685245    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0804823_1b97_487a_beb3_dee34e0b3d25.slice/crio-0720793d7d1cc563bd57ed54fa4538e0aaf439c65800806fee68023c6e60ad61 WatchSource:0}: Error finding container 0720793d7d1cc563bd57ed54fa4538e0aaf439c65800806fee68023c6e60ad61: Status 404 returned error can't find the container with id 0720793d7d1cc563bd57ed54fa4538e0aaf439c65800806fee68023c6e60ad61
Jul 09 15:04:01.772337 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:01.772310    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7qq6f"]
Jul 09 15:04:01.776191 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:01.776173    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7qq6f"
Jul 09 15:04:01.786823 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:01.786801    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7qq6f"]
Jul 09 15:04:01.896170 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:01.896136    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vr9m\" (UniqueName: \"kubernetes.io/projected/a1842963-9cb6-4418-9c2a-5b90a9fdb703-kube-api-access-2vr9m\") pod \"kuadrant-operator-catalog-7qq6f\" (UID: \"a1842963-9cb6-4418-9c2a-5b90a9fdb703\") " pod="kuadrant-system/kuadrant-operator-catalog-7qq6f"
Jul 09 15:04:01.997596 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:01.997523    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vr9m\" (UniqueName: \"kubernetes.io/projected/a1842963-9cb6-4418-9c2a-5b90a9fdb703-kube-api-access-2vr9m\") pod \"kuadrant-operator-catalog-7qq6f\" (UID: \"a1842963-9cb6-4418-9c2a-5b90a9fdb703\") " pod="kuadrant-system/kuadrant-operator-catalog-7qq6f"
Jul 09 15:04:02.006954 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:02.006924    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vr9m\" (UniqueName: \"kubernetes.io/projected/a1842963-9cb6-4418-9c2a-5b90a9fdb703-kube-api-access-2vr9m\") pod \"kuadrant-operator-catalog-7qq6f\" (UID: \"a1842963-9cb6-4418-9c2a-5b90a9fdb703\") " pod="kuadrant-system/kuadrant-operator-catalog-7qq6f"
Jul 09 15:04:02.085908 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:02.085872    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7qq6f"
Jul 09 15:04:02.215126 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:02.215098    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7qq6f"]
Jul 09 15:04:02.217434 ip-10-0-137-94 kubenswrapper[2575]: W0709 15:04:02.217401    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1842963_9cb6_4418_9c2a_5b90a9fdb703.slice/crio-ac7fd3c6a39757fec5c0664a97698dd1686d65ae5dc0126099daf1442c10b1e1 WatchSource:0}: Error finding container ac7fd3c6a39757fec5c0664a97698dd1686d65ae5dc0126099daf1442c10b1e1: Status 404 returned error can't find the container with id ac7fd3c6a39757fec5c0664a97698dd1686d65ae5dc0126099daf1442c10b1e1
Jul 09 15:04:02.251504 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:02.251441    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7qq6f" event={"ID":"a1842963-9cb6-4418-9c2a-5b90a9fdb703","Type":"ContainerStarted","Data":"ac7fd3c6a39757fec5c0664a97698dd1686d65ae5dc0126099daf1442c10b1e1"}
Jul 09 15:04:02.252579 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:02.252557    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dpwwl" event={"ID":"a0804823-1b97-487a-beb3-dee34e0b3d25","Type":"ContainerStarted","Data":"0720793d7d1cc563bd57ed54fa4538e0aaf439c65800806fee68023c6e60ad61"}
Jul 09 15:04:05.274071 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:05.273973    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7qq6f" event={"ID":"a1842963-9cb6-4418-9c2a-5b90a9fdb703","Type":"ContainerStarted","Data":"e207300ef41a767a69bb63cd489e6d9c1ecaac618176162dba40d0946854b5b5"}
Jul 09 15:04:05.275474 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:05.275448    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dpwwl" event={"ID":"a0804823-1b97-487a-beb3-dee34e0b3d25","Type":"ContainerStarted","Data":"575cdb6622c1cfad31a3f9d0e1171527a590d9c014e611159b9ee2d8745e06ce"}
Jul 09 15:04:05.275577 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:05.275491    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-dpwwl" podUID="a0804823-1b97-487a-beb3-dee34e0b3d25" containerName="registry-server" containerID="cri-o://575cdb6622c1cfad31a3f9d0e1171527a590d9c014e611159b9ee2d8745e06ce" gracePeriod=2
Jul 09 15:04:05.294800 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:05.294759    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-7qq6f" podStartSLOduration=1.5117205889999998 podStartE2EDuration="4.294743996s" totalImagesPullingTime="2.783023407s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:04:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:04:05.294074504 +0000 UTC m=+553.136607436" watchObservedRunningTime="2026-07-09 15:04:05.294743996 +0000 UTC m=+553.137276927"
Jul 09 15:04:05.313327 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:05.313280    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-dpwwl" podStartSLOduration=1.561847129 podStartE2EDuration="4.313262975s" totalImagesPullingTime="2.751415846s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:04:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:04:05.312840122 +0000 UTC m=+553.155373054" watchObservedRunningTime="2026-07-09 15:04:05.313262975 +0000 UTC m=+553.155795919"
Jul 09 15:04:05.516823 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:05.516799    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dpwwl"
Jul 09 15:04:05.628070 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:05.627986    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d7g6r\" (UniqueName: \"kubernetes.io/projected/a0804823-1b97-487a-beb3-dee34e0b3d25-kube-api-access-d7g6r\") pod \"a0804823-1b97-487a-beb3-dee34e0b3d25\" (UID: \"a0804823-1b97-487a-beb3-dee34e0b3d25\") "
Jul 09 15:04:05.630094 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:05.630072    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0804823-1b97-487a-beb3-dee34e0b3d25-kube-api-access-d7g6r" (OuterVolumeSpecName: "kube-api-access-d7g6r") pod "a0804823-1b97-487a-beb3-dee34e0b3d25" (UID: "a0804823-1b97-487a-beb3-dee34e0b3d25"). InnerVolumeSpecName "kube-api-access-d7g6r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:04:05.728551 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:05.728520    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d7g6r\" (UniqueName: \"kubernetes.io/projected/a0804823-1b97-487a-beb3-dee34e0b3d25-kube-api-access-d7g6r\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:04:06.280431 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:06.280397    2575 generic.go:356] "Generic (PLEG): container finished" podID="a0804823-1b97-487a-beb3-dee34e0b3d25" containerID="575cdb6622c1cfad31a3f9d0e1171527a590d9c014e611159b9ee2d8745e06ce" exitCode=0
Jul 09 15:04:06.280854 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:06.280438    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dpwwl"
Jul 09 15:04:06.280854 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:06.280485    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dpwwl" event={"ID":"a0804823-1b97-487a-beb3-dee34e0b3d25","Type":"ContainerDied","Data":"575cdb6622c1cfad31a3f9d0e1171527a590d9c014e611159b9ee2d8745e06ce"}
Jul 09 15:04:06.280854 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:06.280534    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dpwwl" event={"ID":"a0804823-1b97-487a-beb3-dee34e0b3d25","Type":"ContainerDied","Data":"0720793d7d1cc563bd57ed54fa4538e0aaf439c65800806fee68023c6e60ad61"}
Jul 09 15:04:06.280854 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:06.280558    2575 scope.go:117] "RemoveContainer" containerID="575cdb6622c1cfad31a3f9d0e1171527a590d9c014e611159b9ee2d8745e06ce"
Jul 09 15:04:06.289159 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:06.289142    2575 scope.go:117] "RemoveContainer" containerID="575cdb6622c1cfad31a3f9d0e1171527a590d9c014e611159b9ee2d8745e06ce"
Jul 09 15:04:06.289402 ip-10-0-137-94 kubenswrapper[2575]: E0709 15:04:06.289384    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"575cdb6622c1cfad31a3f9d0e1171527a590d9c014e611159b9ee2d8745e06ce\": container with ID starting with 575cdb6622c1cfad31a3f9d0e1171527a590d9c014e611159b9ee2d8745e06ce not found: ID does not exist" containerID="575cdb6622c1cfad31a3f9d0e1171527a590d9c014e611159b9ee2d8745e06ce"
Jul 09 15:04:06.289467 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:06.289410    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"575cdb6622c1cfad31a3f9d0e1171527a590d9c014e611159b9ee2d8745e06ce"} err="failed to get container status \"575cdb6622c1cfad31a3f9d0e1171527a590d9c014e611159b9ee2d8745e06ce\": rpc error: code = NotFound desc = could not find container \"575cdb6622c1cfad31a3f9d0e1171527a590d9c014e611159b9ee2d8745e06ce\": container with ID starting with 575cdb6622c1cfad31a3f9d0e1171527a590d9c014e611159b9ee2d8745e06ce not found: ID does not exist"
Jul 09 15:04:06.303721 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:06.303691    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dpwwl"]
Jul 09 15:04:06.309563 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:06.309541    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dpwwl"]
Jul 09 15:04:07.315724 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:07.315680    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0804823-1b97-487a-beb3-dee34e0b3d25" path="/var/lib/kubelet/pods/a0804823-1b97-487a-beb3-dee34e0b3d25/volumes"
Jul 09 15:04:12.086125 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:12.086089    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-7qq6f"
Jul 09 15:04:12.086500 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:12.086171    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-7qq6f"
Jul 09 15:04:12.108246 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:12.108220    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-7qq6f"
Jul 09 15:04:12.326574 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:12.326543    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-7qq6f"
Jul 09 15:04:16.789745 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:16.789690    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18q6l5"]
Jul 09 15:04:16.790141 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:16.790023    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0804823-1b97-487a-beb3-dee34e0b3d25" containerName="registry-server"
Jul 09 15:04:16.790141 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:16.790035    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0804823-1b97-487a-beb3-dee34e0b3d25" containerName="registry-server"
Jul 09 15:04:16.790141 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:16.790082    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0804823-1b97-487a-beb3-dee34e0b3d25" containerName="registry-server"
Jul 09 15:04:16.793176 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:16.793159    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18q6l5"
Jul 09 15:04:16.796228 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:16.796202    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-rm8lj\""
Jul 09 15:04:16.802382 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:16.802362    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18q6l5"]
Jul 09 15:04:16.921800 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:16.921756    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/48dc0bae-8282-44ea-922b-c6787596276f-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18q6l5\" (UID: \"48dc0bae-8282-44ea-922b-c6787596276f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18q6l5"
Jul 09 15:04:16.921800 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:16.921803    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/48dc0bae-8282-44ea-922b-c6787596276f-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18q6l5\" (UID: \"48dc0bae-8282-44ea-922b-c6787596276f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18q6l5"
Jul 09 15:04:16.922031 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:16.921869    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjwh2\" (UniqueName: \"kubernetes.io/projected/48dc0bae-8282-44ea-922b-c6787596276f-kube-api-access-vjwh2\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18q6l5\" (UID: \"48dc0bae-8282-44ea-922b-c6787596276f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18q6l5"
Jul 09 15:04:17.022370 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:17.022336    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjwh2\" (UniqueName: \"kubernetes.io/projected/48dc0bae-8282-44ea-922b-c6787596276f-kube-api-access-vjwh2\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18q6l5\" (UID: \"48dc0bae-8282-44ea-922b-c6787596276f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18q6l5"
Jul 09 15:04:17.022554 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:17.022430    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/48dc0bae-8282-44ea-922b-c6787596276f-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18q6l5\" (UID: \"48dc0bae-8282-44ea-922b-c6787596276f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18q6l5"
Jul 09 15:04:17.022554 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:17.022453    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/48dc0bae-8282-44ea-922b-c6787596276f-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18q6l5\" (UID: \"48dc0bae-8282-44ea-922b-c6787596276f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18q6l5"
Jul 09 15:04:17.022892 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:17.022869    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/48dc0bae-8282-44ea-922b-c6787596276f-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18q6l5\" (UID: \"48dc0bae-8282-44ea-922b-c6787596276f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18q6l5"
Jul 09 15:04:17.022892 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:17.022883    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/48dc0bae-8282-44ea-922b-c6787596276f-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18q6l5\" (UID: \"48dc0bae-8282-44ea-922b-c6787596276f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18q6l5"
Jul 09 15:04:17.032636 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:17.032615    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjwh2\" (UniqueName: \"kubernetes.io/projected/48dc0bae-8282-44ea-922b-c6787596276f-kube-api-access-vjwh2\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18q6l5\" (UID: \"48dc0bae-8282-44ea-922b-c6787596276f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18q6l5"
Jul 09 15:04:17.102084 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:17.102001    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18q6l5"
Jul 09 15:04:17.239748 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:17.239723    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18q6l5"]
Jul 09 15:04:17.242333 ip-10-0-137-94 kubenswrapper[2575]: W0709 15:04:17.242304    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48dc0bae_8282_44ea_922b_c6787596276f.slice/crio-1bc237b8c0ee2b6a3526cc1159abf4fe701c65e70aba72e5ca4ea1728150a68c WatchSource:0}: Error finding container 1bc237b8c0ee2b6a3526cc1159abf4fe701c65e70aba72e5ca4ea1728150a68c: Status 404 returned error can't find the container with id 1bc237b8c0ee2b6a3526cc1159abf4fe701c65e70aba72e5ca4ea1728150a68c
Jul 09 15:04:17.331225 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:17.331185    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18q6l5" event={"ID":"48dc0bae-8282-44ea-922b-c6787596276f","Type":"ContainerStarted","Data":"039f65a4310930b03f5bf7d5684fdd4abf25856fa809d8be38328362f6a7c947"}
Jul 09 15:04:17.331380 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:17.331241    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18q6l5" event={"ID":"48dc0bae-8282-44ea-922b-c6787596276f","Type":"ContainerStarted","Data":"1bc237b8c0ee2b6a3526cc1159abf4fe701c65e70aba72e5ca4ea1728150a68c"}
Jul 09 15:04:17.386972 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:17.386939    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q58vh"]
Jul 09 15:04:17.390237 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:17.390215    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q58vh"
Jul 09 15:04:17.400764 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:17.400741    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q58vh"]
Jul 09 15:04:17.526340 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:17.526299    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wc744\" (UniqueName: \"kubernetes.io/projected/a0d02497-a76a-43b2-9af2-7e87a75ee1ee-kube-api-access-wc744\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q58vh\" (UID: \"a0d02497-a76a-43b2-9af2-7e87a75ee1ee\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q58vh"
Jul 09 15:04:17.526541 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:17.526350    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a0d02497-a76a-43b2-9af2-7e87a75ee1ee-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q58vh\" (UID: \"a0d02497-a76a-43b2-9af2-7e87a75ee1ee\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q58vh"
Jul 09 15:04:17.526541 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:17.526425    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a0d02497-a76a-43b2-9af2-7e87a75ee1ee-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q58vh\" (UID: \"a0d02497-a76a-43b2-9af2-7e87a75ee1ee\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q58vh"
Jul 09 15:04:17.627772 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:17.627724    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wc744\" (UniqueName: \"kubernetes.io/projected/a0d02497-a76a-43b2-9af2-7e87a75ee1ee-kube-api-access-wc744\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q58vh\" (UID: \"a0d02497-a76a-43b2-9af2-7e87a75ee1ee\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q58vh"
Jul 09 15:04:17.627917 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:17.627792    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a0d02497-a76a-43b2-9af2-7e87a75ee1ee-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q58vh\" (UID: \"a0d02497-a76a-43b2-9af2-7e87a75ee1ee\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q58vh"
Jul 09 15:04:17.627917 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:17.627826    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a0d02497-a76a-43b2-9af2-7e87a75ee1ee-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q58vh\" (UID: \"a0d02497-a76a-43b2-9af2-7e87a75ee1ee\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q58vh"
Jul 09 15:04:17.628184 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:17.628164    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a0d02497-a76a-43b2-9af2-7e87a75ee1ee-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q58vh\" (UID: \"a0d02497-a76a-43b2-9af2-7e87a75ee1ee\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q58vh"
Jul 09 15:04:17.628250 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:17.628194    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a0d02497-a76a-43b2-9af2-7e87a75ee1ee-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q58vh\" (UID: \"a0d02497-a76a-43b2-9af2-7e87a75ee1ee\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q58vh"
Jul 09 15:04:17.637763 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:17.637687    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wc744\" (UniqueName: \"kubernetes.io/projected/a0d02497-a76a-43b2-9af2-7e87a75ee1ee-kube-api-access-wc744\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q58vh\" (UID: \"a0d02497-a76a-43b2-9af2-7e87a75ee1ee\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q58vh"
Jul 09 15:04:17.698692 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:17.698656    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q58vh"
Jul 09 15:04:17.788296 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:17.788263    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7b2l"]
Jul 09 15:04:17.794494 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:17.794469    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7b2l"
Jul 09 15:04:17.803624 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:17.803599    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7b2l"]
Jul 09 15:04:17.831133 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:17.831105    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q58vh"]
Jul 09 15:04:17.833922 ip-10-0-137-94 kubenswrapper[2575]: W0709 15:04:17.833897    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0d02497_a76a_43b2_9af2_7e87a75ee1ee.slice/crio-a572c9e0979ea5901fb95ab2dab5164efe637711f712d4d8f956a47a331fe9c8 WatchSource:0}: Error finding container a572c9e0979ea5901fb95ab2dab5164efe637711f712d4d8f956a47a331fe9c8: Status 404 returned error can't find the container with id a572c9e0979ea5901fb95ab2dab5164efe637711f712d4d8f956a47a331fe9c8
Jul 09 15:04:17.930297 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:17.930257    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4f0471e1-7ff7-4795-b974-0072dfb7739b-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7b2l\" (UID: \"4f0471e1-7ff7-4795-b974-0072dfb7739b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7b2l"
Jul 09 15:04:17.930426 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:17.930308    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gp6gb\" (UniqueName: \"kubernetes.io/projected/4f0471e1-7ff7-4795-b974-0072dfb7739b-kube-api-access-gp6gb\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7b2l\" (UID: \"4f0471e1-7ff7-4795-b974-0072dfb7739b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7b2l"
Jul 09 15:04:17.930426 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:17.930375    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4f0471e1-7ff7-4795-b974-0072dfb7739b-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7b2l\" (UID: \"4f0471e1-7ff7-4795-b974-0072dfb7739b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7b2l"
Jul 09 15:04:18.031406 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:18.031370    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4f0471e1-7ff7-4795-b974-0072dfb7739b-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7b2l\" (UID: \"4f0471e1-7ff7-4795-b974-0072dfb7739b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7b2l"
Jul 09 15:04:18.031556 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:18.031431    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4f0471e1-7ff7-4795-b974-0072dfb7739b-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7b2l\" (UID: \"4f0471e1-7ff7-4795-b974-0072dfb7739b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7b2l"
Jul 09 15:04:18.031556 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:18.031454    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gp6gb\" (UniqueName: \"kubernetes.io/projected/4f0471e1-7ff7-4795-b974-0072dfb7739b-kube-api-access-gp6gb\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7b2l\" (UID: \"4f0471e1-7ff7-4795-b974-0072dfb7739b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7b2l"
Jul 09 15:04:18.031754 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:18.031735    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4f0471e1-7ff7-4795-b974-0072dfb7739b-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7b2l\" (UID: \"4f0471e1-7ff7-4795-b974-0072dfb7739b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7b2l"
Jul 09 15:04:18.031801 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:18.031759    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4f0471e1-7ff7-4795-b974-0072dfb7739b-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7b2l\" (UID: \"4f0471e1-7ff7-4795-b974-0072dfb7739b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7b2l"
Jul 09 15:04:18.040488 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:18.040469    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gp6gb\" (UniqueName: \"kubernetes.io/projected/4f0471e1-7ff7-4795-b974-0072dfb7739b-kube-api-access-gp6gb\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7b2l\" (UID: \"4f0471e1-7ff7-4795-b974-0072dfb7739b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7b2l"
Jul 09 15:04:18.105563 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:18.105531    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7b2l"
Jul 09 15:04:18.180399 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:18.180325    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h2q26"]
Jul 09 15:04:18.185043 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:18.185012    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h2q26"
Jul 09 15:04:18.197044 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:18.197014    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h2q26"]
Jul 09 15:04:18.249000 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:18.243812    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7b2l"]
Jul 09 15:04:18.332834 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:18.332799    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/746a4a31-0b68-47e3-bc87-e16dd3edea5a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h2q26\" (UID: \"746a4a31-0b68-47e3-bc87-e16dd3edea5a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h2q26"
Jul 09 15:04:18.332946 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:18.332847    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbd8n\" (UniqueName: \"kubernetes.io/projected/746a4a31-0b68-47e3-bc87-e16dd3edea5a-kube-api-access-kbd8n\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h2q26\" (UID: \"746a4a31-0b68-47e3-bc87-e16dd3edea5a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h2q26"
Jul 09 15:04:18.332946 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:18.332884    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/746a4a31-0b68-47e3-bc87-e16dd3edea5a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h2q26\" (UID: \"746a4a31-0b68-47e3-bc87-e16dd3edea5a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h2q26"
Jul 09 15:04:18.338583 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:18.338550    2575 generic.go:356] "Generic (PLEG): container finished" podID="48dc0bae-8282-44ea-922b-c6787596276f" containerID="039f65a4310930b03f5bf7d5684fdd4abf25856fa809d8be38328362f6a7c947" exitCode=0
Jul 09 15:04:18.338693 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:18.338646    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18q6l5" event={"ID":"48dc0bae-8282-44ea-922b-c6787596276f","Type":"ContainerDied","Data":"039f65a4310930b03f5bf7d5684fdd4abf25856fa809d8be38328362f6a7c947"}
Jul 09 15:04:18.340268 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:18.340241    2575 generic.go:356] "Generic (PLEG): container finished" podID="a0d02497-a76a-43b2-9af2-7e87a75ee1ee" containerID="e49b0d47947fe064fba55809b57e1e299b45783c1852fc9ebf70f42101a3ad84" exitCode=0
Jul 09 15:04:18.340397 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:18.340324    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q58vh" event={"ID":"a0d02497-a76a-43b2-9af2-7e87a75ee1ee","Type":"ContainerDied","Data":"e49b0d47947fe064fba55809b57e1e299b45783c1852fc9ebf70f42101a3ad84"}
Jul 09 15:04:18.340397 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:18.340384    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q58vh" event={"ID":"a0d02497-a76a-43b2-9af2-7e87a75ee1ee","Type":"ContainerStarted","Data":"a572c9e0979ea5901fb95ab2dab5164efe637711f712d4d8f956a47a331fe9c8"}
Jul 09 15:04:18.342066 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:18.342043    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7b2l" event={"ID":"4f0471e1-7ff7-4795-b974-0072dfb7739b","Type":"ContainerStarted","Data":"d5deb0327d5f474b5434ea038df43bb98c4bb7b616fc523ea2e0299709fba6e8"}
Jul 09 15:04:18.342168 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:18.342101    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7b2l" event={"ID":"4f0471e1-7ff7-4795-b974-0072dfb7739b","Type":"ContainerStarted","Data":"97060352d61a656231f1041a03d87aa3746c5a3e286f3edd3722038211eb62ee"}
Jul 09 15:04:18.433870 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:18.433780    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/746a4a31-0b68-47e3-bc87-e16dd3edea5a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h2q26\" (UID: \"746a4a31-0b68-47e3-bc87-e16dd3edea5a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h2q26"
Jul 09 15:04:18.433870 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:18.433835    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbd8n\" (UniqueName: \"kubernetes.io/projected/746a4a31-0b68-47e3-bc87-e16dd3edea5a-kube-api-access-kbd8n\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h2q26\" (UID: \"746a4a31-0b68-47e3-bc87-e16dd3edea5a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h2q26"
Jul 09 15:04:18.433870 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:18.433867    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/746a4a31-0b68-47e3-bc87-e16dd3edea5a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h2q26\" (UID: \"746a4a31-0b68-47e3-bc87-e16dd3edea5a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h2q26"
Jul 09 15:04:18.434292 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:18.434184    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/746a4a31-0b68-47e3-bc87-e16dd3edea5a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h2q26\" (UID: \"746a4a31-0b68-47e3-bc87-e16dd3edea5a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h2q26"
Jul 09 15:04:18.434292 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:18.434208    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/746a4a31-0b68-47e3-bc87-e16dd3edea5a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h2q26\" (UID: \"746a4a31-0b68-47e3-bc87-e16dd3edea5a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h2q26"
Jul 09 15:04:18.442852 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:18.442824    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbd8n\" (UniqueName: \"kubernetes.io/projected/746a4a31-0b68-47e3-bc87-e16dd3edea5a-kube-api-access-kbd8n\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h2q26\" (UID: \"746a4a31-0b68-47e3-bc87-e16dd3edea5a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h2q26"
Jul 09 15:04:18.496806 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:18.496779    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h2q26"
Jul 09 15:04:18.626126 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:18.626090    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h2q26"]
Jul 09 15:04:18.628996 ip-10-0-137-94 kubenswrapper[2575]: W0709 15:04:18.628969    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod746a4a31_0b68_47e3_bc87_e16dd3edea5a.slice/crio-7e27a2a8bbc6feadc6daffe4d27523c5f96846ad86f86eb1349086ab614a5781 WatchSource:0}: Error finding container 7e27a2a8bbc6feadc6daffe4d27523c5f96846ad86f86eb1349086ab614a5781: Status 404 returned error can't find the container with id 7e27a2a8bbc6feadc6daffe4d27523c5f96846ad86f86eb1349086ab614a5781
Jul 09 15:04:19.347156 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:19.347119    2575 generic.go:356] "Generic (PLEG): container finished" podID="746a4a31-0b68-47e3-bc87-e16dd3edea5a" containerID="fc6a2da231405ca93b0f9ae479906f4ad446adf37f4c36dbf6daec1b8335b171" exitCode=0
Jul 09 15:04:19.347584 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:19.347212    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h2q26" event={"ID":"746a4a31-0b68-47e3-bc87-e16dd3edea5a","Type":"ContainerDied","Data":"fc6a2da231405ca93b0f9ae479906f4ad446adf37f4c36dbf6daec1b8335b171"}
Jul 09 15:04:19.347584 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:19.347272    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h2q26" event={"ID":"746a4a31-0b68-47e3-bc87-e16dd3edea5a","Type":"ContainerStarted","Data":"7e27a2a8bbc6feadc6daffe4d27523c5f96846ad86f86eb1349086ab614a5781"}
Jul 09 15:04:19.348810 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:19.348783    2575 generic.go:356] "Generic (PLEG): container finished" podID="4f0471e1-7ff7-4795-b974-0072dfb7739b" containerID="d5deb0327d5f474b5434ea038df43bb98c4bb7b616fc523ea2e0299709fba6e8" exitCode=0
Jul 09 15:04:19.348921 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:19.348864    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7b2l" event={"ID":"4f0471e1-7ff7-4795-b974-0072dfb7739b","Type":"ContainerDied","Data":"d5deb0327d5f474b5434ea038df43bb98c4bb7b616fc523ea2e0299709fba6e8"}
Jul 09 15:04:19.350951 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:19.350928    2575 generic.go:356] "Generic (PLEG): container finished" podID="48dc0bae-8282-44ea-922b-c6787596276f" containerID="2ce23469b0bd431b8bd8f5e419d6c0eb3b0d9cf61ce30aebc91a9a6087b20456" exitCode=0
Jul 09 15:04:19.351045 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:19.351009    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18q6l5" event={"ID":"48dc0bae-8282-44ea-922b-c6787596276f","Type":"ContainerDied","Data":"2ce23469b0bd431b8bd8f5e419d6c0eb3b0d9cf61ce30aebc91a9a6087b20456"}
Jul 09 15:04:19.352976 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:19.352956    2575 generic.go:356] "Generic (PLEG): container finished" podID="a0d02497-a76a-43b2-9af2-7e87a75ee1ee" containerID="fe73b4c3e113f9140a0f675549a855480f4d88dba242ec4371be354ddc5b73f8" exitCode=0
Jul 09 15:04:19.353070 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:19.353006    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q58vh" event={"ID":"a0d02497-a76a-43b2-9af2-7e87a75ee1ee","Type":"ContainerDied","Data":"fe73b4c3e113f9140a0f675549a855480f4d88dba242ec4371be354ddc5b73f8"}
Jul 09 15:04:20.359965 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:20.359929    2575 generic.go:356] "Generic (PLEG): container finished" podID="a0d02497-a76a-43b2-9af2-7e87a75ee1ee" containerID="03837bbb6bf32b12985ea28079ff363a05dd5c4f987d73fb729af1f8d4f9883c" exitCode=0
Jul 09 15:04:20.360339 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:20.359995    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q58vh" event={"ID":"a0d02497-a76a-43b2-9af2-7e87a75ee1ee","Type":"ContainerDied","Data":"03837bbb6bf32b12985ea28079ff363a05dd5c4f987d73fb729af1f8d4f9883c"}
Jul 09 15:04:20.362044 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:20.362022    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7b2l" event={"ID":"4f0471e1-7ff7-4795-b974-0072dfb7739b","Type":"ContainerStarted","Data":"de3f1542bbd4680756864ad6be66c9580f3c1b55d1e69e44aeb86b9d882cec7e"}
Jul 09 15:04:20.364380 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:20.364352    2575 generic.go:356] "Generic (PLEG): container finished" podID="48dc0bae-8282-44ea-922b-c6787596276f" containerID="9c42e2ecb2d4ef3efd33fd59f7fcab1db0725508a4c091012518ceac49ea685d" exitCode=0
Jul 09 15:04:20.364486 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:20.364389    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18q6l5" event={"ID":"48dc0bae-8282-44ea-922b-c6787596276f","Type":"ContainerDied","Data":"9c42e2ecb2d4ef3efd33fd59f7fcab1db0725508a4c091012518ceac49ea685d"}
Jul 09 15:04:21.370607 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:21.370572    2575 generic.go:356] "Generic (PLEG): container finished" podID="4f0471e1-7ff7-4795-b974-0072dfb7739b" containerID="de3f1542bbd4680756864ad6be66c9580f3c1b55d1e69e44aeb86b9d882cec7e" exitCode=0
Jul 09 15:04:21.371007 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:21.370658    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7b2l" event={"ID":"4f0471e1-7ff7-4795-b974-0072dfb7739b","Type":"ContainerDied","Data":"de3f1542bbd4680756864ad6be66c9580f3c1b55d1e69e44aeb86b9d882cec7e"}
Jul 09 15:04:21.524159 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:21.524136    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q58vh"
Jul 09 15:04:21.595119 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:21.595091    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18q6l5"
Jul 09 15:04:21.660833 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:21.660808    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/48dc0bae-8282-44ea-922b-c6787596276f-bundle\") pod \"48dc0bae-8282-44ea-922b-c6787596276f\" (UID: \"48dc0bae-8282-44ea-922b-c6787596276f\") "
Jul 09 15:04:21.660985 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:21.660846    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vjwh2\" (UniqueName: \"kubernetes.io/projected/48dc0bae-8282-44ea-922b-c6787596276f-kube-api-access-vjwh2\") pod \"48dc0bae-8282-44ea-922b-c6787596276f\" (UID: \"48dc0bae-8282-44ea-922b-c6787596276f\") "
Jul 09 15:04:21.660985 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:21.660867    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a0d02497-a76a-43b2-9af2-7e87a75ee1ee-bundle\") pod \"a0d02497-a76a-43b2-9af2-7e87a75ee1ee\" (UID: \"a0d02497-a76a-43b2-9af2-7e87a75ee1ee\") "
Jul 09 15:04:21.660985 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:21.660893    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a0d02497-a76a-43b2-9af2-7e87a75ee1ee-util\") pod \"a0d02497-a76a-43b2-9af2-7e87a75ee1ee\" (UID: \"a0d02497-a76a-43b2-9af2-7e87a75ee1ee\") "
Jul 09 15:04:21.660985 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:21.660970    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/48dc0bae-8282-44ea-922b-c6787596276f-util\") pod \"48dc0bae-8282-44ea-922b-c6787596276f\" (UID: \"48dc0bae-8282-44ea-922b-c6787596276f\") "
Jul 09 15:04:21.661157 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:21.660995    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wc744\" (UniqueName: \"kubernetes.io/projected/a0d02497-a76a-43b2-9af2-7e87a75ee1ee-kube-api-access-wc744\") pod \"a0d02497-a76a-43b2-9af2-7e87a75ee1ee\" (UID: \"a0d02497-a76a-43b2-9af2-7e87a75ee1ee\") "
Jul 09 15:04:21.661568 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:21.661447    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0d02497-a76a-43b2-9af2-7e87a75ee1ee-bundle" (OuterVolumeSpecName: "bundle") pod "a0d02497-a76a-43b2-9af2-7e87a75ee1ee" (UID: "a0d02497-a76a-43b2-9af2-7e87a75ee1ee"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:04:21.661568 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:21.661487    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48dc0bae-8282-44ea-922b-c6787596276f-bundle" (OuterVolumeSpecName: "bundle") pod "48dc0bae-8282-44ea-922b-c6787596276f" (UID: "48dc0bae-8282-44ea-922b-c6787596276f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:04:21.663202 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:21.663180    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0d02497-a76a-43b2-9af2-7e87a75ee1ee-kube-api-access-wc744" (OuterVolumeSpecName: "kube-api-access-wc744") pod "a0d02497-a76a-43b2-9af2-7e87a75ee1ee" (UID: "a0d02497-a76a-43b2-9af2-7e87a75ee1ee"). InnerVolumeSpecName "kube-api-access-wc744". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:04:21.663343 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:21.663324    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48dc0bae-8282-44ea-922b-c6787596276f-kube-api-access-vjwh2" (OuterVolumeSpecName: "kube-api-access-vjwh2") pod "48dc0bae-8282-44ea-922b-c6787596276f" (UID: "48dc0bae-8282-44ea-922b-c6787596276f"). InnerVolumeSpecName "kube-api-access-vjwh2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:04:21.666196 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:21.666160    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48dc0bae-8282-44ea-922b-c6787596276f-util" (OuterVolumeSpecName: "util") pod "48dc0bae-8282-44ea-922b-c6787596276f" (UID: "48dc0bae-8282-44ea-922b-c6787596276f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:04:21.667567 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:21.667546    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0d02497-a76a-43b2-9af2-7e87a75ee1ee-util" (OuterVolumeSpecName: "util") pod "a0d02497-a76a-43b2-9af2-7e87a75ee1ee" (UID: "a0d02497-a76a-43b2-9af2-7e87a75ee1ee"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:04:21.762353 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:21.762320    2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/48dc0bae-8282-44ea-922b-c6787596276f-bundle\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:04:21.762353 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:21.762348    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vjwh2\" (UniqueName: \"kubernetes.io/projected/48dc0bae-8282-44ea-922b-c6787596276f-kube-api-access-vjwh2\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:04:21.762353 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:21.762359    2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a0d02497-a76a-43b2-9af2-7e87a75ee1ee-bundle\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:04:21.762563 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:21.762367    2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a0d02497-a76a-43b2-9af2-7e87a75ee1ee-util\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:04:21.762563 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:21.762374    2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/48dc0bae-8282-44ea-922b-c6787596276f-util\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:04:21.762563 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:21.762382    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wc744\" (UniqueName: \"kubernetes.io/projected/a0d02497-a76a-43b2-9af2-7e87a75ee1ee-kube-api-access-wc744\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:04:22.376920 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:22.376885    2575 generic.go:356] "Generic (PLEG): container finished" podID="4f0471e1-7ff7-4795-b974-0072dfb7739b" containerID="de2b62816df3d1f925d81522ed1a474b32d910ed98c5f674396bc4fe8d8f8ff0" exitCode=0
Jul 09 15:04:22.377318 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:22.376971    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7b2l" event={"ID":"4f0471e1-7ff7-4795-b974-0072dfb7739b","Type":"ContainerDied","Data":"de2b62816df3d1f925d81522ed1a474b32d910ed98c5f674396bc4fe8d8f8ff0"}
Jul 09 15:04:22.378700 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:22.378657    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18q6l5"
Jul 09 15:04:22.378700 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:22.378669    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18q6l5" event={"ID":"48dc0bae-8282-44ea-922b-c6787596276f","Type":"ContainerDied","Data":"1bc237b8c0ee2b6a3526cc1159abf4fe701c65e70aba72e5ca4ea1728150a68c"}
Jul 09 15:04:22.378864 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:22.378729    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1bc237b8c0ee2b6a3526cc1159abf4fe701c65e70aba72e5ca4ea1728150a68c"
Jul 09 15:04:22.380661 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:22.380617    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q58vh" event={"ID":"a0d02497-a76a-43b2-9af2-7e87a75ee1ee","Type":"ContainerDied","Data":"a572c9e0979ea5901fb95ab2dab5164efe637711f712d4d8f956a47a331fe9c8"}
Jul 09 15:04:22.380661 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:22.380654    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a572c9e0979ea5901fb95ab2dab5164efe637711f712d4d8f956a47a331fe9c8"
Jul 09 15:04:22.380827 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:22.380673    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q58vh"
Jul 09 15:04:23.386947 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:23.386917    2575 generic.go:356] "Generic (PLEG): container finished" podID="746a4a31-0b68-47e3-bc87-e16dd3edea5a" containerID="6e1c45fb10d0aeaaa3d042565f425028453580e01a7c2f2e08c4cf1172bc0a40" exitCode=0
Jul 09 15:04:23.387320 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:23.387006    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h2q26" event={"ID":"746a4a31-0b68-47e3-bc87-e16dd3edea5a","Type":"ContainerDied","Data":"6e1c45fb10d0aeaaa3d042565f425028453580e01a7c2f2e08c4cf1172bc0a40"}
Jul 09 15:04:23.527422 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:23.527398    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7b2l"
Jul 09 15:04:23.678320 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:23.678226    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gp6gb\" (UniqueName: \"kubernetes.io/projected/4f0471e1-7ff7-4795-b974-0072dfb7739b-kube-api-access-gp6gb\") pod \"4f0471e1-7ff7-4795-b974-0072dfb7739b\" (UID: \"4f0471e1-7ff7-4795-b974-0072dfb7739b\") "
Jul 09 15:04:23.678320 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:23.678288    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4f0471e1-7ff7-4795-b974-0072dfb7739b-bundle\") pod \"4f0471e1-7ff7-4795-b974-0072dfb7739b\" (UID: \"4f0471e1-7ff7-4795-b974-0072dfb7739b\") "
Jul 09 15:04:23.678521 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:23.678331    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4f0471e1-7ff7-4795-b974-0072dfb7739b-util\") pod \"4f0471e1-7ff7-4795-b974-0072dfb7739b\" (UID: \"4f0471e1-7ff7-4795-b974-0072dfb7739b\") "
Jul 09 15:04:23.678822 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:23.678794    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f0471e1-7ff7-4795-b974-0072dfb7739b-bundle" (OuterVolumeSpecName: "bundle") pod "4f0471e1-7ff7-4795-b974-0072dfb7739b" (UID: "4f0471e1-7ff7-4795-b974-0072dfb7739b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:04:23.680294 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:23.680273    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f0471e1-7ff7-4795-b974-0072dfb7739b-kube-api-access-gp6gb" (OuterVolumeSpecName: "kube-api-access-gp6gb") pod "4f0471e1-7ff7-4795-b974-0072dfb7739b" (UID: "4f0471e1-7ff7-4795-b974-0072dfb7739b"). InnerVolumeSpecName "kube-api-access-gp6gb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:04:23.683389 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:23.683347    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f0471e1-7ff7-4795-b974-0072dfb7739b-util" (OuterVolumeSpecName: "util") pod "4f0471e1-7ff7-4795-b974-0072dfb7739b" (UID: "4f0471e1-7ff7-4795-b974-0072dfb7739b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:04:23.779886 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:23.779851    2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4f0471e1-7ff7-4795-b974-0072dfb7739b-util\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:04:23.779886 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:23.779880    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gp6gb\" (UniqueName: \"kubernetes.io/projected/4f0471e1-7ff7-4795-b974-0072dfb7739b-kube-api-access-gp6gb\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:04:23.779886 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:23.779890    2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4f0471e1-7ff7-4795-b974-0072dfb7739b-bundle\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:04:24.393473 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:24.393439    2575 generic.go:356] "Generic (PLEG): container finished" podID="746a4a31-0b68-47e3-bc87-e16dd3edea5a" containerID="50f64262ff97d671b2d292bec09d560e32b6024647b1b660ae70394bfb53797e" exitCode=0
Jul 09 15:04:24.393897 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:24.393518    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h2q26" event={"ID":"746a4a31-0b68-47e3-bc87-e16dd3edea5a","Type":"ContainerDied","Data":"50f64262ff97d671b2d292bec09d560e32b6024647b1b660ae70394bfb53797e"}
Jul 09 15:04:24.395338 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:24.395315    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7b2l" event={"ID":"4f0471e1-7ff7-4795-b974-0072dfb7739b","Type":"ContainerDied","Data":"97060352d61a656231f1041a03d87aa3746c5a3e286f3edd3722038211eb62ee"}
Jul 09 15:04:24.395338 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:24.395337    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7b2l"
Jul 09 15:04:24.395520 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:24.395351    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="97060352d61a656231f1041a03d87aa3746c5a3e286f3edd3722038211eb62ee"
Jul 09 15:04:25.528014 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:25.527992    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h2q26"
Jul 09 15:04:25.694574 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:25.694478    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/746a4a31-0b68-47e3-bc87-e16dd3edea5a-bundle\") pod \"746a4a31-0b68-47e3-bc87-e16dd3edea5a\" (UID: \"746a4a31-0b68-47e3-bc87-e16dd3edea5a\") "
Jul 09 15:04:25.694574 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:25.694517    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/746a4a31-0b68-47e3-bc87-e16dd3edea5a-util\") pod \"746a4a31-0b68-47e3-bc87-e16dd3edea5a\" (UID: \"746a4a31-0b68-47e3-bc87-e16dd3edea5a\") "
Jul 09 15:04:25.694832 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:25.694602    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kbd8n\" (UniqueName: \"kubernetes.io/projected/746a4a31-0b68-47e3-bc87-e16dd3edea5a-kube-api-access-kbd8n\") pod \"746a4a31-0b68-47e3-bc87-e16dd3edea5a\" (UID: \"746a4a31-0b68-47e3-bc87-e16dd3edea5a\") "
Jul 09 15:04:25.695221 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:25.695188    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/746a4a31-0b68-47e3-bc87-e16dd3edea5a-bundle" (OuterVolumeSpecName: "bundle") pod "746a4a31-0b68-47e3-bc87-e16dd3edea5a" (UID: "746a4a31-0b68-47e3-bc87-e16dd3edea5a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:04:25.696840 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:25.696814    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/746a4a31-0b68-47e3-bc87-e16dd3edea5a-kube-api-access-kbd8n" (OuterVolumeSpecName: "kube-api-access-kbd8n") pod "746a4a31-0b68-47e3-bc87-e16dd3edea5a" (UID: "746a4a31-0b68-47e3-bc87-e16dd3edea5a"). InnerVolumeSpecName "kube-api-access-kbd8n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:04:25.698965 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:25.698937    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/746a4a31-0b68-47e3-bc87-e16dd3edea5a-util" (OuterVolumeSpecName: "util") pod "746a4a31-0b68-47e3-bc87-e16dd3edea5a" (UID: "746a4a31-0b68-47e3-bc87-e16dd3edea5a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:04:25.786960 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:25.786929    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:04:25.795987 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:25.795964    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kbd8n\" (UniqueName: \"kubernetes.io/projected/746a4a31-0b68-47e3-bc87-e16dd3edea5a-kube-api-access-kbd8n\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:04:25.796050 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:25.795989    2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/746a4a31-0b68-47e3-bc87-e16dd3edea5a-bundle\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:04:25.796050 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:25.795999    2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/746a4a31-0b68-47e3-bc87-e16dd3edea5a-util\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:04:25.854174 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:25.854129    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:04:26.407213 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:26.407183    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h2q26"
Jul 09 15:04:26.407405 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:26.407215    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h2q26" event={"ID":"746a4a31-0b68-47e3-bc87-e16dd3edea5a","Type":"ContainerDied","Data":"7e27a2a8bbc6feadc6daffe4d27523c5f96846ad86f86eb1349086ab614a5781"}
Jul 09 15:04:26.407405 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:26.407258    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7e27a2a8bbc6feadc6daffe4d27523c5f96846ad86f86eb1349086ab614a5781"
Jul 09 15:04:30.345882 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:30.345848    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:04:33.134609 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:33.134575    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6xp2m"]
Jul 09 15:04:33.135001 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:33.134879    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f0471e1-7ff7-4795-b974-0072dfb7739b" containerName="pull"
Jul 09 15:04:33.135001 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:33.134890    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f0471e1-7ff7-4795-b974-0072dfb7739b" containerName="pull"
Jul 09 15:04:33.135001 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:33.134900    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48dc0bae-8282-44ea-922b-c6787596276f" containerName="extract"
Jul 09 15:04:33.135001 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:33.134905    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="48dc0bae-8282-44ea-922b-c6787596276f" containerName="extract"
Jul 09 15:04:33.135001 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:33.134912    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0d02497-a76a-43b2-9af2-7e87a75ee1ee" containerName="extract"
Jul 09 15:04:33.135001 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:33.134919    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0d02497-a76a-43b2-9af2-7e87a75ee1ee" containerName="extract"
Jul 09 15:04:33.135001 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:33.134927    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f0471e1-7ff7-4795-b974-0072dfb7739b" containerName="util"
Jul 09 15:04:33.135001 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:33.134932    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f0471e1-7ff7-4795-b974-0072dfb7739b" containerName="util"
Jul 09 15:04:33.135001 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:33.134940    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0d02497-a76a-43b2-9af2-7e87a75ee1ee" containerName="util"
Jul 09 15:04:33.135001 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:33.134945    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0d02497-a76a-43b2-9af2-7e87a75ee1ee" containerName="util"
Jul 09 15:04:33.135001 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:33.134951    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="746a4a31-0b68-47e3-bc87-e16dd3edea5a" containerName="pull"
Jul 09 15:04:33.135001 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:33.134956    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="746a4a31-0b68-47e3-bc87-e16dd3edea5a" containerName="pull"
Jul 09 15:04:33.135001 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:33.134966    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="746a4a31-0b68-47e3-bc87-e16dd3edea5a" containerName="extract"
Jul 09 15:04:33.135001 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:33.134972    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="746a4a31-0b68-47e3-bc87-e16dd3edea5a" containerName="extract"
Jul 09 15:04:33.135001 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:33.134979    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0d02497-a76a-43b2-9af2-7e87a75ee1ee" containerName="pull"
Jul 09 15:04:33.135001 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:33.134983    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0d02497-a76a-43b2-9af2-7e87a75ee1ee" containerName="pull"
Jul 09 15:04:33.135001 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:33.134990    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48dc0bae-8282-44ea-922b-c6787596276f" containerName="util"
Jul 09 15:04:33.135001 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:33.134994    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="48dc0bae-8282-44ea-922b-c6787596276f" containerName="util"
Jul 09 15:04:33.135001 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:33.135001    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="746a4a31-0b68-47e3-bc87-e16dd3edea5a" containerName="util"
Jul 09 15:04:33.135001 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:33.135006    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="746a4a31-0b68-47e3-bc87-e16dd3edea5a" containerName="util"
Jul 09 15:04:33.135001 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:33.135011    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48dc0bae-8282-44ea-922b-c6787596276f" containerName="pull"
Jul 09 15:04:33.135625 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:33.135018    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="48dc0bae-8282-44ea-922b-c6787596276f" containerName="pull"
Jul 09 15:04:33.135625 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:33.135023    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f0471e1-7ff7-4795-b974-0072dfb7739b" containerName="extract"
Jul 09 15:04:33.135625 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:33.135028    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f0471e1-7ff7-4795-b974-0072dfb7739b" containerName="extract"
Jul 09 15:04:33.135625 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:33.135088    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="48dc0bae-8282-44ea-922b-c6787596276f" containerName="extract"
Jul 09 15:04:33.135625 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:33.135097    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0d02497-a76a-43b2-9af2-7e87a75ee1ee" containerName="extract"
Jul 09 15:04:33.135625 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:33.135103    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="746a4a31-0b68-47e3-bc87-e16dd3edea5a" containerName="extract"
Jul 09 15:04:33.135625 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:33.135109    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f0471e1-7ff7-4795-b974-0072dfb7739b" containerName="extract"
Jul 09 15:04:33.139809 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:33.139790    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6xp2m"
Jul 09 15:04:33.142582 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:33.142555    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-chq52\""
Jul 09 15:04:33.152999 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:33.152975    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6xp2m"]
Jul 09 15:04:33.252084 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:33.252033    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smdh7\" (UniqueName: \"kubernetes.io/projected/a3b73466-fc62-443a-95b4-55298960b89e-kube-api-access-smdh7\") pod \"limitador-operator-controller-manager-859d7b78bd-6xp2m\" (UID: \"a3b73466-fc62-443a-95b4-55298960b89e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6xp2m"
Jul 09 15:04:33.352750 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:33.352697    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smdh7\" (UniqueName: \"kubernetes.io/projected/a3b73466-fc62-443a-95b4-55298960b89e-kube-api-access-smdh7\") pod \"limitador-operator-controller-manager-859d7b78bd-6xp2m\" (UID: \"a3b73466-fc62-443a-95b4-55298960b89e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6xp2m"
Jul 09 15:04:33.364934 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:33.364909    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-smdh7\" (UniqueName: \"kubernetes.io/projected/a3b73466-fc62-443a-95b4-55298960b89e-kube-api-access-smdh7\") pod \"limitador-operator-controller-manager-859d7b78bd-6xp2m\" (UID: \"a3b73466-fc62-443a-95b4-55298960b89e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6xp2m"
Jul 09 15:04:33.450072 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:33.449995    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6xp2m"
Jul 09 15:04:33.581263 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:33.581237    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6xp2m"]
Jul 09 15:04:33.582929 ip-10-0-137-94 kubenswrapper[2575]: W0709 15:04:33.582904    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3b73466_fc62_443a_95b4_55298960b89e.slice/crio-9423e35172bb0368233a0cbb84f66c688d1252be9e4b2190f563129984d80aa0 WatchSource:0}: Error finding container 9423e35172bb0368233a0cbb84f66c688d1252be9e4b2190f563129984d80aa0: Status 404 returned error can't find the container with id 9423e35172bb0368233a0cbb84f66c688d1252be9e4b2190f563129984d80aa0
Jul 09 15:04:34.444639 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:34.444606    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6xp2m" event={"ID":"a3b73466-fc62-443a-95b4-55298960b89e","Type":"ContainerStarted","Data":"9423e35172bb0368233a0cbb84f66c688d1252be9e4b2190f563129984d80aa0"}
Jul 09 15:04:34.638340 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:34.638292    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:04:35.216046 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:35.216009    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:04:36.448967 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:36.448934    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:04:36.456103 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:36.456068    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6xp2m" event={"ID":"a3b73466-fc62-443a-95b4-55298960b89e","Type":"ContainerStarted","Data":"faf828d6d60bad32904fca502a51dbb5805dd9ea25f7feb4746433472ee27a1b"}
Jul 09 15:04:36.456241 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:36.456174    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6xp2m"
Jul 09 15:04:36.477882 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:36.477840    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6xp2m" podStartSLOduration=1.499420047 podStartE2EDuration="3.477826852s" totalImagesPullingTime="1.978406805s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:04:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:04:36.476202499 +0000 UTC m=+584.318735445" watchObservedRunningTime="2026-07-09 15:04:36.477826852 +0000 UTC m=+584.320359784"
Jul 09 15:04:36.554930 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:36.554896    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:04:36.648657 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:36.648625    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:04:39.980768 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:39.976419    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bvhdq"]
Jul 09 15:04:39.984550 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:39.984530    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bvhdq"
Jul 09 15:04:39.987930 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:39.987909    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-9s4bm\""
Jul 09 15:04:40.011162 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:40.011131    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bvhdq"]
Jul 09 15:04:40.113557 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:40.113522    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnjth\" (UniqueName: \"kubernetes.io/projected/72751821-f284-4621-a10c-bc11db34e708-kube-api-access-fnjth\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bvhdq\" (UID: \"72751821-f284-4621-a10c-bc11db34e708\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bvhdq"
Jul 09 15:04:40.113748 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:40.113631    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/72751821-f284-4621-a10c-bc11db34e708-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bvhdq\" (UID: \"72751821-f284-4621-a10c-bc11db34e708\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bvhdq"
Jul 09 15:04:40.214904 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:40.214873    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/72751821-f284-4621-a10c-bc11db34e708-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bvhdq\" (UID: \"72751821-f284-4621-a10c-bc11db34e708\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bvhdq"
Jul 09 15:04:40.215053 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:40.214918    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnjth\" (UniqueName: \"kubernetes.io/projected/72751821-f284-4621-a10c-bc11db34e708-kube-api-access-fnjth\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bvhdq\" (UID: \"72751821-f284-4621-a10c-bc11db34e708\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bvhdq"
Jul 09 15:04:40.215251 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:40.215233    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/72751821-f284-4621-a10c-bc11db34e708-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bvhdq\" (UID: \"72751821-f284-4621-a10c-bc11db34e708\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bvhdq"
Jul 09 15:04:40.234128 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:40.234066    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnjth\" (UniqueName: \"kubernetes.io/projected/72751821-f284-4621-a10c-bc11db34e708-kube-api-access-fnjth\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bvhdq\" (UID: \"72751821-f284-4621-a10c-bc11db34e708\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bvhdq"
Jul 09 15:04:40.294527 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:40.294499    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bvhdq"
Jul 09 15:04:40.424750 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:40.424597    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bvhdq"]
Jul 09 15:04:40.427470 ip-10-0-137-94 kubenswrapper[2575]: W0709 15:04:40.427427    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72751821_f284_4621_a10c_bc11db34e708.slice/crio-06ad9673a2a5e0593d4cf389af0072cae1a22e4cfe4ba9ebe35204ccb590f877 WatchSource:0}: Error finding container 06ad9673a2a5e0593d4cf389af0072cae1a22e4cfe4ba9ebe35204ccb590f877: Status 404 returned error can't find the container with id 06ad9673a2a5e0593d4cf389af0072cae1a22e4cfe4ba9ebe35204ccb590f877
Jul 09 15:04:40.474602 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:40.474568    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bvhdq" event={"ID":"72751821-f284-4621-a10c-bc11db34e708","Type":"ContainerStarted","Data":"06ad9673a2a5e0593d4cf389af0072cae1a22e4cfe4ba9ebe35204ccb590f877"}
Jul 09 15:04:40.641859 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:40.641816    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:04:41.139456 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:41.139423    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:04:44.752257 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:44.752223    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:04:45.796209 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:45.796176    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:04:45.900645 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:45.900610    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:04:47.345604 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:47.345528    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-85lw4"]
Jul 09 15:04:47.348808 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:47.348791    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-85lw4"
Jul 09 15:04:47.352444 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:47.352418    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-zmbkn\""
Jul 09 15:04:47.352973 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:47.352959    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 09 15:04:47.361813 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:47.361785    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sv2ff\" (UniqueName: \"kubernetes.io/projected/4705b447-31df-4df7-b987-d56f20319c34-kube-api-access-sv2ff\") pod \"dns-operator-controller-manager-864dd78c4c-85lw4\" (UID: \"4705b447-31df-4df7-b987-d56f20319c34\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-85lw4"
Jul 09 15:04:47.372699 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:47.372672    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-85lw4"]
Jul 09 15:04:47.462189 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:47.462152    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sv2ff\" (UniqueName: \"kubernetes.io/projected/4705b447-31df-4df7-b987-d56f20319c34-kube-api-access-sv2ff\") pod \"dns-operator-controller-manager-864dd78c4c-85lw4\" (UID: \"4705b447-31df-4df7-b987-d56f20319c34\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-85lw4"
Jul 09 15:04:47.462350 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:47.462323    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6xp2m"
Jul 09 15:04:47.470720 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:47.470676    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sv2ff\" (UniqueName: \"kubernetes.io/projected/4705b447-31df-4df7-b987-d56f20319c34-kube-api-access-sv2ff\") pod \"dns-operator-controller-manager-864dd78c4c-85lw4\" (UID: \"4705b447-31df-4df7-b987-d56f20319c34\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-85lw4"
Jul 09 15:04:47.509569 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:47.509533    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bvhdq" event={"ID":"72751821-f284-4621-a10c-bc11db34e708","Type":"ContainerStarted","Data":"b033cf6e8d283b0bbe0823b093057f8b959f9821b8c84021c5b2697b19c73d95"}
Jul 09 15:04:47.509759 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:47.509637    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bvhdq"
Jul 09 15:04:47.532174 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:47.532121    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bvhdq" podStartSLOduration=1.954032862 podStartE2EDuration="8.532104425s" totalImagesPullingTime="6.578071563s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:04:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:04:47.531209688 +0000 UTC m=+595.373742622" watchObservedRunningTime="2026-07-09 15:04:47.532104425 +0000 UTC m=+595.374637357"
Jul 09 15:04:47.657899 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:47.657871    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-85lw4"
Jul 09 15:04:47.794163 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:47.794139    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-85lw4"]
Jul 09 15:04:47.796581 ip-10-0-137-94 kubenswrapper[2575]: W0709 15:04:47.796316    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4705b447_31df_4df7_b987_d56f20319c34.slice/crio-8d7a01527e36d21354e8ad9848b588dbf714b7ee3d900d04fafe612a162a9739 WatchSource:0}: Error finding container 8d7a01527e36d21354e8ad9848b588dbf714b7ee3d900d04fafe612a162a9739: Status 404 returned error can't find the container with id 8d7a01527e36d21354e8ad9848b588dbf714b7ee3d900d04fafe612a162a9739
Jul 09 15:04:48.197062 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:48.197022    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:04:48.518545 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:48.518471    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-85lw4" event={"ID":"4705b447-31df-4df7-b987-d56f20319c34","Type":"ContainerStarted","Data":"8d7a01527e36d21354e8ad9848b588dbf714b7ee3d900d04fafe612a162a9739"}
Jul 09 15:04:49.893525 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:49.893491    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-st6mr"]
Jul 09 15:04:49.896826 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:49.896808    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-st6mr"
Jul 09 15:04:49.900055 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:49.900025    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:04:49.903840 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:49.903821    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-rm8lj\""
Jul 09 15:04:49.904599 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:49.904580    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 09 15:04:49.904702 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:49.904612    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 09 15:04:49.919155 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:49.919129    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-st6mr"]
Jul 09 15:04:49.981726 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:49.981661    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7c3ebb71-a0f0-4b32-8e8c-54104d13623e-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-st6mr\" (UID: \"7c3ebb71-a0f0-4b32-8e8c-54104d13623e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-st6mr"
Jul 09 15:04:49.981897 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:49.981766    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/7c3ebb71-a0f0-4b32-8e8c-54104d13623e-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-st6mr\" (UID: \"7c3ebb71-a0f0-4b32-8e8c-54104d13623e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-st6mr"
Jul 09 15:04:49.981897 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:49.981802    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fpqz\" (UniqueName: \"kubernetes.io/projected/7c3ebb71-a0f0-4b32-8e8c-54104d13623e-kube-api-access-4fpqz\") pod \"kuadrant-console-plugin-66b5774985-st6mr\" (UID: \"7c3ebb71-a0f0-4b32-8e8c-54104d13623e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-st6mr"
Jul 09 15:04:50.083007 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:50.082926    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fpqz\" (UniqueName: \"kubernetes.io/projected/7c3ebb71-a0f0-4b32-8e8c-54104d13623e-kube-api-access-4fpqz\") pod \"kuadrant-console-plugin-66b5774985-st6mr\" (UID: \"7c3ebb71-a0f0-4b32-8e8c-54104d13623e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-st6mr"
Jul 09 15:04:50.083007 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:50.082994    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7c3ebb71-a0f0-4b32-8e8c-54104d13623e-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-st6mr\" (UID: \"7c3ebb71-a0f0-4b32-8e8c-54104d13623e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-st6mr"
Jul 09 15:04:50.083189 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:50.083039    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/7c3ebb71-a0f0-4b32-8e8c-54104d13623e-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-st6mr\" (UID: \"7c3ebb71-a0f0-4b32-8e8c-54104d13623e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-st6mr"
Jul 09 15:04:50.083189 ip-10-0-137-94 kubenswrapper[2575]: E0709 15:04:50.083127    2575 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 09 15:04:50.083189 ip-10-0-137-94 kubenswrapper[2575]: E0709 15:04:50.083185    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c3ebb71-a0f0-4b32-8e8c-54104d13623e-plugin-serving-cert podName:7c3ebb71-a0f0-4b32-8e8c-54104d13623e nodeName:}" failed. No retries permitted until 2026-07-09 15:04:50.583167033 +0000 UTC m=+598.425699946 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/7c3ebb71-a0f0-4b32-8e8c-54104d13623e-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-st6mr" (UID: "7c3ebb71-a0f0-4b32-8e8c-54104d13623e") : secret "plugin-serving-cert" not found
Jul 09 15:04:50.083608 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:50.083589    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7c3ebb71-a0f0-4b32-8e8c-54104d13623e-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-st6mr\" (UID: \"7c3ebb71-a0f0-4b32-8e8c-54104d13623e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-st6mr"
Jul 09 15:04:50.092078 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:50.092051    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fpqz\" (UniqueName: \"kubernetes.io/projected/7c3ebb71-a0f0-4b32-8e8c-54104d13623e-kube-api-access-4fpqz\") pod \"kuadrant-console-plugin-66b5774985-st6mr\" (UID: \"7c3ebb71-a0f0-4b32-8e8c-54104d13623e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-st6mr"
Jul 09 15:04:50.256531 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:50.256495    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:04:50.530847 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:50.530809    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-85lw4" event={"ID":"4705b447-31df-4df7-b987-d56f20319c34","Type":"ContainerStarted","Data":"29bf0db12544289ce2e5ce84b250ad8d485e323bef2029d32901177eeeeda89d"}
Jul 09 15:04:50.531032 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:50.530890    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-85lw4"
Jul 09 15:04:50.549506 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:50.549460    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-85lw4" podStartSLOduration=1.594012084 podStartE2EDuration="3.549445444s" totalImagesPullingTime="1.95543336s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:04:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:04:50.547959764 +0000 UTC m=+598.390492696" watchObservedRunningTime="2026-07-09 15:04:50.549445444 +0000 UTC m=+598.391978375"
Jul 09 15:04:50.551694 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:50.551667    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:04:50.585420 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:50.585388    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/7c3ebb71-a0f0-4b32-8e8c-54104d13623e-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-st6mr\" (UID: \"7c3ebb71-a0f0-4b32-8e8c-54104d13623e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-st6mr"
Jul 09 15:04:50.587808 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:50.587782    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/7c3ebb71-a0f0-4b32-8e8c-54104d13623e-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-st6mr\" (UID: \"7c3ebb71-a0f0-4b32-8e8c-54104d13623e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-st6mr"
Jul 09 15:04:50.650203 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:50.650170    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:04:50.806520 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:50.806424    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-st6mr"
Jul 09 15:04:50.937579 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:50.937546    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-st6mr"]
Jul 09 15:04:50.940573 ip-10-0-137-94 kubenswrapper[2575]: W0709 15:04:50.940543    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7c3ebb71_a0f0_4b32_8e8c_54104d13623e.slice/crio-7af1c3bf3e24bd89fafcbcb964f11c17c859d759ae31161ac4d472cb940dac5b WatchSource:0}: Error finding container 7af1c3bf3e24bd89fafcbcb964f11c17c859d759ae31161ac4d472cb940dac5b: Status 404 returned error can't find the container with id 7af1c3bf3e24bd89fafcbcb964f11c17c859d759ae31161ac4d472cb940dac5b
Jul 09 15:04:51.381545 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:51.381512    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:04:51.535928 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:51.535891    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-st6mr" event={"ID":"7c3ebb71-a0f0-4b32-8e8c-54104d13623e","Type":"ContainerStarted","Data":"7af1c3bf3e24bd89fafcbcb964f11c17c859d759ae31161ac4d472cb940dac5b"}
Jul 09 15:04:53.793828 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:53.793778    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:04:53.892263 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:53.892187    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:04:58.521100 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:04:58.521070    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bvhdq"
Jul 09 15:05:00.023601 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.023570    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fsd4r"]
Jul 09 15:05:00.026958 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.026938    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fsd4r"
Jul 09 15:05:00.043775 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.043744    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fsd4r"]
Jul 09 15:05:00.058872 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.058838    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/51b508c4-b018-426b-8e8f-b03214a79410-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-fsd4r\" (UID: \"51b508c4-b018-426b-8e8f-b03214a79410\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fsd4r"
Jul 09 15:05:00.058990 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.058908    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnw4v\" (UniqueName: \"kubernetes.io/projected/51b508c4-b018-426b-8e8f-b03214a79410-kube-api-access-vnw4v\") pod \"kuadrant-operator-controller-manager-55467d9f7-fsd4r\" (UID: \"51b508c4-b018-426b-8e8f-b03214a79410\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fsd4r"
Jul 09 15:05:00.128865 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.128830    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fsd4r"]
Jul 09 15:05:00.129167 ip-10-0-137-94 kubenswrapper[2575]: E0709 15:05:00.129143    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-vnw4v], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fsd4r" podUID="51b508c4-b018-426b-8e8f-b03214a79410"
Jul 09 15:05:00.159995 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.159964    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnw4v\" (UniqueName: \"kubernetes.io/projected/51b508c4-b018-426b-8e8f-b03214a79410-kube-api-access-vnw4v\") pod \"kuadrant-operator-controller-manager-55467d9f7-fsd4r\" (UID: \"51b508c4-b018-426b-8e8f-b03214a79410\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fsd4r"
Jul 09 15:05:00.160139 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.160035    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/51b508c4-b018-426b-8e8f-b03214a79410-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-fsd4r\" (UID: \"51b508c4-b018-426b-8e8f-b03214a79410\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fsd4r"
Jul 09 15:05:00.160434 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.160416    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/51b508c4-b018-426b-8e8f-b03214a79410-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-fsd4r\" (UID: \"51b508c4-b018-426b-8e8f-b03214a79410\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fsd4r"
Jul 09 15:05:00.170377 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.170354    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5dpsl"]
Jul 09 15:05:00.173967 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.173950    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5dpsl"
Jul 09 15:05:00.174897 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.174876    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnw4v\" (UniqueName: \"kubernetes.io/projected/51b508c4-b018-426b-8e8f-b03214a79410-kube-api-access-vnw4v\") pod \"kuadrant-operator-controller-manager-55467d9f7-fsd4r\" (UID: \"51b508c4-b018-426b-8e8f-b03214a79410\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fsd4r"
Jul 09 15:05:00.187033 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.187007    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5dpsl"]
Jul 09 15:05:00.241581 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.241549    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fsd4r"]
Jul 09 15:05:00.247857 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.247836    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fsd4r"]
Jul 09 15:05:00.261347 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.261316    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d7d5ea08-7df7-4899-be4f-868369ae7b1f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-5dpsl\" (UID: \"d7d5ea08-7df7-4899-be4f-868369ae7b1f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5dpsl"
Jul 09 15:05:00.261475 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.261352    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mh88r\" (UniqueName: \"kubernetes.io/projected/d7d5ea08-7df7-4899-be4f-868369ae7b1f-kube-api-access-mh88r\") pod \"kuadrant-operator-controller-manager-86878c769f-5dpsl\" (UID: \"d7d5ea08-7df7-4899-be4f-868369ae7b1f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5dpsl"
Jul 09 15:05:00.265771 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.265745    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bvhdq"]
Jul 09 15:05:00.265987 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.265961    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bvhdq" podUID="72751821-f284-4621-a10c-bc11db34e708" containerName="manager" containerID="cri-o://b033cf6e8d283b0bbe0823b093057f8b959f9821b8c84021c5b2697b19c73d95" gracePeriod=2
Jul 09 15:05:00.279932 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.279908    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bvhdq"]
Jul 09 15:05:00.282907 ip-10-0-137-94 kubenswrapper[2575]: E0709 15:05:00.282870    2575 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"72751821-f284-4621-a10c-bc11db34e708\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-bvhdq\": pods \"kuadrant-operator-controller-manager-8684c9ff49-bvhdq\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bvhdq"
Jul 09 15:05:00.298586 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.298564    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5dpsl"]
Jul 09 15:05:00.298881 ip-10-0-137-94 kubenswrapper[2575]: E0709 15:05:00.298858    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-mh88r], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5dpsl" podUID="d7d5ea08-7df7-4899-be4f-868369ae7b1f"
Jul 09 15:05:00.313134 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.313108    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5dpsl"]
Jul 09 15:05:00.322594 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.322571    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hsnrw"]
Jul 09 15:05:00.323072 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.323053    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72751821-f284-4621-a10c-bc11db34e708" containerName="manager"
Jul 09 15:05:00.323167 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.323074    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="72751821-f284-4621-a10c-bc11db34e708" containerName="manager"
Jul 09 15:05:00.323225 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.323173    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="72751821-f284-4621-a10c-bc11db34e708" containerName="manager"
Jul 09 15:05:00.326430 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.326413    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hsnrw"
Jul 09 15:05:00.330170 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.330150    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6xp2m"]
Jul 09 15:05:00.330320 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.330302    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6xp2m" podUID="a3b73466-fc62-443a-95b4-55298960b89e" containerName="manager" containerID="cri-o://faf828d6d60bad32904fca502a51dbb5805dd9ea25f7feb4746433472ee27a1b" gracePeriod=2
Jul 09 15:05:00.354786 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.354759    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hsnrw"]
Jul 09 15:05:00.364033 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.362880    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6xp2m"]
Jul 09 15:05:00.364033 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.363587    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d528860d-ecb3-4b08-8fd0-fbd5201fdd5a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hsnrw\" (UID: \"d528860d-ecb3-4b08-8fd0-fbd5201fdd5a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hsnrw"
Jul 09 15:05:00.364033 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.363646    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d7d5ea08-7df7-4899-be4f-868369ae7b1f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-5dpsl\" (UID: \"d7d5ea08-7df7-4899-be4f-868369ae7b1f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5dpsl"
Jul 09 15:05:00.364033 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.363693    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mh88r\" (UniqueName: \"kubernetes.io/projected/d7d5ea08-7df7-4899-be4f-868369ae7b1f-kube-api-access-mh88r\") pod \"kuadrant-operator-controller-manager-86878c769f-5dpsl\" (UID: \"d7d5ea08-7df7-4899-be4f-868369ae7b1f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5dpsl"
Jul 09 15:05:00.364033 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.363793    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s79mx\" (UniqueName: \"kubernetes.io/projected/d528860d-ecb3-4b08-8fd0-fbd5201fdd5a-kube-api-access-s79mx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hsnrw\" (UID: \"d528860d-ecb3-4b08-8fd0-fbd5201fdd5a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hsnrw"
Jul 09 15:05:00.368801 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.366661    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d7d5ea08-7df7-4899-be4f-868369ae7b1f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-5dpsl\" (UID: \"d7d5ea08-7df7-4899-be4f-868369ae7b1f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5dpsl"
Jul 09 15:05:00.368801 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.367787    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mknfh"]
Jul 09 15:05:00.368801 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.368439    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3b73466-fc62-443a-95b4-55298960b89e" containerName="manager"
Jul 09 15:05:00.368801 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.368456    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3b73466-fc62-443a-95b4-55298960b89e" containerName="manager"
Jul 09 15:05:00.368801 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.368597    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3b73466-fc62-443a-95b4-55298960b89e" containerName="manager"
Jul 09 15:05:00.372366 ip-10-0-137-94 kubenswrapper[2575]: E0709 15:05:00.372341    2575 projected.go:196] Error preparing data for projected volume kube-api-access-mh88r for pod kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5dpsl: failed to fetch token: pod "kuadrant-operator-controller-manager-86878c769f-5dpsl" not found
Jul 09 15:05:00.372453 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.372387    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mknfh"
Jul 09 15:05:00.372453 ip-10-0-137-94 kubenswrapper[2575]: E0709 15:05:00.372443    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d7d5ea08-7df7-4899-be4f-868369ae7b1f-kube-api-access-mh88r podName:d7d5ea08-7df7-4899-be4f-868369ae7b1f nodeName:}" failed. No retries permitted until 2026-07-09 15:05:00.872423094 +0000 UTC m=+608.714956007 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-mh88r" (UniqueName: "kubernetes.io/projected/d7d5ea08-7df7-4899-be4f-868369ae7b1f-kube-api-access-mh88r") pod "kuadrant-operator-controller-manager-86878c769f-5dpsl" (UID: "d7d5ea08-7df7-4899-be4f-868369ae7b1f") : failed to fetch token: pod "kuadrant-operator-controller-manager-86878c769f-5dpsl" not found
Jul 09 15:05:00.378174 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.378153    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2qr6n"]
Jul 09 15:05:00.381474 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.381454    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2qr6n"
Jul 09 15:05:00.391514 ip-10-0-137-94 kubenswrapper[2575]: E0709 15:05:00.391475    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-bvhdq\" is forbidden: User \"system:node:ip-10-0-137-94.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-94.ec2.internal' and this object" podUID="72751821-f284-4621-a10c-bc11db34e708" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bvhdq"
Jul 09 15:05:00.393849 ip-10-0-137-94 kubenswrapper[2575]: E0709 15:05:00.393815    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-bvhdq\" is forbidden: User \"system:node:ip-10-0-137-94.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-94.ec2.internal' and this object" podUID="72751821-f284-4621-a10c-bc11db34e708" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bvhdq"
Jul 09 15:05:00.395462 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.395130    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mknfh"]
Jul 09 15:05:00.409499 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.409462    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2qr6n"]
Jul 09 15:05:00.454228 ip-10-0-137-94 kubenswrapper[2575]: E0709 15:05:00.454187    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-6xp2m\" is forbidden: User \"system:node:ip-10-0-137-94.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-94.ec2.internal' and this object" podUID="a3b73466-fc62-443a-95b4-55298960b89e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6xp2m"
Jul 09 15:05:00.464722 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.464686    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fcd3efaa-aeac-4dcd-b4d9-df4294053d7b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-mknfh\" (UID: \"fcd3efaa-aeac-4dcd-b4d9-df4294053d7b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mknfh"
Jul 09 15:05:00.464857 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.464787    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5f6h\" (UniqueName: \"kubernetes.io/projected/fcd3efaa-aeac-4dcd-b4d9-df4294053d7b-kube-api-access-q5f6h\") pod \"kuadrant-operator-controller-manager-86878c769f-mknfh\" (UID: \"fcd3efaa-aeac-4dcd-b4d9-df4294053d7b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mknfh"
Jul 09 15:05:00.464857 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.464830    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s79mx\" (UniqueName: \"kubernetes.io/projected/d528860d-ecb3-4b08-8fd0-fbd5201fdd5a-kube-api-access-s79mx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hsnrw\" (UID: \"d528860d-ecb3-4b08-8fd0-fbd5201fdd5a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hsnrw"
Jul 09 15:05:00.464964 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.464898    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kj2k6\" (UniqueName: \"kubernetes.io/projected/f321cc35-8da4-40aa-b983-58ca540983bf-kube-api-access-kj2k6\") pod \"limitador-operator-controller-manager-859d7b78bd-2qr6n\" (UID: \"f321cc35-8da4-40aa-b983-58ca540983bf\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2qr6n"
Jul 09 15:05:00.464964 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.464930    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d528860d-ecb3-4b08-8fd0-fbd5201fdd5a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hsnrw\" (UID: \"d528860d-ecb3-4b08-8fd0-fbd5201fdd5a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hsnrw"
Jul 09 15:05:00.465286 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.465269    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d528860d-ecb3-4b08-8fd0-fbd5201fdd5a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hsnrw\" (UID: \"d528860d-ecb3-4b08-8fd0-fbd5201fdd5a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hsnrw"
Jul 09 15:05:00.476547 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.476524    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s79mx\" (UniqueName: \"kubernetes.io/projected/d528860d-ecb3-4b08-8fd0-fbd5201fdd5a-kube-api-access-s79mx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hsnrw\" (UID: \"d528860d-ecb3-4b08-8fd0-fbd5201fdd5a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hsnrw"
Jul 09 15:05:00.522993 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.522939    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bvhdq"
Jul 09 15:05:00.525127 ip-10-0-137-94 kubenswrapper[2575]: E0709 15:05:00.525067    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-6xp2m\" is forbidden: User \"system:node:ip-10-0-137-94.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-94.ec2.internal' and this object" podUID="a3b73466-fc62-443a-95b4-55298960b89e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6xp2m"
Jul 09 15:05:00.527341 ip-10-0-137-94 kubenswrapper[2575]: E0709 15:05:00.527309    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-bvhdq\" is forbidden: User \"system:node:ip-10-0-137-94.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-94.ec2.internal' and this object" podUID="72751821-f284-4621-a10c-bc11db34e708" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bvhdq"
Jul 09 15:05:00.566064 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.566035    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/72751821-f284-4621-a10c-bc11db34e708-extensions-socket-volume\") pod \"72751821-f284-4621-a10c-bc11db34e708\" (UID: \"72751821-f284-4621-a10c-bc11db34e708\") "
Jul 09 15:05:00.566214 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.566141    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fnjth\" (UniqueName: \"kubernetes.io/projected/72751821-f284-4621-a10c-bc11db34e708-kube-api-access-fnjth\") pod \"72751821-f284-4621-a10c-bc11db34e708\" (UID: \"72751821-f284-4621-a10c-bc11db34e708\") "
Jul 09 15:05:00.566282 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.566261    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fcd3efaa-aeac-4dcd-b4d9-df4294053d7b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-mknfh\" (UID: \"fcd3efaa-aeac-4dcd-b4d9-df4294053d7b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mknfh"
Jul 09 15:05:00.566338 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.566310    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5f6h\" (UniqueName: \"kubernetes.io/projected/fcd3efaa-aeac-4dcd-b4d9-df4294053d7b-kube-api-access-q5f6h\") pod \"kuadrant-operator-controller-manager-86878c769f-mknfh\" (UID: \"fcd3efaa-aeac-4dcd-b4d9-df4294053d7b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mknfh"
Jul 09 15:05:00.566393 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.566379    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kj2k6\" (UniqueName: \"kubernetes.io/projected/f321cc35-8da4-40aa-b983-58ca540983bf-kube-api-access-kj2k6\") pod \"limitador-operator-controller-manager-859d7b78bd-2qr6n\" (UID: \"f321cc35-8da4-40aa-b983-58ca540983bf\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2qr6n"
Jul 09 15:05:00.566461 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.566399    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72751821-f284-4621-a10c-bc11db34e708-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "72751821-f284-4621-a10c-bc11db34e708" (UID: "72751821-f284-4621-a10c-bc11db34e708"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:05:00.566844 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.566765    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fcd3efaa-aeac-4dcd-b4d9-df4294053d7b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-mknfh\" (UID: \"fcd3efaa-aeac-4dcd-b4d9-df4294053d7b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mknfh"
Jul 09 15:05:00.568425 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.568398    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72751821-f284-4621-a10c-bc11db34e708-kube-api-access-fnjth" (OuterVolumeSpecName: "kube-api-access-fnjth") pod "72751821-f284-4621-a10c-bc11db34e708" (UID: "72751821-f284-4621-a10c-bc11db34e708"). InnerVolumeSpecName "kube-api-access-fnjth". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:05:00.575768 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.575741    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kj2k6\" (UniqueName: \"kubernetes.io/projected/f321cc35-8da4-40aa-b983-58ca540983bf-kube-api-access-kj2k6\") pod \"limitador-operator-controller-manager-859d7b78bd-2qr6n\" (UID: \"f321cc35-8da4-40aa-b983-58ca540983bf\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2qr6n"
Jul 09 15:05:00.575916 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.575892    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5f6h\" (UniqueName: \"kubernetes.io/projected/fcd3efaa-aeac-4dcd-b4d9-df4294053d7b-kube-api-access-q5f6h\") pod \"kuadrant-operator-controller-manager-86878c769f-mknfh\" (UID: \"fcd3efaa-aeac-4dcd-b4d9-df4294053d7b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mknfh"
Jul 09 15:05:00.584688 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.584661    2575 generic.go:356] "Generic (PLEG): container finished" podID="72751821-f284-4621-a10c-bc11db34e708" containerID="b033cf6e8d283b0bbe0823b093057f8b959f9821b8c84021c5b2697b19c73d95" exitCode=0
Jul 09 15:05:00.584849 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.584733    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bvhdq"
Jul 09 15:05:00.584849 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.584775    2575 scope.go:117] "RemoveContainer" containerID="b033cf6e8d283b0bbe0823b093057f8b959f9821b8c84021c5b2697b19c73d95"
Jul 09 15:05:00.586416 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.586325    2575 generic.go:356] "Generic (PLEG): container finished" podID="a3b73466-fc62-443a-95b4-55298960b89e" containerID="faf828d6d60bad32904fca502a51dbb5805dd9ea25f7feb4746433472ee27a1b" exitCode=0
Jul 09 15:05:00.586484 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.586435    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5dpsl"
Jul 09 15:05:00.586584 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.586522    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fsd4r"
Jul 09 15:05:00.587699 ip-10-0-137-94 kubenswrapper[2575]: E0709 15:05:00.587671    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-6xp2m\" is forbidden: User \"system:node:ip-10-0-137-94.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-94.ec2.internal' and this object" podUID="a3b73466-fc62-443a-95b4-55298960b89e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6xp2m"
Jul 09 15:05:00.590472 ip-10-0-137-94 kubenswrapper[2575]: E0709 15:05:00.590444    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-bvhdq\" is forbidden: User \"system:node:ip-10-0-137-94.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-94.ec2.internal' and this object" podUID="72751821-f284-4621-a10c-bc11db34e708" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bvhdq"
Jul 09 15:05:00.592691 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.592671    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6xp2m"
Jul 09 15:05:00.593145 ip-10-0-137-94 kubenswrapper[2575]: E0709 15:05:00.593117    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-5dpsl\" is forbidden: User \"system:node:ip-10-0-137-94.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-94.ec2.internal' and this object" podUID="d7d5ea08-7df7-4899-be4f-868369ae7b1f" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5dpsl"
Jul 09 15:05:00.595534 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.595512    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5dpsl"
Jul 09 15:05:00.595697 ip-10-0-137-94 kubenswrapper[2575]: E0709 15:05:00.595660    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-6xp2m\" is forbidden: User \"system:node:ip-10-0-137-94.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-94.ec2.internal' and this object" podUID="a3b73466-fc62-443a-95b4-55298960b89e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6xp2m"
Jul 09 15:05:00.596081 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.596061    2575 scope.go:117] "RemoveContainer" containerID="b033cf6e8d283b0bbe0823b093057f8b959f9821b8c84021c5b2697b19c73d95"
Jul 09 15:05:00.596360 ip-10-0-137-94 kubenswrapper[2575]: E0709 15:05:00.596339    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b033cf6e8d283b0bbe0823b093057f8b959f9821b8c84021c5b2697b19c73d95\": container with ID starting with b033cf6e8d283b0bbe0823b093057f8b959f9821b8c84021c5b2697b19c73d95 not found: ID does not exist" containerID="b033cf6e8d283b0bbe0823b093057f8b959f9821b8c84021c5b2697b19c73d95"
Jul 09 15:05:00.596448 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.596367    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b033cf6e8d283b0bbe0823b093057f8b959f9821b8c84021c5b2697b19c73d95"} err="failed to get container status \"b033cf6e8d283b0bbe0823b093057f8b959f9821b8c84021c5b2697b19c73d95\": rpc error: code = NotFound desc = could not find container \"b033cf6e8d283b0bbe0823b093057f8b959f9821b8c84021c5b2697b19c73d95\": container with ID starting with b033cf6e8d283b0bbe0823b093057f8b959f9821b8c84021c5b2697b19c73d95 not found: ID does not exist"
Jul 09 15:05:00.597627 ip-10-0-137-94 kubenswrapper[2575]: E0709 15:05:00.597600    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-fsd4r\" is forbidden: User \"system:node:ip-10-0-137-94.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-94.ec2.internal' and this object" podUID="51b508c4-b018-426b-8e8f-b03214a79410" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fsd4r"
Jul 09 15:05:00.599700 ip-10-0-137-94 kubenswrapper[2575]: E0709 15:05:00.599665    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-bvhdq\" is forbidden: User \"system:node:ip-10-0-137-94.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-94.ec2.internal' and this object" podUID="72751821-f284-4621-a10c-bc11db34e708" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bvhdq"
Jul 09 15:05:00.601778 ip-10-0-137-94 kubenswrapper[2575]: E0709 15:05:00.601740    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-fsd4r\" is forbidden: User \"system:node:ip-10-0-137-94.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-94.ec2.internal' and this object" podUID="51b508c4-b018-426b-8e8f-b03214a79410" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fsd4r"
Jul 09 15:05:00.601887 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.601876    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fsd4r"
Jul 09 15:05:00.603728 ip-10-0-137-94 kubenswrapper[2575]: E0709 15:05:00.603688    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-bvhdq\" is forbidden: User \"system:node:ip-10-0-137-94.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-94.ec2.internal' and this object" podUID="72751821-f284-4621-a10c-bc11db34e708" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bvhdq"
Jul 09 15:05:00.605808 ip-10-0-137-94 kubenswrapper[2575]: E0709 15:05:00.605774    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-5dpsl\" is forbidden: User \"system:node:ip-10-0-137-94.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-94.ec2.internal' and this object" podUID="d7d5ea08-7df7-4899-be4f-868369ae7b1f" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5dpsl"
Jul 09 15:05:00.607664 ip-10-0-137-94 kubenswrapper[2575]: E0709 15:05:00.607641    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-6xp2m\" is forbidden: User \"system:node:ip-10-0-137-94.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-94.ec2.internal' and this object" podUID="a3b73466-fc62-443a-95b4-55298960b89e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6xp2m"
Jul 09 15:05:00.609746 ip-10-0-137-94 kubenswrapper[2575]: E0709 15:05:00.609701    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-6xp2m\" is forbidden: User \"system:node:ip-10-0-137-94.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-94.ec2.internal' and this object" podUID="a3b73466-fc62-443a-95b4-55298960b89e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6xp2m"
Jul 09 15:05:00.611727 ip-10-0-137-94 kubenswrapper[2575]: E0709 15:05:00.611676    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-fsd4r\" is forbidden: User \"system:node:ip-10-0-137-94.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-94.ec2.internal' and this object" podUID="51b508c4-b018-426b-8e8f-b03214a79410" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fsd4r"
Jul 09 15:05:00.614086 ip-10-0-137-94 kubenswrapper[2575]: E0709 15:05:00.614061    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-bvhdq\" is forbidden: User \"system:node:ip-10-0-137-94.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-94.ec2.internal' and this object" podUID="72751821-f284-4621-a10c-bc11db34e708" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bvhdq"
Jul 09 15:05:00.616025 ip-10-0-137-94 kubenswrapper[2575]: E0709 15:05:00.615998    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-5dpsl\" is forbidden: User \"system:node:ip-10-0-137-94.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-94.ec2.internal' and this object" podUID="d7d5ea08-7df7-4899-be4f-868369ae7b1f" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5dpsl"
Jul 09 15:05:00.666958 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.666927    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-smdh7\" (UniqueName: \"kubernetes.io/projected/a3b73466-fc62-443a-95b4-55298960b89e-kube-api-access-smdh7\") pod \"a3b73466-fc62-443a-95b4-55298960b89e\" (UID: \"a3b73466-fc62-443a-95b4-55298960b89e\") "
Jul 09 15:05:00.667091 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.666963    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d7d5ea08-7df7-4899-be4f-868369ae7b1f-extensions-socket-volume\") pod \"d7d5ea08-7df7-4899-be4f-868369ae7b1f\" (UID: \"d7d5ea08-7df7-4899-be4f-868369ae7b1f\") "
Jul 09 15:05:00.667091 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.666991    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/51b508c4-b018-426b-8e8f-b03214a79410-extensions-socket-volume\") pod \"51b508c4-b018-426b-8e8f-b03214a79410\" (UID: \"51b508c4-b018-426b-8e8f-b03214a79410\") "
Jul 09 15:05:00.667091 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.667029    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vnw4v\" (UniqueName: \"kubernetes.io/projected/51b508c4-b018-426b-8e8f-b03214a79410-kube-api-access-vnw4v\") pod \"51b508c4-b018-426b-8e8f-b03214a79410\" (UID: \"51b508c4-b018-426b-8e8f-b03214a79410\") "
Jul 09 15:05:00.667214 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.667145    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fnjth\" (UniqueName: \"kubernetes.io/projected/72751821-f284-4621-a10c-bc11db34e708-kube-api-access-fnjth\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:05:00.667214 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.667155    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mh88r\" (UniqueName: \"kubernetes.io/projected/d7d5ea08-7df7-4899-be4f-868369ae7b1f-kube-api-access-mh88r\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:05:00.667214 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.667164    2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/72751821-f284-4621-a10c-bc11db34e708-extensions-socket-volume\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:05:00.667371 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.667232    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7d5ea08-7df7-4899-be4f-868369ae7b1f-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d7d5ea08-7df7-4899-be4f-868369ae7b1f" (UID: "d7d5ea08-7df7-4899-be4f-868369ae7b1f"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:05:00.667371 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.667260    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51b508c4-b018-426b-8e8f-b03214a79410-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "51b508c4-b018-426b-8e8f-b03214a79410" (UID: "51b508c4-b018-426b-8e8f-b03214a79410"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:05:00.668937 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.668919    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3b73466-fc62-443a-95b4-55298960b89e-kube-api-access-smdh7" (OuterVolumeSpecName: "kube-api-access-smdh7") pod "a3b73466-fc62-443a-95b4-55298960b89e" (UID: "a3b73466-fc62-443a-95b4-55298960b89e"). InnerVolumeSpecName "kube-api-access-smdh7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:05:00.669015 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.668991    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51b508c4-b018-426b-8e8f-b03214a79410-kube-api-access-vnw4v" (OuterVolumeSpecName: "kube-api-access-vnw4v") pod "51b508c4-b018-426b-8e8f-b03214a79410" (UID: "51b508c4-b018-426b-8e8f-b03214a79410"). InnerVolumeSpecName "kube-api-access-vnw4v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:05:00.704452 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.704426    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hsnrw"
Jul 09 15:05:00.714819 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.714803    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mknfh"
Jul 09 15:05:00.721799 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.721631    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2qr6n"
Jul 09 15:05:00.768452 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.768349    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-smdh7\" (UniqueName: \"kubernetes.io/projected/a3b73466-fc62-443a-95b4-55298960b89e-kube-api-access-smdh7\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:05:00.768452 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.768385    2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d7d5ea08-7df7-4899-be4f-868369ae7b1f-extensions-socket-volume\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:05:00.768452 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.768404    2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/51b508c4-b018-426b-8e8f-b03214a79410-extensions-socket-volume\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:05:00.768452 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.768418    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vnw4v\" (UniqueName: \"kubernetes.io/projected/51b508c4-b018-426b-8e8f-b03214a79410-kube-api-access-vnw4v\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:05:00.873166 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.873137    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hsnrw"]
Jul 09 15:05:00.876425 ip-10-0-137-94 kubenswrapper[2575]: W0709 15:05:00.876392    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd528860d_ecb3_4b08_8fd0_fbd5201fdd5a.slice/crio-738a4bd680c3233ab8a66f7e8c511f4626ef4c0016ddc29d9d72ba2efe70c277 WatchSource:0}: Error finding container 738a4bd680c3233ab8a66f7e8c511f4626ef4c0016ddc29d9d72ba2efe70c277: Status 404 returned error can't find the container with id 738a4bd680c3233ab8a66f7e8c511f4626ef4c0016ddc29d9d72ba2efe70c277
Jul 09 15:05:00.902913 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.902885    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2qr6n"]
Jul 09 15:05:00.909948 ip-10-0-137-94 kubenswrapper[2575]: W0709 15:05:00.909916    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf321cc35_8da4_40aa_b983_58ca540983bf.slice/crio-766736cf511d7e0d41b1effe1e180095710d410312c9a6748ae0a1025b5cadb5 WatchSource:0}: Error finding container 766736cf511d7e0d41b1effe1e180095710d410312c9a6748ae0a1025b5cadb5: Status 404 returned error can't find the container with id 766736cf511d7e0d41b1effe1e180095710d410312c9a6748ae0a1025b5cadb5
Jul 09 15:05:00.924756 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:00.924730    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mknfh"]
Jul 09 15:05:00.928941 ip-10-0-137-94 kubenswrapper[2575]: W0709 15:05:00.928906    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcd3efaa_aeac_4dcd_b4d9_df4294053d7b.slice/crio-d1abfcef557398630fcb05c079c665144677677e8b55953268328bfadebcabc6 WatchSource:0}: Error finding container d1abfcef557398630fcb05c079c665144677677e8b55953268328bfadebcabc6: Status 404 returned error can't find the container with id d1abfcef557398630fcb05c079c665144677677e8b55953268328bfadebcabc6
Jul 09 15:05:01.318310 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:01.318278    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51b508c4-b018-426b-8e8f-b03214a79410" path="/var/lib/kubelet/pods/51b508c4-b018-426b-8e8f-b03214a79410/volumes"
Jul 09 15:05:01.318664 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:01.318556    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72751821-f284-4621-a10c-bc11db34e708" path="/var/lib/kubelet/pods/72751821-f284-4621-a10c-bc11db34e708/volumes"
Jul 09 15:05:01.318918 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:01.318904    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3b73466-fc62-443a-95b4-55298960b89e" path="/var/lib/kubelet/pods/a3b73466-fc62-443a-95b4-55298960b89e/volumes"
Jul 09 15:05:01.319250 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:01.319235    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d7d5ea08-7df7-4899-be4f-868369ae7b1f" path="/var/lib/kubelet/pods/d7d5ea08-7df7-4899-be4f-868369ae7b1f/volumes"
Jul 09 15:05:01.539290 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:01.539215    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-85lw4"
Jul 09 15:05:01.594128 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:01.594097    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6xp2m"
Jul 09 15:05:01.594277 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:01.594153    2575 scope.go:117] "RemoveContainer" containerID="faf828d6d60bad32904fca502a51dbb5805dd9ea25f7feb4746433472ee27a1b"
Jul 09 15:05:01.597194 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:01.597162    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2qr6n" event={"ID":"f321cc35-8da4-40aa-b983-58ca540983bf","Type":"ContainerStarted","Data":"184bd212dd1ce22c7329e36f4d8bd22643ff411f7b2a8898b4abe051ed975aca"}
Jul 09 15:05:01.597318 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:01.597225    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2qr6n"
Jul 09 15:05:01.597318 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:01.597254    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2qr6n" event={"ID":"f321cc35-8da4-40aa-b983-58ca540983bf","Type":"ContainerStarted","Data":"766736cf511d7e0d41b1effe1e180095710d410312c9a6748ae0a1025b5cadb5"}
Jul 09 15:05:01.599321 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:01.599296    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hsnrw" event={"ID":"d528860d-ecb3-4b08-8fd0-fbd5201fdd5a","Type":"ContainerStarted","Data":"dbb7b8bd58c9a8d28e54f5827e55b192679b5e8231bd22c3fcd3b75a7f1fa14f"}
Jul 09 15:05:01.599442 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:01.599345    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hsnrw"
Jul 09 15:05:01.599442 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:01.599371    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hsnrw" event={"ID":"d528860d-ecb3-4b08-8fd0-fbd5201fdd5a","Type":"ContainerStarted","Data":"738a4bd680c3233ab8a66f7e8c511f4626ef4c0016ddc29d9d72ba2efe70c277"}
Jul 09 15:05:01.602506 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:01.602411    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mknfh" event={"ID":"fcd3efaa-aeac-4dcd-b4d9-df4294053d7b","Type":"ContainerStarted","Data":"22ac7410952c7debfda72b7216f965125708677b784247cdd64fd56dc6d2ce1e"}
Jul 09 15:05:01.602506 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:01.602459    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mknfh" event={"ID":"fcd3efaa-aeac-4dcd-b4d9-df4294053d7b","Type":"ContainerStarted","Data":"d1abfcef557398630fcb05c079c665144677677e8b55953268328bfadebcabc6"}
Jul 09 15:05:01.602506 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:01.602456    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5dpsl"
Jul 09 15:05:01.602506 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:01.602422    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fsd4r"
Jul 09 15:05:01.602506 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:01.602491    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mknfh"
Jul 09 15:05:01.626440 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:01.626378    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2qr6n" podStartSLOduration=1.626364079 podStartE2EDuration="1.626364079s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:05:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:05:01.625568351 +0000 UTC m=+609.468101301" watchObservedRunningTime="2026-07-09 15:05:01.626364079 +0000 UTC m=+609.468897004"
Jul 09 15:05:01.660485 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:01.660424    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hsnrw" podStartSLOduration=1.660405683 podStartE2EDuration="1.660405683s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:05:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:05:01.660240787 +0000 UTC m=+609.502773720" watchObservedRunningTime="2026-07-09 15:05:01.660405683 +0000 UTC m=+609.502938615"
Jul 09 15:05:01.662409 ip-10-0-137-94 kubenswrapper[2575]: E0709 15:05:01.662373    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-fsd4r\" is forbidden: User \"system:node:ip-10-0-137-94.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-94.ec2.internal' and this object" podUID="51b508c4-b018-426b-8e8f-b03214a79410" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fsd4r"
Jul 09 15:05:01.664307 ip-10-0-137-94 kubenswrapper[2575]: E0709 15:05:01.664283    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-5dpsl\" is forbidden: User \"system:node:ip-10-0-137-94.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-94.ec2.internal' and this object" podUID="d7d5ea08-7df7-4899-be4f-868369ae7b1f" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5dpsl"
Jul 09 15:05:01.685610 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:01.685572    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mknfh" podStartSLOduration=1.6855591140000001 podStartE2EDuration="1.685559114s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:05:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:05:01.684193507 +0000 UTC m=+609.526726438" watchObservedRunningTime="2026-07-09 15:05:01.685559114 +0000 UTC m=+609.528092048"
Jul 09 15:05:03.315621 ip-10-0-137-94 kubenswrapper[2575]: E0709 15:05:03.315578    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-fsd4r\" is forbidden: User \"system:node:ip-10-0-137-94.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-94.ec2.internal' and this object" podUID="51b508c4-b018-426b-8e8f-b03214a79410" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fsd4r"
Jul 09 15:05:03.317695 ip-10-0-137-94 kubenswrapper[2575]: E0709 15:05:03.317653    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-5dpsl\" is forbidden: User \"system:node:ip-10-0-137-94.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-94.ec2.internal' and this object" podUID="d7d5ea08-7df7-4899-be4f-868369ae7b1f" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5dpsl"
Jul 09 15:05:03.982087 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:03.982004    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:05:04.085409 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:04.085350    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:05:06.402736 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:06.402669    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:05:06.503457 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:06.503221    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:05:10.739212 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:10.739146    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:05:10.840313 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:10.840223    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:05:12.611065 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:12.610979    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mknfh"
Jul 09 15:05:12.611065 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:12.611065    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2qr6n"
Jul 09 15:05:12.611524 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:12.611204    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hsnrw"
Jul 09 15:05:12.687298 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:12.687268    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hsnrw"]
Jul 09 15:05:12.687817 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:12.687784    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hsnrw" podUID="d528860d-ecb3-4b08-8fd0-fbd5201fdd5a" containerName="manager" containerID="cri-o://dbb7b8bd58c9a8d28e54f5827e55b192679b5e8231bd22c3fcd3b75a7f1fa14f" gracePeriod=10
Jul 09 15:05:13.012528 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:13.012479    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:05:13.110001 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:13.109958    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:05:17.538973 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:17.538947    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hsnrw"
Jul 09 15:05:17.621532 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:17.621504    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s79mx\" (UniqueName: \"kubernetes.io/projected/d528860d-ecb3-4b08-8fd0-fbd5201fdd5a-kube-api-access-s79mx\") pod \"d528860d-ecb3-4b08-8fd0-fbd5201fdd5a\" (UID: \"d528860d-ecb3-4b08-8fd0-fbd5201fdd5a\") "
Jul 09 15:05:17.621723 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:17.621557    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d528860d-ecb3-4b08-8fd0-fbd5201fdd5a-extensions-socket-volume\") pod \"d528860d-ecb3-4b08-8fd0-fbd5201fdd5a\" (UID: \"d528860d-ecb3-4b08-8fd0-fbd5201fdd5a\") "
Jul 09 15:05:17.621967 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:17.621941    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d528860d-ecb3-4b08-8fd0-fbd5201fdd5a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d528860d-ecb3-4b08-8fd0-fbd5201fdd5a" (UID: "d528860d-ecb3-4b08-8fd0-fbd5201fdd5a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:05:17.623491 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:17.623469    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d528860d-ecb3-4b08-8fd0-fbd5201fdd5a-kube-api-access-s79mx" (OuterVolumeSpecName: "kube-api-access-s79mx") pod "d528860d-ecb3-4b08-8fd0-fbd5201fdd5a" (UID: "d528860d-ecb3-4b08-8fd0-fbd5201fdd5a"). InnerVolumeSpecName "kube-api-access-s79mx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:05:17.695389 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:17.695315    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-st6mr" event={"ID":"7c3ebb71-a0f0-4b32-8e8c-54104d13623e","Type":"ContainerStarted","Data":"ef06e6c40f6b31e043aa6b2bd25d7bd11cc6539e4a20f797e08695792bdd86ea"}
Jul 09 15:05:17.696692 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:17.696669    2575 generic.go:356] "Generic (PLEG): container finished" podID="d528860d-ecb3-4b08-8fd0-fbd5201fdd5a" containerID="dbb7b8bd58c9a8d28e54f5827e55b192679b5e8231bd22c3fcd3b75a7f1fa14f" exitCode=0
Jul 09 15:05:17.696818 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:17.696732    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hsnrw"
Jul 09 15:05:17.696818 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:17.696749    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hsnrw" event={"ID":"d528860d-ecb3-4b08-8fd0-fbd5201fdd5a","Type":"ContainerDied","Data":"dbb7b8bd58c9a8d28e54f5827e55b192679b5e8231bd22c3fcd3b75a7f1fa14f"}
Jul 09 15:05:17.696818 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:17.696795    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hsnrw" event={"ID":"d528860d-ecb3-4b08-8fd0-fbd5201fdd5a","Type":"ContainerDied","Data":"738a4bd680c3233ab8a66f7e8c511f4626ef4c0016ddc29d9d72ba2efe70c277"}
Jul 09 15:05:17.696818 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:17.696817    2575 scope.go:117] "RemoveContainer" containerID="dbb7b8bd58c9a8d28e54f5827e55b192679b5e8231bd22c3fcd3b75a7f1fa14f"
Jul 09 15:05:17.705627 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:17.705608    2575 scope.go:117] "RemoveContainer" containerID="dbb7b8bd58c9a8d28e54f5827e55b192679b5e8231bd22c3fcd3b75a7f1fa14f"
Jul 09 15:05:17.705900 ip-10-0-137-94 kubenswrapper[2575]: E0709 15:05:17.705880    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbb7b8bd58c9a8d28e54f5827e55b192679b5e8231bd22c3fcd3b75a7f1fa14f\": container with ID starting with dbb7b8bd58c9a8d28e54f5827e55b192679b5e8231bd22c3fcd3b75a7f1fa14f not found: ID does not exist" containerID="dbb7b8bd58c9a8d28e54f5827e55b192679b5e8231bd22c3fcd3b75a7f1fa14f"
Jul 09 15:05:17.705960 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:17.705908    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbb7b8bd58c9a8d28e54f5827e55b192679b5e8231bd22c3fcd3b75a7f1fa14f"} err="failed to get container status \"dbb7b8bd58c9a8d28e54f5827e55b192679b5e8231bd22c3fcd3b75a7f1fa14f\": rpc error: code = NotFound desc = could not find container \"dbb7b8bd58c9a8d28e54f5827e55b192679b5e8231bd22c3fcd3b75a7f1fa14f\": container with ID starting with dbb7b8bd58c9a8d28e54f5827e55b192679b5e8231bd22c3fcd3b75a7f1fa14f not found: ID does not exist"
Jul 09 15:05:17.719921 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:17.719876    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-st6mr" podStartSLOduration=2.1773782170000002 podStartE2EDuration="28.719862759s" totalImagesPullingTime="26.542484542s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:04:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:05:17.718531433 +0000 UTC m=+625.561064366" watchObservedRunningTime="2026-07-09 15:05:17.719862759 +0000 UTC m=+625.562395691"
Jul 09 15:05:17.722063 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:17.722047    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s79mx\" (UniqueName: \"kubernetes.io/projected/d528860d-ecb3-4b08-8fd0-fbd5201fdd5a-kube-api-access-s79mx\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:05:17.722118 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:17.722066    2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d528860d-ecb3-4b08-8fd0-fbd5201fdd5a-extensions-socket-volume\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:05:17.736276 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:17.736253    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hsnrw"]
Jul 09 15:05:17.744899 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:17.744879    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hsnrw"]
Jul 09 15:05:19.316149 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:19.316108    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d528860d-ecb3-4b08-8fd0-fbd5201fdd5a" path="/var/lib/kubelet/pods/d528860d-ecb3-4b08-8fd0-fbd5201fdd5a/volumes"
Jul 09 15:05:20.699068 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:20.699028    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:05:20.771814 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:20.771782    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:05:21.727788 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:21.727751    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:05:21.828753 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:21.828690    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:05:26.301448 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:26.301406    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:05:26.381837 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:26.381808    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:05:28.529075 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:28.529040    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:05:28.638232 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:28.638194    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:05:29.012018 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:29.011986    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mjlqx"]
Jul 09 15:05:29.012339 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:29.012326    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d528860d-ecb3-4b08-8fd0-fbd5201fdd5a" containerName="manager"
Jul 09 15:05:29.012395 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:29.012340    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d528860d-ecb3-4b08-8fd0-fbd5201fdd5a" containerName="manager"
Jul 09 15:05:29.012432 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:29.012401    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="d528860d-ecb3-4b08-8fd0-fbd5201fdd5a" containerName="manager"
Jul 09 15:05:29.031590 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:29.031563    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mjlqx"]
Jul 09 15:05:29.031767 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:29.031693    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mjlqx"
Jul 09 15:05:29.034418 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:29.034397    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-mbnpk\""
Jul 09 15:05:29.039457 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:29.039430    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:05:29.122967 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:29.122930    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85ae6aa9-f89f-4a61-9630-9f6b2b82910d-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-mjlqx\" (UID: \"85ae6aa9-f89f-4a61-9630-9f6b2b82910d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mjlqx"
Jul 09 15:05:29.123136 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:29.122979    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85ae6aa9-f89f-4a61-9630-9f6b2b82910d-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-mjlqx\" (UID: \"85ae6aa9-f89f-4a61-9630-9f6b2b82910d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mjlqx"
Jul 09 15:05:29.123136 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:29.123008    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85ae6aa9-f89f-4a61-9630-9f6b2b82910d-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-mjlqx\" (UID: \"85ae6aa9-f89f-4a61-9630-9f6b2b82910d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mjlqx"
Jul 09 15:05:29.123136 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:29.123098    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85ae6aa9-f89f-4a61-9630-9f6b2b82910d-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-mjlqx\" (UID: \"85ae6aa9-f89f-4a61-9630-9f6b2b82910d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mjlqx"
Jul 09 15:05:29.123240 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:29.123143    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hfxp\" (UniqueName: \"kubernetes.io/projected/85ae6aa9-f89f-4a61-9630-9f6b2b82910d-kube-api-access-9hfxp\") pod \"maas-default-gateway-openshift-default-56654dcf7-mjlqx\" (UID: \"85ae6aa9-f89f-4a61-9630-9f6b2b82910d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mjlqx"
Jul 09 15:05:29.123240 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:29.123174    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85ae6aa9-f89f-4a61-9630-9f6b2b82910d-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-mjlqx\" (UID: \"85ae6aa9-f89f-4a61-9630-9f6b2b82910d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mjlqx"
Jul 09 15:05:29.123240 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:29.123196    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85ae6aa9-f89f-4a61-9630-9f6b2b82910d-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-mjlqx\" (UID: \"85ae6aa9-f89f-4a61-9630-9f6b2b82910d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mjlqx"
Jul 09 15:05:29.123240 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:29.123218    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85ae6aa9-f89f-4a61-9630-9f6b2b82910d-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-mjlqx\" (UID: \"85ae6aa9-f89f-4a61-9630-9f6b2b82910d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mjlqx"
Jul 09 15:05:29.123397 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:29.123268    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85ae6aa9-f89f-4a61-9630-9f6b2b82910d-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-mjlqx\" (UID: \"85ae6aa9-f89f-4a61-9630-9f6b2b82910d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mjlqx"
Jul 09 15:05:29.198361 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:29.198330    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:05:29.224375 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:29.224344    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85ae6aa9-f89f-4a61-9630-9f6b2b82910d-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-mjlqx\" (UID: \"85ae6aa9-f89f-4a61-9630-9f6b2b82910d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mjlqx"
Jul 09 15:05:29.224538 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:29.224379    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85ae6aa9-f89f-4a61-9630-9f6b2b82910d-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-mjlqx\" (UID: \"85ae6aa9-f89f-4a61-9630-9f6b2b82910d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mjlqx"
Jul 09 15:05:29.224538 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:29.224405    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85ae6aa9-f89f-4a61-9630-9f6b2b82910d-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-mjlqx\" (UID: \"85ae6aa9-f89f-4a61-9630-9f6b2b82910d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mjlqx"
Jul 09 15:05:29.224538 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:29.224444    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85ae6aa9-f89f-4a61-9630-9f6b2b82910d-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-mjlqx\" (UID: \"85ae6aa9-f89f-4a61-9630-9f6b2b82910d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mjlqx"
Jul 09 15:05:29.224538 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:29.224462    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85ae6aa9-f89f-4a61-9630-9f6b2b82910d-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-mjlqx\" (UID: \"85ae6aa9-f89f-4a61-9630-9f6b2b82910d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mjlqx"
Jul 09 15:05:29.224538 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:29.224481    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85ae6aa9-f89f-4a61-9630-9f6b2b82910d-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-mjlqx\" (UID: \"85ae6aa9-f89f-4a61-9630-9f6b2b82910d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mjlqx"
Jul 09 15:05:29.224538 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:29.224523    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85ae6aa9-f89f-4a61-9630-9f6b2b82910d-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-mjlqx\" (UID: \"85ae6aa9-f89f-4a61-9630-9f6b2b82910d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mjlqx"
Jul 09 15:05:29.224883 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:29.224566    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hfxp\" (UniqueName: \"kubernetes.io/projected/85ae6aa9-f89f-4a61-9630-9f6b2b82910d-kube-api-access-9hfxp\") pod \"maas-default-gateway-openshift-default-56654dcf7-mjlqx\" (UID: \"85ae6aa9-f89f-4a61-9630-9f6b2b82910d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mjlqx"
Jul 09 15:05:29.224883 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:29.224600    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85ae6aa9-f89f-4a61-9630-9f6b2b82910d-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-mjlqx\" (UID: \"85ae6aa9-f89f-4a61-9630-9f6b2b82910d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mjlqx"
Jul 09 15:05:29.224883 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:29.224815    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85ae6aa9-f89f-4a61-9630-9f6b2b82910d-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-mjlqx\" (UID: \"85ae6aa9-f89f-4a61-9630-9f6b2b82910d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mjlqx"
Jul 09 15:05:29.225037 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:29.224894    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85ae6aa9-f89f-4a61-9630-9f6b2b82910d-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-mjlqx\" (UID: \"85ae6aa9-f89f-4a61-9630-9f6b2b82910d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mjlqx"
Jul 09 15:05:29.225037 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:29.224995    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85ae6aa9-f89f-4a61-9630-9f6b2b82910d-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-mjlqx\" (UID: \"85ae6aa9-f89f-4a61-9630-9f6b2b82910d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mjlqx"
Jul 09 15:05:29.225119 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:29.225055    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85ae6aa9-f89f-4a61-9630-9f6b2b82910d-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-mjlqx\" (UID: \"85ae6aa9-f89f-4a61-9630-9f6b2b82910d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mjlqx"
Jul 09 15:05:29.225373 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:29.225351    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85ae6aa9-f89f-4a61-9630-9f6b2b82910d-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-mjlqx\" (UID: \"85ae6aa9-f89f-4a61-9630-9f6b2b82910d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mjlqx"
Jul 09 15:05:29.226773 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:29.226754    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85ae6aa9-f89f-4a61-9630-9f6b2b82910d-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-mjlqx\" (UID: \"85ae6aa9-f89f-4a61-9630-9f6b2b82910d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mjlqx"
Jul 09 15:05:29.226886 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:29.226870    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85ae6aa9-f89f-4a61-9630-9f6b2b82910d-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-mjlqx\" (UID: \"85ae6aa9-f89f-4a61-9630-9f6b2b82910d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mjlqx"
Jul 09 15:05:29.233290 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:29.233267    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85ae6aa9-f89f-4a61-9630-9f6b2b82910d-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-mjlqx\" (UID: \"85ae6aa9-f89f-4a61-9630-9f6b2b82910d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mjlqx"
Jul 09 15:05:29.233407 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:29.233296    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hfxp\" (UniqueName: \"kubernetes.io/projected/85ae6aa9-f89f-4a61-9630-9f6b2b82910d-kube-api-access-9hfxp\") pod \"maas-default-gateway-openshift-default-56654dcf7-mjlqx\" (UID: \"85ae6aa9-f89f-4a61-9630-9f6b2b82910d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mjlqx"
Jul 09 15:05:29.343132 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:29.343059    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mjlqx"
Jul 09 15:05:29.495556 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:29.495534    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mjlqx"]
Jul 09 15:05:29.497817 ip-10-0-137-94 kubenswrapper[2575]: W0709 15:05:29.497790    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85ae6aa9_f89f_4a61_9630_9f6b2b82910d.slice/crio-674d318f05f44fb8f3db106caae34b5b2e6a351834b4d65889650e604fa7287b WatchSource:0}: Error finding container 674d318f05f44fb8f3db106caae34b5b2e6a351834b4d65889650e604fa7287b: Status 404 returned error can't find the container with id 674d318f05f44fb8f3db106caae34b5b2e6a351834b4d65889650e604fa7287b
Jul 09 15:05:29.500287 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:29.500252    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 15:05:29.500620 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:29.500328    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 15:05:29.500620 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:29.500357    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 15:05:29.757835 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:29.757793    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mjlqx" event={"ID":"85ae6aa9-f89f-4a61-9630-9f6b2b82910d","Type":"ContainerStarted","Data":"6baf4b432d63ba2c84a8f35caa25c27bf8d9d4f6f5ac22df4eda3546665862b9"}
Jul 09 15:05:29.758226 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:29.757857    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mjlqx" event={"ID":"85ae6aa9-f89f-4a61-9630-9f6b2b82910d","Type":"ContainerStarted","Data":"674d318f05f44fb8f3db106caae34b5b2e6a351834b4d65889650e604fa7287b"}
Jul 09 15:05:29.781371 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:29.781313    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mjlqx" podStartSLOduration=1.7812964340000002 podStartE2EDuration="1.781296434s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:05:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:05:29.779771831 +0000 UTC m=+637.622304763" watchObservedRunningTime="2026-07-09 15:05:29.781296434 +0000 UTC m=+637.623829366"
Jul 09 15:05:30.343909 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:30.343860    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mjlqx"
Jul 09 15:05:30.348728 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:30.348682    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mjlqx"
Jul 09 15:05:30.762768 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:30.762738    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mjlqx"
Jul 09 15:05:30.763768 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:30.763745    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mjlqx"
Jul 09 15:05:30.884830 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:30.884800    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-sqdx9"]
Jul 09 15:05:30.888281 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:30.888262    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-sqdx9"
Jul 09 15:05:30.890870 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:30.890852    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 09 15:05:30.899412 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:30.899396    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-sqdx9"]
Jul 09 15:05:30.904460 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:30.904433    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:05:30.976115 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:30.976085    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-sqdx9"]
Jul 09 15:05:30.998421 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:30.998393    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:05:31.041324 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:31.041256    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8jbw\" (UniqueName: \"kubernetes.io/projected/0f4e52cb-1f74-4985-9295-a0a1fb9e804e-kube-api-access-v8jbw\") pod \"limitador-limitador-64c94fd64f-sqdx9\" (UID: \"0f4e52cb-1f74-4985-9295-a0a1fb9e804e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-sqdx9"
Jul 09 15:05:31.041324 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:31.041317    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0f4e52cb-1f74-4985-9295-a0a1fb9e804e-config-file\") pod \"limitador-limitador-64c94fd64f-sqdx9\" (UID: \"0f4e52cb-1f74-4985-9295-a0a1fb9e804e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-sqdx9"
Jul 09 15:05:31.100252 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:31.100219    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:05:31.142331 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:31.142300    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8jbw\" (UniqueName: \"kubernetes.io/projected/0f4e52cb-1f74-4985-9295-a0a1fb9e804e-kube-api-access-v8jbw\") pod \"limitador-limitador-64c94fd64f-sqdx9\" (UID: \"0f4e52cb-1f74-4985-9295-a0a1fb9e804e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-sqdx9"
Jul 09 15:05:31.142510 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:31.142366    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0f4e52cb-1f74-4985-9295-a0a1fb9e804e-config-file\") pod \"limitador-limitador-64c94fd64f-sqdx9\" (UID: \"0f4e52cb-1f74-4985-9295-a0a1fb9e804e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-sqdx9"
Jul 09 15:05:31.143000 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:31.142981    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0f4e52cb-1f74-4985-9295-a0a1fb9e804e-config-file\") pod \"limitador-limitador-64c94fd64f-sqdx9\" (UID: \"0f4e52cb-1f74-4985-9295-a0a1fb9e804e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-sqdx9"
Jul 09 15:05:31.154652 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:31.154627    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8jbw\" (UniqueName: \"kubernetes.io/projected/0f4e52cb-1f74-4985-9295-a0a1fb9e804e-kube-api-access-v8jbw\") pod \"limitador-limitador-64c94fd64f-sqdx9\" (UID: \"0f4e52cb-1f74-4985-9295-a0a1fb9e804e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-sqdx9"
Jul 09 15:05:31.199867 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:31.199837    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-sqdx9"
Jul 09 15:05:31.327322 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:31.327296    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-sqdx9"]
Jul 09 15:05:31.329218 ip-10-0-137-94 kubenswrapper[2575]: W0709 15:05:31.329192    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f4e52cb_1f74_4985_9295_a0a1fb9e804e.slice/crio-4db6466282ac242edbfc31d9561acb0bb76d7dd1d6ac04e05147568bdf092e88 WatchSource:0}: Error finding container 4db6466282ac242edbfc31d9561acb0bb76d7dd1d6ac04e05147568bdf092e88: Status 404 returned error can't find the container with id 4db6466282ac242edbfc31d9561acb0bb76d7dd1d6ac04e05147568bdf092e88
Jul 09 15:05:31.546283 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:31.546248    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:05:31.644547 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:31.644514    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:05:31.739667 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:31.739629    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:05:31.773690 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:31.773652    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-sqdx9" event={"ID":"0f4e52cb-1f74-4985-9295-a0a1fb9e804e","Type":"ContainerStarted","Data":"4db6466282ac242edbfc31d9561acb0bb76d7dd1d6ac04e05147568bdf092e88"}
Jul 09 15:05:31.819029 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:31.818994    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:05:32.030314 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:32.030217    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:05:35.060554 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:35.060483    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:05:35.161737 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:35.161679    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:05:36.805426 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:36.805331    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-sqdx9" event={"ID":"0f4e52cb-1f74-4985-9295-a0a1fb9e804e","Type":"ContainerStarted","Data":"3f91425a433bf4877b09e686b4e2afe919667bcc9944cfd4efb0fd3aa10499f9"}
Jul 09 15:05:36.805825 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:36.805448    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-sqdx9"
Jul 09 15:05:36.824597 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:36.824553    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-sqdx9" podStartSLOduration=1.625378167 podStartE2EDuration="6.824537871s" totalImagesPullingTime="5.199159704s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:05:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:05:36.822996576 +0000 UTC m=+644.665529509" watchObservedRunningTime="2026-07-09 15:05:36.824537871 +0000 UTC m=+644.667070802"
Jul 09 15:05:41.127249 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:41.127209    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:05:41.226827 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:41.226786    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:05:41.342384 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:41.342331    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:05:41.434457 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:41.434417    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:05:43.200045 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:43.200010    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:05:43.299957 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:43.299921    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:05:47.811132 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:47.811101    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-sqdx9"
Jul 09 15:05:50.936073 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:50.936037    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-sqdx9"]
Jul 09 15:05:50.936540 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:50.936229    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-sqdx9" podUID="0f4e52cb-1f74-4985-9295-a0a1fb9e804e" containerName="limitador" containerID="cri-o://3f91425a433bf4877b09e686b4e2afe919667bcc9944cfd4efb0fd3aa10499f9" gracePeriod=30
Jul 09 15:05:51.518256 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:51.518230    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-sqdx9"
Jul 09 15:05:51.609894 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:51.609860    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0f4e52cb-1f74-4985-9295-a0a1fb9e804e-config-file\") pod \"0f4e52cb-1f74-4985-9295-a0a1fb9e804e\" (UID: \"0f4e52cb-1f74-4985-9295-a0a1fb9e804e\") "
Jul 09 15:05:51.609894 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:51.609899    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v8jbw\" (UniqueName: \"kubernetes.io/projected/0f4e52cb-1f74-4985-9295-a0a1fb9e804e-kube-api-access-v8jbw\") pod \"0f4e52cb-1f74-4985-9295-a0a1fb9e804e\" (UID: \"0f4e52cb-1f74-4985-9295-a0a1fb9e804e\") "
Jul 09 15:05:51.610240 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:51.610218    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f4e52cb-1f74-4985-9295-a0a1fb9e804e-config-file" (OuterVolumeSpecName: "config-file") pod "0f4e52cb-1f74-4985-9295-a0a1fb9e804e" (UID: "0f4e52cb-1f74-4985-9295-a0a1fb9e804e"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 15:05:51.611942 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:51.611916    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f4e52cb-1f74-4985-9295-a0a1fb9e804e-kube-api-access-v8jbw" (OuterVolumeSpecName: "kube-api-access-v8jbw") pod "0f4e52cb-1f74-4985-9295-a0a1fb9e804e" (UID: "0f4e52cb-1f74-4985-9295-a0a1fb9e804e"). InnerVolumeSpecName "kube-api-access-v8jbw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:05:51.711095 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:51.711054    2575 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0f4e52cb-1f74-4985-9295-a0a1fb9e804e-config-file\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:05:51.711095 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:51.711090    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v8jbw\" (UniqueName: \"kubernetes.io/projected/0f4e52cb-1f74-4985-9295-a0a1fb9e804e-kube-api-access-v8jbw\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:05:51.877294 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:51.877198    2575 generic.go:356] "Generic (PLEG): container finished" podID="0f4e52cb-1f74-4985-9295-a0a1fb9e804e" containerID="3f91425a433bf4877b09e686b4e2afe919667bcc9944cfd4efb0fd3aa10499f9" exitCode=0
Jul 09 15:05:51.877294 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:51.877235    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-sqdx9"
Jul 09 15:05:51.877294 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:51.877286    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-sqdx9" event={"ID":"0f4e52cb-1f74-4985-9295-a0a1fb9e804e","Type":"ContainerDied","Data":"3f91425a433bf4877b09e686b4e2afe919667bcc9944cfd4efb0fd3aa10499f9"}
Jul 09 15:05:51.877534 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:51.877334    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-sqdx9" event={"ID":"0f4e52cb-1f74-4985-9295-a0a1fb9e804e","Type":"ContainerDied","Data":"4db6466282ac242edbfc31d9561acb0bb76d7dd1d6ac04e05147568bdf092e88"}
Jul 09 15:05:51.877534 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:51.877356    2575 scope.go:117] "RemoveContainer" containerID="3f91425a433bf4877b09e686b4e2afe919667bcc9944cfd4efb0fd3aa10499f9"
Jul 09 15:05:51.885889 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:51.885871    2575 scope.go:117] "RemoveContainer" containerID="3f91425a433bf4877b09e686b4e2afe919667bcc9944cfd4efb0fd3aa10499f9"
Jul 09 15:05:51.886125 ip-10-0-137-94 kubenswrapper[2575]: E0709 15:05:51.886105    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f91425a433bf4877b09e686b4e2afe919667bcc9944cfd4efb0fd3aa10499f9\": container with ID starting with 3f91425a433bf4877b09e686b4e2afe919667bcc9944cfd4efb0fd3aa10499f9 not found: ID does not exist" containerID="3f91425a433bf4877b09e686b4e2afe919667bcc9944cfd4efb0fd3aa10499f9"
Jul 09 15:05:51.886165 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:51.886133    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f91425a433bf4877b09e686b4e2afe919667bcc9944cfd4efb0fd3aa10499f9"} err="failed to get container status \"3f91425a433bf4877b09e686b4e2afe919667bcc9944cfd4efb0fd3aa10499f9\": rpc error: code = NotFound desc = could not find container \"3f91425a433bf4877b09e686b4e2afe919667bcc9944cfd4efb0fd3aa10499f9\": container with ID starting with 3f91425a433bf4877b09e686b4e2afe919667bcc9944cfd4efb0fd3aa10499f9 not found: ID does not exist"
Jul 09 15:05:51.898516 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:51.898491    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-sqdx9"]
Jul 09 15:05:51.902647 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:51.902625    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-sqdx9"]
Jul 09 15:05:52.073084 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:52.073048    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:05:52.290458 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:52.290428    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:05:52.446070 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:52.446033    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-k4pfk"]
Jul 09 15:05:52.446454 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:52.446434    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f4e52cb-1f74-4985-9295-a0a1fb9e804e" containerName="limitador"
Jul 09 15:05:52.446454 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:52.446452    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f4e52cb-1f74-4985-9295-a0a1fb9e804e" containerName="limitador"
Jul 09 15:05:52.446603 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:52.446509    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f4e52cb-1f74-4985-9295-a0a1fb9e804e" containerName="limitador"
Jul 09 15:05:52.451042 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:52.451020    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-k4pfk"
Jul 09 15:05:52.455285 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:52.455265    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 09 15:05:52.456662 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:52.456535    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 09 15:05:52.456787 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:52.456729    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 09 15:05:52.456945 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:52.456920    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-jwkq5\""
Jul 09 15:05:52.459643 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:52.459510    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-k4pfk"]
Jul 09 15:05:52.501570 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:52.501538    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:05:52.517828 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:52.517803    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xc99b\" (UniqueName: \"kubernetes.io/projected/255f66f0-5b8a-4ab5-ba7e-9b8c20afaa6a-kube-api-access-xc99b\") pod \"postgres-69fb4594cf-k4pfk\" (UID: \"255f66f0-5b8a-4ab5-ba7e-9b8c20afaa6a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-k4pfk"
Jul 09 15:05:52.517941 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:52.517834    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/255f66f0-5b8a-4ab5-ba7e-9b8c20afaa6a-data\") pod \"postgres-69fb4594cf-k4pfk\" (UID: \"255f66f0-5b8a-4ab5-ba7e-9b8c20afaa6a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-k4pfk"
Jul 09 15:05:52.619198 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:52.619120    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xc99b\" (UniqueName: \"kubernetes.io/projected/255f66f0-5b8a-4ab5-ba7e-9b8c20afaa6a-kube-api-access-xc99b\") pod \"postgres-69fb4594cf-k4pfk\" (UID: \"255f66f0-5b8a-4ab5-ba7e-9b8c20afaa6a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-k4pfk"
Jul 09 15:05:52.619198 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:52.619168    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/255f66f0-5b8a-4ab5-ba7e-9b8c20afaa6a-data\") pod \"postgres-69fb4594cf-k4pfk\" (UID: \"255f66f0-5b8a-4ab5-ba7e-9b8c20afaa6a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-k4pfk"
Jul 09 15:05:52.619469 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:52.619446    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/255f66f0-5b8a-4ab5-ba7e-9b8c20afaa6a-data\") pod \"postgres-69fb4594cf-k4pfk\" (UID: \"255f66f0-5b8a-4ab5-ba7e-9b8c20afaa6a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-k4pfk"
Jul 09 15:05:52.629573 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:52.629549    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 09 15:05:52.639718 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:52.639695    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 09 15:05:52.650250 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:52.650226    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xc99b\" (UniqueName: \"kubernetes.io/projected/255f66f0-5b8a-4ab5-ba7e-9b8c20afaa6a-kube-api-access-xc99b\") pod \"postgres-69fb4594cf-k4pfk\" (UID: \"255f66f0-5b8a-4ab5-ba7e-9b8c20afaa6a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-k4pfk"
Jul 09 15:05:52.767259 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:52.767228    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-jwkq5\""
Jul 09 15:05:52.774029 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:52.773999    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-k4pfk"
Jul 09 15:05:52.908521 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:52.908488    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-k4pfk"]
Jul 09 15:05:52.911887 ip-10-0-137-94 kubenswrapper[2575]: W0709 15:05:52.911858    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod255f66f0_5b8a_4ab5_ba7e_9b8c20afaa6a.slice/crio-fee4a8fc1707d307839f91f536b0571919b7a37961e8ad1fc4c5612f20c3691b WatchSource:0}: Error finding container fee4a8fc1707d307839f91f536b0571919b7a37961e8ad1fc4c5612f20c3691b: Status 404 returned error can't find the container with id fee4a8fc1707d307839f91f536b0571919b7a37961e8ad1fc4c5612f20c3691b
Jul 09 15:05:53.316163 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:53.316087    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f4e52cb-1f74-4985-9295-a0a1fb9e804e" path="/var/lib/kubelet/pods/0f4e52cb-1f74-4985-9295-a0a1fb9e804e/volumes"
Jul 09 15:05:53.890875 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:53.890834    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-k4pfk" event={"ID":"255f66f0-5b8a-4ab5-ba7e-9b8c20afaa6a","Type":"ContainerStarted","Data":"fee4a8fc1707d307839f91f536b0571919b7a37961e8ad1fc4c5612f20c3691b"}
Jul 09 15:05:57.639463 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:57.639442    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 09 15:05:57.916332 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:57.916243    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-k4pfk" event={"ID":"255f66f0-5b8a-4ab5-ba7e-9b8c20afaa6a","Type":"ContainerStarted","Data":"ab349de51745d3357fd26b45e89b1189a55f51a982cfb651f025ad316ab40e4e"}
Jul 09 15:05:57.916497 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:57.916336    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-k4pfk"
Jul 09 15:05:57.934393 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:05:57.934343    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-k4pfk" podStartSLOduration=1.21073046 podStartE2EDuration="5.93432914s" totalImagesPullingTime="4.72359868s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:05:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:05:57.932343594 +0000 UTC m=+665.774876526" watchObservedRunningTime="2026-07-09 15:05:57.93432914 +0000 UTC m=+665.776862114"
Jul 09 15:06:03.950830 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:03.950798    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-k4pfk"
Jul 09 15:06:06.373334 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:06.373297    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:06:06.461973 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:06.461929    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:06:09.835060 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:09.835022    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:06:09.842767 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:09.842744    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7dff4b9896-nqw2v"]
Jul 09 15:06:09.848740 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:09.848703    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7dff4b9896-nqw2v"
Jul 09 15:06:09.851320 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:09.851299    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 09 15:06:09.851533 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:09.851511    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-btvm9\""
Jul 09 15:06:09.851871 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:09.851852    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 09 15:06:09.858172 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:09.858150    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7dff4b9896-nqw2v"]
Jul 09 15:06:09.932929 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:09.932898    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:06:09.971622 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:09.971595    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8a4b506d-5479-4b79-ba4e-e250852a930e-webhook-cert\") pod \"maas-controller-7dff4b9896-nqw2v\" (UID: \"8a4b506d-5479-4b79-ba4e-e250852a930e\") " pod="opendatahub/maas-controller-7dff4b9896-nqw2v"
Jul 09 15:06:09.971837 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:09.971700    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j294b\" (UniqueName: \"kubernetes.io/projected/8a4b506d-5479-4b79-ba4e-e250852a930e-kube-api-access-j294b\") pod \"maas-controller-7dff4b9896-nqw2v\" (UID: \"8a4b506d-5479-4b79-ba4e-e250852a930e\") " pod="opendatahub/maas-controller-7dff4b9896-nqw2v"
Jul 09 15:06:10.019889 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:10.019857    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-79d77fd896-mnzfc"]
Jul 09 15:06:10.023917 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:10.023898    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79d77fd896-mnzfc"
Jul 09 15:06:10.034824 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:10.034800    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-79d77fd896-mnzfc"]
Jul 09 15:06:10.072172 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:10.072139    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8a4b506d-5479-4b79-ba4e-e250852a930e-webhook-cert\") pod \"maas-controller-7dff4b9896-nqw2v\" (UID: \"8a4b506d-5479-4b79-ba4e-e250852a930e\") " pod="opendatahub/maas-controller-7dff4b9896-nqw2v"
Jul 09 15:06:10.072172 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:10.072176    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7nfb\" (UniqueName: \"kubernetes.io/projected/2c405838-dac2-46b5-b583-5d722dc0b4af-kube-api-access-m7nfb\") pod \"maas-controller-79d77fd896-mnzfc\" (UID: \"2c405838-dac2-46b5-b583-5d722dc0b4af\") " pod="opendatahub/maas-controller-79d77fd896-mnzfc"
Jul 09 15:06:10.072345 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:10.072241    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j294b\" (UniqueName: \"kubernetes.io/projected/8a4b506d-5479-4b79-ba4e-e250852a930e-kube-api-access-j294b\") pod \"maas-controller-7dff4b9896-nqw2v\" (UID: \"8a4b506d-5479-4b79-ba4e-e250852a930e\") " pod="opendatahub/maas-controller-7dff4b9896-nqw2v"
Jul 09 15:06:10.072345 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:10.072283    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2c405838-dac2-46b5-b583-5d722dc0b4af-webhook-cert\") pod \"maas-controller-79d77fd896-mnzfc\" (UID: \"2c405838-dac2-46b5-b583-5d722dc0b4af\") " pod="opendatahub/maas-controller-79d77fd896-mnzfc"
Jul 09 15:06:10.072345 ip-10-0-137-94 kubenswrapper[2575]: E0709 15:06:10.072291    2575 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 09 15:06:10.072446 ip-10-0-137-94 kubenswrapper[2575]: E0709 15:06:10.072382    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a4b506d-5479-4b79-ba4e-e250852a930e-webhook-cert podName:8a4b506d-5479-4b79-ba4e-e250852a930e nodeName:}" failed. No retries permitted until 2026-07-09 15:06:10.572364637 +0000 UTC m=+678.414897547 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/8a4b506d-5479-4b79-ba4e-e250852a930e-webhook-cert") pod "maas-controller-7dff4b9896-nqw2v" (UID: "8a4b506d-5479-4b79-ba4e-e250852a930e") : secret "maas-controller-webhook-cert" not found
Jul 09 15:06:10.083241 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:10.083214    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j294b\" (UniqueName: \"kubernetes.io/projected/8a4b506d-5479-4b79-ba4e-e250852a930e-kube-api-access-j294b\") pod \"maas-controller-7dff4b9896-nqw2v\" (UID: \"8a4b506d-5479-4b79-ba4e-e250852a930e\") " pod="opendatahub/maas-controller-7dff4b9896-nqw2v"
Jul 09 15:06:10.173335 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:10.173302    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2c405838-dac2-46b5-b583-5d722dc0b4af-webhook-cert\") pod \"maas-controller-79d77fd896-mnzfc\" (UID: \"2c405838-dac2-46b5-b583-5d722dc0b4af\") " pod="opendatahub/maas-controller-79d77fd896-mnzfc"
Jul 09 15:06:10.173501 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:10.173369    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7nfb\" (UniqueName: \"kubernetes.io/projected/2c405838-dac2-46b5-b583-5d722dc0b4af-kube-api-access-m7nfb\") pod \"maas-controller-79d77fd896-mnzfc\" (UID: \"2c405838-dac2-46b5-b583-5d722dc0b4af\") " pod="opendatahub/maas-controller-79d77fd896-mnzfc"
Jul 09 15:06:10.173501 ip-10-0-137-94 kubenswrapper[2575]: E0709 15:06:10.173459    2575 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 09 15:06:10.173580 ip-10-0-137-94 kubenswrapper[2575]: E0709 15:06:10.173518    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c405838-dac2-46b5-b583-5d722dc0b4af-webhook-cert podName:2c405838-dac2-46b5-b583-5d722dc0b4af nodeName:}" failed. No retries permitted until 2026-07-09 15:06:10.673504449 +0000 UTC m=+678.516037359 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/2c405838-dac2-46b5-b583-5d722dc0b4af-webhook-cert") pod "maas-controller-79d77fd896-mnzfc" (UID: "2c405838-dac2-46b5-b583-5d722dc0b4af") : secret "maas-controller-webhook-cert" not found
Jul 09 15:06:10.182503 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:10.182470    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7nfb\" (UniqueName: \"kubernetes.io/projected/2c405838-dac2-46b5-b583-5d722dc0b4af-kube-api-access-m7nfb\") pod \"maas-controller-79d77fd896-mnzfc\" (UID: \"2c405838-dac2-46b5-b583-5d722dc0b4af\") " pod="opendatahub/maas-controller-79d77fd896-mnzfc"
Jul 09 15:06:10.198127 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:10.198100    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:06:10.428207 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:10.428125    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:06:10.577342 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:10.577307    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8a4b506d-5479-4b79-ba4e-e250852a930e-webhook-cert\") pod \"maas-controller-7dff4b9896-nqw2v\" (UID: \"8a4b506d-5479-4b79-ba4e-e250852a930e\") " pod="opendatahub/maas-controller-7dff4b9896-nqw2v"
Jul 09 15:06:10.579761 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:10.579733    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8a4b506d-5479-4b79-ba4e-e250852a930e-webhook-cert\") pod \"maas-controller-7dff4b9896-nqw2v\" (UID: \"8a4b506d-5479-4b79-ba4e-e250852a930e\") " pod="opendatahub/maas-controller-7dff4b9896-nqw2v"
Jul 09 15:06:10.678000 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:10.677961    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2c405838-dac2-46b5-b583-5d722dc0b4af-webhook-cert\") pod \"maas-controller-79d77fd896-mnzfc\" (UID: \"2c405838-dac2-46b5-b583-5d722dc0b4af\") " pod="opendatahub/maas-controller-79d77fd896-mnzfc"
Jul 09 15:06:10.680407 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:10.680358    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2c405838-dac2-46b5-b583-5d722dc0b4af-webhook-cert\") pod \"maas-controller-79d77fd896-mnzfc\" (UID: \"2c405838-dac2-46b5-b583-5d722dc0b4af\") " pod="opendatahub/maas-controller-79d77fd896-mnzfc"
Jul 09 15:06:10.759217 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:10.759181    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7dff4b9896-nqw2v"
Jul 09 15:06:10.904319 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:10.904290    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7dff4b9896-nqw2v"]
Jul 09 15:06:10.905570 ip-10-0-137-94 kubenswrapper[2575]: W0709 15:06:10.905545    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a4b506d_5479_4b79_ba4e_e250852a930e.slice/crio-c9f5f1457c5a9640422e1d4ff912c9b315e0043a9b2e6de58f872b2555dd1393 WatchSource:0}: Error finding container c9f5f1457c5a9640422e1d4ff912c9b315e0043a9b2e6de58f872b2555dd1393: Status 404 returned error can't find the container with id c9f5f1457c5a9640422e1d4ff912c9b315e0043a9b2e6de58f872b2555dd1393
Jul 09 15:06:10.934259 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:10.934207    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79d77fd896-mnzfc"
Jul 09 15:06:10.980115 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:10.980079    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7dff4b9896-nqw2v" event={"ID":"8a4b506d-5479-4b79-ba4e-e250852a930e","Type":"ContainerStarted","Data":"c9f5f1457c5a9640422e1d4ff912c9b315e0043a9b2e6de58f872b2555dd1393"}
Jul 09 15:06:11.062538 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:11.062514    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-79d77fd896-mnzfc"]
Jul 09 15:06:11.064129 ip-10-0-137-94 kubenswrapper[2575]: W0709 15:06:11.064102    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c405838_dac2_46b5_b583_5d722dc0b4af.slice/crio-84c1fefab2b0247f2d9cf9ae1090be0260982e2f0fdb34f91ce8933ba8ddd81d WatchSource:0}: Error finding container 84c1fefab2b0247f2d9cf9ae1090be0260982e2f0fdb34f91ce8933ba8ddd81d: Status 404 returned error can't find the container with id 84c1fefab2b0247f2d9cf9ae1090be0260982e2f0fdb34f91ce8933ba8ddd81d
Jul 09 15:06:12.009251 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:12.009202    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79d77fd896-mnzfc" event={"ID":"2c405838-dac2-46b5-b583-5d722dc0b4af","Type":"ContainerStarted","Data":"84c1fefab2b0247f2d9cf9ae1090be0260982e2f0fdb34f91ce8933ba8ddd81d"}
Jul 09 15:06:13.785552 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:13.785465    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:06:13.967721 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:13.967667    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:06:14.024068 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:14.024034    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7dff4b9896-nqw2v" event={"ID":"8a4b506d-5479-4b79-ba4e-e250852a930e","Type":"ContainerStarted","Data":"99537027c022209c2813ab4a9960354871f56c2924e8647b4ebc35aa6efdbae7"}
Jul 09 15:06:14.024265 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:14.024186    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7dff4b9896-nqw2v"
Jul 09 15:06:14.025611 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:14.025590    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79d77fd896-mnzfc" event={"ID":"2c405838-dac2-46b5-b583-5d722dc0b4af","Type":"ContainerStarted","Data":"5e6f95f3fbc9796e0b7a2a11b33a0fea7d0cbb049f00be18946c8464c1e10ac3"}
Jul 09 15:06:14.025738 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:14.025673    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-79d77fd896-mnzfc"
Jul 09 15:06:14.080131 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:14.080040    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7dff4b9896-nqw2v" podStartSLOduration=2.45308059 podStartE2EDuration="5.080026476s" totalImagesPullingTime="2.626945886s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:06:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:06:14.077316051 +0000 UTC m=+681.919848995" watchObservedRunningTime="2026-07-09 15:06:14.080026476 +0000 UTC m=+681.922559400"
Jul 09 15:06:14.129952 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:14.129894    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-79d77fd896-mnzfc" podStartSLOduration=1.657704566 podStartE2EDuration="4.129873079s" totalImagesPullingTime="2.472168513s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:06:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:06:14.126627699 +0000 UTC m=+681.969160632" watchObservedRunningTime="2026-07-09 15:06:14.129873079 +0000 UTC m=+681.972406011"
Jul 09 15:06:25.037135 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:25.037103    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7dff4b9896-nqw2v"
Jul 09 15:06:25.037622 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:25.037190    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-79d77fd896-mnzfc"
Jul 09 15:06:25.120356 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:25.120320    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7dff4b9896-nqw2v"]
Jul 09 15:06:25.120554 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:25.120527    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7dff4b9896-nqw2v" podUID="8a4b506d-5479-4b79-ba4e-e250852a930e" containerName="manager" containerID="cri-o://99537027c022209c2813ab4a9960354871f56c2924e8647b4ebc35aa6efdbae7" gracePeriod=30
Jul 09 15:06:25.369333 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:25.369307    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7dff4b9896-nqw2v"
Jul 09 15:06:25.521305 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:25.521267    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8a4b506d-5479-4b79-ba4e-e250852a930e-webhook-cert\") pod \"8a4b506d-5479-4b79-ba4e-e250852a930e\" (UID: \"8a4b506d-5479-4b79-ba4e-e250852a930e\") "
Jul 09 15:06:25.521497 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:25.521323    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j294b\" (UniqueName: \"kubernetes.io/projected/8a4b506d-5479-4b79-ba4e-e250852a930e-kube-api-access-j294b\") pod \"8a4b506d-5479-4b79-ba4e-e250852a930e\" (UID: \"8a4b506d-5479-4b79-ba4e-e250852a930e\") "
Jul 09 15:06:25.523514 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:25.523477    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a4b506d-5479-4b79-ba4e-e250852a930e-kube-api-access-j294b" (OuterVolumeSpecName: "kube-api-access-j294b") pod "8a4b506d-5479-4b79-ba4e-e250852a930e" (UID: "8a4b506d-5479-4b79-ba4e-e250852a930e"). InnerVolumeSpecName "kube-api-access-j294b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:06:25.523624 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:25.523488    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a4b506d-5479-4b79-ba4e-e250852a930e-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "8a4b506d-5479-4b79-ba4e-e250852a930e" (UID: "8a4b506d-5479-4b79-ba4e-e250852a930e"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 15:06:25.622178 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:25.622105    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j294b\" (UniqueName: \"kubernetes.io/projected/8a4b506d-5479-4b79-ba4e-e250852a930e-kube-api-access-j294b\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:06:25.622178 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:25.622132    2575 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8a4b506d-5479-4b79-ba4e-e250852a930e-webhook-cert\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:06:26.084830 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:26.084794    2575 generic.go:356] "Generic (PLEG): container finished" podID="8a4b506d-5479-4b79-ba4e-e250852a930e" containerID="99537027c022209c2813ab4a9960354871f56c2924e8647b4ebc35aa6efdbae7" exitCode=0
Jul 09 15:06:26.084830 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:26.084835    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7dff4b9896-nqw2v"
Jul 09 15:06:26.085329 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:26.084876    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7dff4b9896-nqw2v" event={"ID":"8a4b506d-5479-4b79-ba4e-e250852a930e","Type":"ContainerDied","Data":"99537027c022209c2813ab4a9960354871f56c2924e8647b4ebc35aa6efdbae7"}
Jul 09 15:06:26.085329 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:26.084924    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7dff4b9896-nqw2v" event={"ID":"8a4b506d-5479-4b79-ba4e-e250852a930e","Type":"ContainerDied","Data":"c9f5f1457c5a9640422e1d4ff912c9b315e0043a9b2e6de58f872b2555dd1393"}
Jul 09 15:06:26.085329 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:26.084947    2575 scope.go:117] "RemoveContainer" containerID="99537027c022209c2813ab4a9960354871f56c2924e8647b4ebc35aa6efdbae7"
Jul 09 15:06:26.096221 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:26.096204    2575 scope.go:117] "RemoveContainer" containerID="99537027c022209c2813ab4a9960354871f56c2924e8647b4ebc35aa6efdbae7"
Jul 09 15:06:26.096475 ip-10-0-137-94 kubenswrapper[2575]: E0709 15:06:26.096455    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99537027c022209c2813ab4a9960354871f56c2924e8647b4ebc35aa6efdbae7\": container with ID starting with 99537027c022209c2813ab4a9960354871f56c2924e8647b4ebc35aa6efdbae7 not found: ID does not exist" containerID="99537027c022209c2813ab4a9960354871f56c2924e8647b4ebc35aa6efdbae7"
Jul 09 15:06:26.096540 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:26.096487    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99537027c022209c2813ab4a9960354871f56c2924e8647b4ebc35aa6efdbae7"} err="failed to get container status \"99537027c022209c2813ab4a9960354871f56c2924e8647b4ebc35aa6efdbae7\": rpc error: code = NotFound desc = could not find container \"99537027c022209c2813ab4a9960354871f56c2924e8647b4ebc35aa6efdbae7\": container with ID starting with 99537027c022209c2813ab4a9960354871f56c2924e8647b4ebc35aa6efdbae7 not found: ID does not exist"
Jul 09 15:06:26.108795 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:26.108763    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7dff4b9896-nqw2v"]
Jul 09 15:06:26.112979 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:26.112958    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7dff4b9896-nqw2v"]
Jul 09 15:06:27.316175 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:27.316143    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a4b506d-5479-4b79-ba4e-e250852a930e" path="/var/lib/kubelet/pods/8a4b506d-5479-4b79-ba4e-e250852a930e/volumes"
Jul 09 15:06:45.235112 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:45.235012    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:06:45.845917 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:45.845874    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-79fc58f8b5-p6md8"]
Jul 09 15:06:45.846367 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:45.846350    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a4b506d-5479-4b79-ba4e-e250852a930e" containerName="manager"
Jul 09 15:06:45.846367 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:45.846369    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a4b506d-5479-4b79-ba4e-e250852a930e" containerName="manager"
Jul 09 15:06:45.846523 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:45.846443    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a4b506d-5479-4b79-ba4e-e250852a930e" containerName="manager"
Jul 09 15:06:45.870751 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:45.870697    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-79fc58f8b5-p6md8"]
Jul 09 15:06:45.870876 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:45.870823    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-79fc58f8b5-p6md8"
Jul 09 15:06:45.874596 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:45.874566    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 09 15:06:45.874749 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:45.874652    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-vtct2\""
Jul 09 15:06:45.985352 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:45.985316    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pz4dj\" (UniqueName: \"kubernetes.io/projected/20adf977-ca07-4da2-9e7f-e9a7203eda39-kube-api-access-pz4dj\") pod \"maas-api-79fc58f8b5-p6md8\" (UID: \"20adf977-ca07-4da2-9e7f-e9a7203eda39\") " pod="odh-ai-gateway-infra/maas-api-79fc58f8b5-p6md8"
Jul 09 15:06:45.985532 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:45.985365    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/20adf977-ca07-4da2-9e7f-e9a7203eda39-maas-api-tls\") pod \"maas-api-79fc58f8b5-p6md8\" (UID: \"20adf977-ca07-4da2-9e7f-e9a7203eda39\") " pod="odh-ai-gateway-infra/maas-api-79fc58f8b5-p6md8"
Jul 09 15:06:45.985532 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:45.985430    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/20adf977-ca07-4da2-9e7f-e9a7203eda39-openshift-service-ca\") pod \"maas-api-79fc58f8b5-p6md8\" (UID: \"20adf977-ca07-4da2-9e7f-e9a7203eda39\") " pod="odh-ai-gateway-infra/maas-api-79fc58f8b5-p6md8"
Jul 09 15:06:46.085872 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:46.085841    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pz4dj\" (UniqueName: \"kubernetes.io/projected/20adf977-ca07-4da2-9e7f-e9a7203eda39-kube-api-access-pz4dj\") pod \"maas-api-79fc58f8b5-p6md8\" (UID: \"20adf977-ca07-4da2-9e7f-e9a7203eda39\") " pod="odh-ai-gateway-infra/maas-api-79fc58f8b5-p6md8"
Jul 09 15:06:46.086023 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:46.085879    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/20adf977-ca07-4da2-9e7f-e9a7203eda39-maas-api-tls\") pod \"maas-api-79fc58f8b5-p6md8\" (UID: \"20adf977-ca07-4da2-9e7f-e9a7203eda39\") " pod="odh-ai-gateway-infra/maas-api-79fc58f8b5-p6md8"
Jul 09 15:06:46.086023 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:46.085904    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/20adf977-ca07-4da2-9e7f-e9a7203eda39-openshift-service-ca\") pod \"maas-api-79fc58f8b5-p6md8\" (UID: \"20adf977-ca07-4da2-9e7f-e9a7203eda39\") " pod="odh-ai-gateway-infra/maas-api-79fc58f8b5-p6md8"
Jul 09 15:06:46.086451 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:46.086433    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/20adf977-ca07-4da2-9e7f-e9a7203eda39-openshift-service-ca\") pod \"maas-api-79fc58f8b5-p6md8\" (UID: \"20adf977-ca07-4da2-9e7f-e9a7203eda39\") " pod="odh-ai-gateway-infra/maas-api-79fc58f8b5-p6md8"
Jul 09 15:06:46.088276 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:46.088255    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/20adf977-ca07-4da2-9e7f-e9a7203eda39-maas-api-tls\") pod \"maas-api-79fc58f8b5-p6md8\" (UID: \"20adf977-ca07-4da2-9e7f-e9a7203eda39\") " pod="odh-ai-gateway-infra/maas-api-79fc58f8b5-p6md8"
Jul 09 15:06:46.094844 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:46.094821    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pz4dj\" (UniqueName: \"kubernetes.io/projected/20adf977-ca07-4da2-9e7f-e9a7203eda39-kube-api-access-pz4dj\") pod \"maas-api-79fc58f8b5-p6md8\" (UID: \"20adf977-ca07-4da2-9e7f-e9a7203eda39\") " pod="odh-ai-gateway-infra/maas-api-79fc58f8b5-p6md8"
Jul 09 15:06:46.180698 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:46.180672    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-79fc58f8b5-p6md8"
Jul 09 15:06:46.324920 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:46.324890    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-79fc58f8b5-p6md8"]
Jul 09 15:06:46.326079 ip-10-0-137-94 kubenswrapper[2575]: W0709 15:06:46.326037    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20adf977_ca07_4da2_9e7f_e9a7203eda39.slice/crio-c214f1be486aafe7154515840201a9720b90cbf2282c9680005370bc6bda7099 WatchSource:0}: Error finding container c214f1be486aafe7154515840201a9720b90cbf2282c9680005370bc6bda7099: Status 404 returned error can't find the container with id c214f1be486aafe7154515840201a9720b90cbf2282c9680005370bc6bda7099
Jul 09 15:06:46.327794 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:46.327777    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 15:06:46.544296 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:46.544219    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-qx6fv"]
Jul 09 15:06:46.549018 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:46.548999    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-qx6fv"
Jul 09 15:06:46.551986 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:46.551962    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 09 15:06:46.552292 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:46.552275    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-b7b8w\""
Jul 09 15:06:46.557263 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:46.557240    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-qx6fv"]
Jul 09 15:06:46.591679 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:46.591647    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/122b7856-6300-4e91-92e9-9fc7555df6ce-plugins-config-volume\") pod \"payload-pre-processing-7964457696-qx6fv\" (UID: \"122b7856-6300-4e91-92e9-9fc7555df6ce\") " pod="openshift-ingress/payload-pre-processing-7964457696-qx6fv"
Jul 09 15:06:46.591856 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:46.591766    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96npc\" (UniqueName: \"kubernetes.io/projected/122b7856-6300-4e91-92e9-9fc7555df6ce-kube-api-access-96npc\") pod \"payload-pre-processing-7964457696-qx6fv\" (UID: \"122b7856-6300-4e91-92e9-9fc7555df6ce\") " pod="openshift-ingress/payload-pre-processing-7964457696-qx6fv"
Jul 09 15:06:46.693202 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:46.693161    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/122b7856-6300-4e91-92e9-9fc7555df6ce-plugins-config-volume\") pod \"payload-pre-processing-7964457696-qx6fv\" (UID: \"122b7856-6300-4e91-92e9-9fc7555df6ce\") " pod="openshift-ingress/payload-pre-processing-7964457696-qx6fv"
Jul 09 15:06:46.693383 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:46.693246    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96npc\" (UniqueName: \"kubernetes.io/projected/122b7856-6300-4e91-92e9-9fc7555df6ce-kube-api-access-96npc\") pod \"payload-pre-processing-7964457696-qx6fv\" (UID: \"122b7856-6300-4e91-92e9-9fc7555df6ce\") " pod="openshift-ingress/payload-pre-processing-7964457696-qx6fv"
Jul 09 15:06:46.693987 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:46.693964    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/122b7856-6300-4e91-92e9-9fc7555df6ce-plugins-config-volume\") pod \"payload-pre-processing-7964457696-qx6fv\" (UID: \"122b7856-6300-4e91-92e9-9fc7555df6ce\") " pod="openshift-ingress/payload-pre-processing-7964457696-qx6fv"
Jul 09 15:06:46.709843 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:46.709814    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-96npc\" (UniqueName: \"kubernetes.io/projected/122b7856-6300-4e91-92e9-9fc7555df6ce-kube-api-access-96npc\") pod \"payload-pre-processing-7964457696-qx6fv\" (UID: \"122b7856-6300-4e91-92e9-9fc7555df6ce\") " pod="openshift-ingress/payload-pre-processing-7964457696-qx6fv"
Jul 09 15:06:46.861133 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:46.861045    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-qx6fv"
Jul 09 15:06:46.997138 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:46.997106    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-qx6fv"]
Jul 09 15:06:46.998437 ip-10-0-137-94 kubenswrapper[2575]: W0709 15:06:46.998410    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod122b7856_6300_4e91_92e9_9fc7555df6ce.slice/crio-bd0fde4d434e32ca3459dbef5b377a0d46b1fedf75a0dce9eb754471c03f52a2 WatchSource:0}: Error finding container bd0fde4d434e32ca3459dbef5b377a0d46b1fedf75a0dce9eb754471c03f52a2: Status 404 returned error can't find the container with id bd0fde4d434e32ca3459dbef5b377a0d46b1fedf75a0dce9eb754471c03f52a2
Jul 09 15:06:47.187694 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:47.187662    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-79fc58f8b5-p6md8" event={"ID":"20adf977-ca07-4da2-9e7f-e9a7203eda39","Type":"ContainerStarted","Data":"c214f1be486aafe7154515840201a9720b90cbf2282c9680005370bc6bda7099"}
Jul 09 15:06:47.188768 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:47.188734    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-qx6fv" event={"ID":"122b7856-6300-4e91-92e9-9fc7555df6ce","Type":"ContainerStarted","Data":"bd0fde4d434e32ca3459dbef5b377a0d46b1fedf75a0dce9eb754471c03f52a2"}
Jul 09 15:06:49.864153 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:49.864117    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:06:52.216147 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:52.216088    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-79fc58f8b5-p6md8" event={"ID":"20adf977-ca07-4da2-9e7f-e9a7203eda39","Type":"ContainerStarted","Data":"808433abc616b4e6d5a7249e676abf69ace71c1bdaf9d88efa62d4b43dece040"}
Jul 09 15:06:52.216740 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:52.216700    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-79fc58f8b5-p6md8"
Jul 09 15:06:52.218049 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:52.218020    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-qx6fv" event={"ID":"122b7856-6300-4e91-92e9-9fc7555df6ce","Type":"ContainerStarted","Data":"0b28704da398db5bd8ed89e15d8cc5e3d0f3d628e381374bc739565a3398737e"}
Jul 09 15:06:52.218170 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:52.218078    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-qx6fv"
Jul 09 15:06:52.236697 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:52.236648    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-79fc58f8b5-p6md8" podStartSLOduration=1.828485094 podStartE2EDuration="7.23663484s" totalImagesPullingTime="5.408149746s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:06:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:06:52.235033839 +0000 UTC m=+720.077566770" watchObservedRunningTime="2026-07-09 15:06:52.23663484 +0000 UTC m=+720.079167772"
Jul 09 15:06:52.253069 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:52.253014    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-qx6fv" podStartSLOduration=1.519923262 podStartE2EDuration="6.253001978s" totalImagesPullingTime="4.733078716s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:06:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:06:52.251276492 +0000 UTC m=+720.093809437" watchObservedRunningTime="2026-07-09 15:06:52.253001978 +0000 UTC m=+720.095534963"
Jul 09 15:06:54.229645 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:54.229561    2575 generic.go:356] "Generic (PLEG): container finished" podID="85ae6aa9-f89f-4a61-9630-9f6b2b82910d" containerID="6baf4b432d63ba2c84a8f35caa25c27bf8d9d4f6f5ac22df4eda3546665862b9" exitCode=0
Jul 09 15:06:54.229645 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:54.229610    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mjlqx" event={"ID":"85ae6aa9-f89f-4a61-9630-9f6b2b82910d","Type":"ContainerDied","Data":"6baf4b432d63ba2c84a8f35caa25c27bf8d9d4f6f5ac22df4eda3546665862b9"}
Jul 09 15:06:54.230146 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:54.230008    2575 scope.go:117] "RemoveContainer" containerID="6baf4b432d63ba2c84a8f35caa25c27bf8d9d4f6f5ac22df4eda3546665862b9"
Jul 09 15:06:54.230928 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:54.230899    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 15:06:54.231027 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:54.230984    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 15:06:54.231088 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:54.231033    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 15:06:55.237545 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:55.237512    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mjlqx" event={"ID":"85ae6aa9-f89f-4a61-9630-9f6b2b82910d","Type":"ContainerStarted","Data":"54a87a3a34ea21456564639e5d28e8366c2f20d4b287758af01c42d48b8997c5"}
Jul 09 15:06:55.343360 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:55.343321    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mjlqx"
Jul 09 15:06:55.343570 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:55.343547    2575 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-mjlqx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body=
Jul 09 15:06:55.343623 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:55.343598    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mjlqx" podUID="85ae6aa9-f89f-4a61-9630-9f6b2b82910d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused"
Jul 09 15:06:56.343653 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:56.343612    2575 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-mjlqx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body=
Jul 09 15:06:56.344131 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:56.343672    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mjlqx" podUID="85ae6aa9-f89f-4a61-9630-9f6b2b82910d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused"
Jul 09 15:06:57.344487 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:57.344452    2575 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-mjlqx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body=
Jul 09 15:06:57.344936 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:57.344504    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mjlqx" podUID="85ae6aa9-f89f-4a61-9630-9f6b2b82910d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused"
Jul 09 15:06:58.233099 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:58.233057    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-79fc58f8b5-p6md8"
Jul 09 15:06:58.344360 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:58.344326    2575 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-mjlqx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body=
Jul 09 15:06:58.344529 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:58.344380    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mjlqx" podUID="85ae6aa9-f89f-4a61-9630-9f6b2b82910d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused"
Jul 09 15:06:59.229218 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:59.229163    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:06:59.325109 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:59.325048    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:06:59.347904 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:59.347872    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mjlqx"
Jul 09 15:06:59.348344 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:59.348248    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mjlqx"
Jul 09 15:06:59.348791 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:06:59.348775    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mjlqx"
Jul 09 15:07:03.226303 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:07:03.226273    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-qx6fv"
Jul 09 15:07:04.298196 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:07:04.298158    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g5xmh"]
Jul 09 15:07:04.301820 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:07:04.301801    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g5xmh"
Jul 09 15:07:04.304661 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:07:04.304640    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 09 15:07:04.304808 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:07:04.304640    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 09 15:07:04.305519 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:07:04.305498    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 09 15:07:04.305623 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:07:04.305540    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-x5qqk\""
Jul 09 15:07:04.313227 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:07:04.313202    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g5xmh"]
Jul 09 15:07:04.318755 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:07:04.318733    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:07:04.461701 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:07:04.461669    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0222c564-bc4e-40af-bb50-dff0ac92e796-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g5xmh\" (UID: \"0222c564-bc4e-40af-bb50-dff0ac92e796\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g5xmh"
Jul 09 15:07:04.461874 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:07:04.461744    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98x88\" (UniqueName: \"kubernetes.io/projected/0222c564-bc4e-40af-bb50-dff0ac92e796-kube-api-access-98x88\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g5xmh\" (UID: \"0222c564-bc4e-40af-bb50-dff0ac92e796\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g5xmh"
Jul 09 15:07:04.461874 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:07:04.461778    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0222c564-bc4e-40af-bb50-dff0ac92e796-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g5xmh\" (UID: \"0222c564-bc4e-40af-bb50-dff0ac92e796\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g5xmh"
Jul 09 15:07:04.461874 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:07:04.461804    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0222c564-bc4e-40af-bb50-dff0ac92e796-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g5xmh\" (UID: \"0222c564-bc4e-40af-bb50-dff0ac92e796\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g5xmh"
Jul 09 15:07:04.462015 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:07:04.461910    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0222c564-bc4e-40af-bb50-dff0ac92e796-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g5xmh\" (UID: \"0222c564-bc4e-40af-bb50-dff0ac92e796\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g5xmh"
Jul 09 15:07:04.462015 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:07:04.461976    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0222c564-bc4e-40af-bb50-dff0ac92e796-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g5xmh\" (UID: \"0222c564-bc4e-40af-bb50-dff0ac92e796\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g5xmh"
Jul 09 15:07:04.563134 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:07:04.563039    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0222c564-bc4e-40af-bb50-dff0ac92e796-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g5xmh\" (UID: \"0222c564-bc4e-40af-bb50-dff0ac92e796\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g5xmh"
Jul 09 15:07:04.563134 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:07:04.563097    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0222c564-bc4e-40af-bb50-dff0ac92e796-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g5xmh\" (UID: \"0222c564-bc4e-40af-bb50-dff0ac92e796\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g5xmh"
Jul 09 15:07:04.563368 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:07:04.563145    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0222c564-bc4e-40af-bb50-dff0ac92e796-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g5xmh\" (UID: \"0222c564-bc4e-40af-bb50-dff0ac92e796\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g5xmh"
Jul 09 15:07:04.563368 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:07:04.563179    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98x88\" (UniqueName: \"kubernetes.io/projected/0222c564-bc4e-40af-bb50-dff0ac92e796-kube-api-access-98x88\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g5xmh\" (UID: \"0222c564-bc4e-40af-bb50-dff0ac92e796\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g5xmh"
Jul 09 15:07:04.563368 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:07:04.563243    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0222c564-bc4e-40af-bb50-dff0ac92e796-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g5xmh\" (UID: \"0222c564-bc4e-40af-bb50-dff0ac92e796\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g5xmh"
Jul 09 15:07:04.563368 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:07:04.563279    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0222c564-bc4e-40af-bb50-dff0ac92e796-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g5xmh\" (UID: \"0222c564-bc4e-40af-bb50-dff0ac92e796\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g5xmh"
Jul 09 15:07:04.563692 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:07:04.563659    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0222c564-bc4e-40af-bb50-dff0ac92e796-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g5xmh\" (UID: \"0222c564-bc4e-40af-bb50-dff0ac92e796\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g5xmh"
Jul 09 15:07:04.563692 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:07:04.563682    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0222c564-bc4e-40af-bb50-dff0ac92e796-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g5xmh\" (UID: \"0222c564-bc4e-40af-bb50-dff0ac92e796\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g5xmh"
Jul 09 15:07:04.563905 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:07:04.563755    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0222c564-bc4e-40af-bb50-dff0ac92e796-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g5xmh\" (UID: \"0222c564-bc4e-40af-bb50-dff0ac92e796\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g5xmh"
Jul 09 15:07:04.565520 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:07:04.565491    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0222c564-bc4e-40af-bb50-dff0ac92e796-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g5xmh\" (UID: \"0222c564-bc4e-40af-bb50-dff0ac92e796\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g5xmh"
Jul 09 15:07:04.565889 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:07:04.565870    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0222c564-bc4e-40af-bb50-dff0ac92e796-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g5xmh\" (UID: \"0222c564-bc4e-40af-bb50-dff0ac92e796\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g5xmh"
Jul 09 15:07:04.574743 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:07:04.574721    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-98x88\" (UniqueName: \"kubernetes.io/projected/0222c564-bc4e-40af-bb50-dff0ac92e796-kube-api-access-98x88\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g5xmh\" (UID: \"0222c564-bc4e-40af-bb50-dff0ac92e796\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g5xmh"
Jul 09 15:07:04.612310 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:07:04.612282    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g5xmh"
Jul 09 15:07:04.751444 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:07:04.751415    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g5xmh"]
Jul 09 15:07:04.755000 ip-10-0-137-94 kubenswrapper[2575]: W0709 15:07:04.754974    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0222c564_bc4e_40af_bb50_dff0ac92e796.slice/crio-1cfc1ab708fe4f7f4a781f6a70a0f553c60f0603b9925a1a66f63c679ede7fd8 WatchSource:0}: Error finding container 1cfc1ab708fe4f7f4a781f6a70a0f553c60f0603b9925a1a66f63c679ede7fd8: Status 404 returned error can't find the container with id 1cfc1ab708fe4f7f4a781f6a70a0f553c60f0603b9925a1a66f63c679ede7fd8
Jul 09 15:07:05.295132 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:07:05.295096    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g5xmh" event={"ID":"0222c564-bc4e-40af-bb50-dff0ac92e796","Type":"ContainerStarted","Data":"1cfc1ab708fe4f7f4a781f6a70a0f553c60f0603b9925a1a66f63c679ede7fd8"}
Jul 09 15:07:06.301790 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:07:06.301744    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g5xmh" event={"ID":"0222c564-bc4e-40af-bb50-dff0ac92e796","Type":"ContainerStarted","Data":"e29b7804c54bd34cd0df1fddcac6d7c0d09fe693f2d96c452e5fb2d44a707cab"}
Jul 09 15:07:06.326866 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:07:06.326815    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g5xmh" podStartSLOduration=1.209420819 podStartE2EDuration="2.32679813s" totalImagesPullingTime="1.117377311s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:07:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:07:06.324870689 +0000 UTC m=+734.167403620" watchObservedRunningTime="2026-07-09 15:07:06.32679813 +0000 UTC m=+734.169331061"
Jul 09 15:07:13.069436 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:07:13.069401    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:07:14.613441 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:07:14.613402    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g5xmh"
Jul 09 15:07:14.613833 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:07:14.613465    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g5xmh"
Jul 09 15:07:14.626188 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:07:14.626165    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g5xmh"
Jul 09 15:07:15.355783 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:07:15.355754    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g5xmh"
Jul 09 15:07:24.404134 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:07:24.404096    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:07:33.668075 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:07:33.668038    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkmrqx"]
Jul 09 15:07:33.673217 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:07:33.673197    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkmrqx"
Jul 09 15:07:33.676207 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:07:33.676188    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 09 15:07:33.684126 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:07:33.684104    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkmrqx"]
Jul 09 15:07:33.714164 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:07:33.714129    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ft4w7\" (UniqueName: \"kubernetes.io/projected/f804b172-2790-4ebf-aacb-ecc231bb8033-kube-api-access-ft4w7\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkmrqx\" (UID: \"f804b172-2790-4ebf-aacb-ecc231bb8033\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkmrqx"
Jul 09 15:07:33.714299 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:07:33.714182    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f804b172-2790-4ebf-aacb-ecc231bb8033-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkmrqx\" (UID: \"f804b172-2790-4ebf-aacb-ecc231bb8033\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkmrqx"
Jul 09 15:07:33.714299 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:07:33.714210    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f804b172-2790-4ebf-aacb-ecc231bb8033-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkmrqx\" (UID: \"f804b172-2790-4ebf-aacb-ecc231bb8033\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkmrqx"
Jul 09 15:07:33.714299 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:07:33.714275    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f804b172-2790-4ebf-aacb-ecc231bb8033-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkmrqx\" (UID: \"f804b172-2790-4ebf-aacb-ecc231bb8033\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkmrqx"
Jul 09 15:07:33.714431 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:07:33.714348    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f804b172-2790-4ebf-aacb-ecc231bb8033-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkmrqx\" (UID: \"f804b172-2790-4ebf-aacb-ecc231bb8033\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkmrqx"
Jul 09 15:07:33.714431 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:07:33.714396    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f804b172-2790-4ebf-aacb-ecc231bb8033-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkmrqx\" (UID: \"f804b172-2790-4ebf-aacb-ecc231bb8033\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkmrqx"
Jul 09 15:07:33.797575 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:07:33.797525    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:07:33.815175 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:07:33.815144    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f804b172-2790-4ebf-aacb-ecc231bb8033-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkmrqx\" (UID: \"f804b172-2790-4ebf-aacb-ecc231bb8033\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkmrqx"
Jul 09 15:07:33.815326 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:07:33.815193    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f804b172-2790-4ebf-aacb-ecc231bb8033-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkmrqx\" (UID: \"f804b172-2790-4ebf-aacb-ecc231bb8033\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkmrqx"
Jul 09 15:07:33.815326 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:07:33.815241    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f804b172-2790-4ebf-aacb-ecc231bb8033-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkmrqx\" (UID: \"f804b172-2790-4ebf-aacb-ecc231bb8033\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkmrqx"
Jul 09 15:07:33.815326 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:07:33.815284    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ft4w7\" (UniqueName: \"kubernetes.io/projected/f804b172-2790-4ebf-aacb-ecc231bb8033-kube-api-access-ft4w7\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkmrqx\" (UID: \"f804b172-2790-4ebf-aacb-ecc231bb8033\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkmrqx"
Jul 09 15:07:33.815499 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:07:33.815326    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f804b172-2790-4ebf-aacb-ecc231bb8033-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkmrqx\" (UID: \"f804b172-2790-4ebf-aacb-ecc231bb8033\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkmrqx"
Jul 09 15:07:33.815499 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:07:33.815354    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f804b172-2790-4ebf-aacb-ecc231bb8033-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkmrqx\" (UID: \"f804b172-2790-4ebf-aacb-ecc231bb8033\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkmrqx"
Jul 09 15:07:33.815666 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:07:33.815646    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f804b172-2790-4ebf-aacb-ecc231bb8033-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkmrqx\" (UID: \"f804b172-2790-4ebf-aacb-ecc231bb8033\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkmrqx"
Jul 09 15:07:33.815767 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:07:33.815728    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f804b172-2790-4ebf-aacb-ecc231bb8033-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkmrqx\" (UID: \"f804b172-2790-4ebf-aacb-ecc231bb8033\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkmrqx"
Jul 09 15:07:33.815829 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:07:33.815755    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f804b172-2790-4ebf-aacb-ecc231bb8033-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkmrqx\" (UID: \"f804b172-2790-4ebf-aacb-ecc231bb8033\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkmrqx"
Jul 09 15:07:33.817628 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:07:33.817603    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f804b172-2790-4ebf-aacb-ecc231bb8033-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkmrqx\" (UID: \"f804b172-2790-4ebf-aacb-ecc231bb8033\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkmrqx"
Jul 09 15:07:33.817761 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:07:33.817734    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f804b172-2790-4ebf-aacb-ecc231bb8033-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkmrqx\" (UID: \"f804b172-2790-4ebf-aacb-ecc231bb8033\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkmrqx"
Jul 09 15:07:33.823972 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:07:33.823946    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ft4w7\" (UniqueName: \"kubernetes.io/projected/f804b172-2790-4ebf-aacb-ecc231bb8033-kube-api-access-ft4w7\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkmrqx\" (UID: \"f804b172-2790-4ebf-aacb-ecc231bb8033\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkmrqx"
Jul 09 15:07:33.984334 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:07:33.984297    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkmrqx"
Jul 09 15:07:34.121822 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:07:34.121643    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkmrqx"]
Jul 09 15:07:34.124946 ip-10-0-137-94 kubenswrapper[2575]: W0709 15:07:34.124907    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf804b172_2790_4ebf_aacb_ecc231bb8033.slice/crio-081a00957b0866f0c13c2ec231e93510aecf00a71af88bbc0d38e24e0c3c1824 WatchSource:0}: Error finding container 081a00957b0866f0c13c2ec231e93510aecf00a71af88bbc0d38e24e0c3c1824: Status 404 returned error can't find the container with id 081a00957b0866f0c13c2ec231e93510aecf00a71af88bbc0d38e24e0c3c1824
Jul 09 15:07:34.440439 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:07:34.440407    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkmrqx" event={"ID":"f804b172-2790-4ebf-aacb-ecc231bb8033","Type":"ContainerStarted","Data":"081a00957b0866f0c13c2ec231e93510aecf00a71af88bbc0d38e24e0c3c1824"}
Jul 09 15:07:35.446880 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:07:35.446846    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkmrqx" event={"ID":"f804b172-2790-4ebf-aacb-ecc231bb8033","Type":"ContainerStarted","Data":"30cda2c1bc2b988f91cf46501a8f669f5b24d02c841d5d82c71a9aaa9affa3cb"}
Jul 09 15:07:35.467493 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:07:35.467435    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkmrqx" podStartSLOduration=2.2130953030000002 podStartE2EDuration="2.467418424s" totalImagesPullingTime="254.323121ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:07:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:07:35.465357317 +0000 UTC m=+763.307890250" watchObservedRunningTime="2026-07-09 15:07:35.467418424 +0000 UTC m=+763.309951397"
Jul 09 15:07:41.612257 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:07:41.612218    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:07:43.985067 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:07:43.985032    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkmrqx"
Jul 09 15:07:43.985525 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:07:43.985091    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkmrqx"
Jul 09 15:07:43.997417 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:07:43.997391    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkmrqx"
Jul 09 15:07:44.503654 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:07:44.503627    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkmrqx"
Jul 09 15:07:50.716091 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:07:50.716033    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:07:57.662311 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:07:57.662268    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:07:57.760047 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:07:57.760007    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:08:01.050609 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:08:01.050572    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-222rh"]
Jul 09 15:08:01.054969 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:08:01.054949    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-222rh"
Jul 09 15:08:01.057627 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:08:01.057609    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 09 15:08:01.067251 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:08:01.067228    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-222rh"]
Jul 09 15:08:01.085549 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:08:01.085519    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:08:01.164663 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:08:01.164623    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e385da63-dd63-432c-8c54-f790278eb0c2-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-222rh\" (UID: \"e385da63-dd63-432c-8c54-f790278eb0c2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-222rh"
Jul 09 15:08:01.164856 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:08:01.164686    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e385da63-dd63-432c-8c54-f790278eb0c2-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-222rh\" (UID: \"e385da63-dd63-432c-8c54-f790278eb0c2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-222rh"
Jul 09 15:08:01.164856 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:08:01.164758    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e385da63-dd63-432c-8c54-f790278eb0c2-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-222rh\" (UID: \"e385da63-dd63-432c-8c54-f790278eb0c2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-222rh"
Jul 09 15:08:01.164856 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:08:01.164815    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e385da63-dd63-432c-8c54-f790278eb0c2-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-222rh\" (UID: \"e385da63-dd63-432c-8c54-f790278eb0c2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-222rh"
Jul 09 15:08:01.165014 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:08:01.164876    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e385da63-dd63-432c-8c54-f790278eb0c2-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-222rh\" (UID: \"e385da63-dd63-432c-8c54-f790278eb0c2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-222rh"
Jul 09 15:08:01.165014 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:08:01.164901    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbtjk\" (UniqueName: \"kubernetes.io/projected/e385da63-dd63-432c-8c54-f790278eb0c2-kube-api-access-qbtjk\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-222rh\" (UID: \"e385da63-dd63-432c-8c54-f790278eb0c2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-222rh"
Jul 09 15:08:01.265680 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:08:01.265648    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e385da63-dd63-432c-8c54-f790278eb0c2-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-222rh\" (UID: \"e385da63-dd63-432c-8c54-f790278eb0c2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-222rh"
Jul 09 15:08:01.265867 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:08:01.265693    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e385da63-dd63-432c-8c54-f790278eb0c2-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-222rh\" (UID: \"e385da63-dd63-432c-8c54-f790278eb0c2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-222rh"
Jul 09 15:08:01.265867 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:08:01.265753    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e385da63-dd63-432c-8c54-f790278eb0c2-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-222rh\" (UID: \"e385da63-dd63-432c-8c54-f790278eb0c2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-222rh"
Jul 09 15:08:01.265867 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:08:01.265770    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbtjk\" (UniqueName: \"kubernetes.io/projected/e385da63-dd63-432c-8c54-f790278eb0c2-kube-api-access-qbtjk\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-222rh\" (UID: \"e385da63-dd63-432c-8c54-f790278eb0c2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-222rh"
Jul 09 15:08:01.265867 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:08:01.265806    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e385da63-dd63-432c-8c54-f790278eb0c2-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-222rh\" (UID: \"e385da63-dd63-432c-8c54-f790278eb0c2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-222rh"
Jul 09 15:08:01.265867 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:08:01.265846    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e385da63-dd63-432c-8c54-f790278eb0c2-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-222rh\" (UID: \"e385da63-dd63-432c-8c54-f790278eb0c2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-222rh"
Jul 09 15:08:01.266168 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:08:01.266140    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e385da63-dd63-432c-8c54-f790278eb0c2-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-222rh\" (UID: \"e385da63-dd63-432c-8c54-f790278eb0c2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-222rh"
Jul 09 15:08:01.266219 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:08:01.266191    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e385da63-dd63-432c-8c54-f790278eb0c2-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-222rh\" (UID: \"e385da63-dd63-432c-8c54-f790278eb0c2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-222rh"
Jul 09 15:08:01.266256 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:08:01.266238    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e385da63-dd63-432c-8c54-f790278eb0c2-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-222rh\" (UID: \"e385da63-dd63-432c-8c54-f790278eb0c2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-222rh"
Jul 09 15:08:01.268015 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:08:01.267994    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e385da63-dd63-432c-8c54-f790278eb0c2-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-222rh\" (UID: \"e385da63-dd63-432c-8c54-f790278eb0c2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-222rh"
Jul 09 15:08:01.268178 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:08:01.268162    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e385da63-dd63-432c-8c54-f790278eb0c2-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-222rh\" (UID: \"e385da63-dd63-432c-8c54-f790278eb0c2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-222rh"
Jul 09 15:08:01.274877 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:08:01.274857    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbtjk\" (UniqueName: \"kubernetes.io/projected/e385da63-dd63-432c-8c54-f790278eb0c2-kube-api-access-qbtjk\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-222rh\" (UID: \"e385da63-dd63-432c-8c54-f790278eb0c2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-222rh"
Jul 09 15:08:01.364413 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:08:01.364335    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-222rh"
Jul 09 15:08:01.501226 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:08:01.501199    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-222rh"]
Jul 09 15:08:01.504977 ip-10-0-137-94 kubenswrapper[2575]: W0709 15:08:01.504937    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode385da63_dd63_432c_8c54_f790278eb0c2.slice/crio-d384e3226eb158abb31f284c77df05746c712bd722d7699ae18efe4fdee77e66 WatchSource:0}: Error finding container d384e3226eb158abb31f284c77df05746c712bd722d7699ae18efe4fdee77e66: Status 404 returned error can't find the container with id d384e3226eb158abb31f284c77df05746c712bd722d7699ae18efe4fdee77e66
Jul 09 15:08:01.583836 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:08:01.583802    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-222rh" event={"ID":"e385da63-dd63-432c-8c54-f790278eb0c2","Type":"ContainerStarted","Data":"d384e3226eb158abb31f284c77df05746c712bd722d7699ae18efe4fdee77e66"}
Jul 09 15:08:02.590300 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:08:02.590264    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-222rh" event={"ID":"e385da63-dd63-432c-8c54-f790278eb0c2","Type":"ContainerStarted","Data":"73f746274ac92356a0dd16771e826819d25995a054445f6f58b8c0ca89d6d46c"}
Jul 09 15:08:02.611590 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:08:02.611528    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-222rh" podStartSLOduration=1.381105209 podStartE2EDuration="1.611508625s" totalImagesPullingTime="230.403416ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:08:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:08:02.609925994 +0000 UTC m=+790.452458928" watchObservedRunningTime="2026-07-09 15:08:02.611508625 +0000 UTC m=+790.454041562"
Jul 09 15:08:07.230131 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:08:07.230095    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:08:07.541142 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:08:07.541047    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:08:11.365118 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:08:11.365090    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-222rh"
Jul 09 15:08:11.365489 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:08:11.365129    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-222rh"
Jul 09 15:08:11.377619 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:08:11.377594    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-222rh"
Jul 09 15:08:11.646651 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:08:11.646627    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-222rh"
Jul 09 15:08:12.671843 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:08:12.671813    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:08:12.747942 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:08:12.747887    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:08:14.455086 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:08:14.455051    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:08:18.845025 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:08:18.844930    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:09:00.115628 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:09:00.115583    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:09:00.204063 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:09:00.204024    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:09:01.659033 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:09:01.658998    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:09:01.757452 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:09:01.757415    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:09:08.931199 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:09:08.931162    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:09:26.362596 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:09:26.362560    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:09:29.878648 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:09:29.878604    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:10:12.289847 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:10:12.289805    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:10:12.377441 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:10:12.377402    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-79d77fd896-mnzfc"]
Jul 09 15:10:12.377609 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:10:12.377589    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-79d77fd896-mnzfc" podUID="2c405838-dac2-46b5-b583-5d722dc0b4af" containerName="manager" containerID="cri-o://5e6f95f3fbc9796e0b7a2a11b33a0fea7d0cbb049f00be18946c8464c1e10ac3" gracePeriod=30
Jul 09 15:10:12.620085 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:10:12.620063    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79d77fd896-mnzfc"
Jul 09 15:10:12.711745 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:10:12.711717    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m7nfb\" (UniqueName: \"kubernetes.io/projected/2c405838-dac2-46b5-b583-5d722dc0b4af-kube-api-access-m7nfb\") pod \"2c405838-dac2-46b5-b583-5d722dc0b4af\" (UID: \"2c405838-dac2-46b5-b583-5d722dc0b4af\") "
Jul 09 15:10:12.711901 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:10:12.711863    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2c405838-dac2-46b5-b583-5d722dc0b4af-webhook-cert\") pod \"2c405838-dac2-46b5-b583-5d722dc0b4af\" (UID: \"2c405838-dac2-46b5-b583-5d722dc0b4af\") "
Jul 09 15:10:12.713846 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:10:12.713811    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c405838-dac2-46b5-b583-5d722dc0b4af-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "2c405838-dac2-46b5-b583-5d722dc0b4af" (UID: "2c405838-dac2-46b5-b583-5d722dc0b4af"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 15:10:12.713846 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:10:12.713832    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c405838-dac2-46b5-b583-5d722dc0b4af-kube-api-access-m7nfb" (OuterVolumeSpecName: "kube-api-access-m7nfb") pod "2c405838-dac2-46b5-b583-5d722dc0b4af" (UID: "2c405838-dac2-46b5-b583-5d722dc0b4af"). InnerVolumeSpecName "kube-api-access-m7nfb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:10:12.813520 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:10:12.813413    2575 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2c405838-dac2-46b5-b583-5d722dc0b4af-webhook-cert\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:10:12.813520 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:10:12.813461    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m7nfb\" (UniqueName: \"kubernetes.io/projected/2c405838-dac2-46b5-b583-5d722dc0b4af-kube-api-access-m7nfb\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:10:13.263756 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:10:13.263699    2575 generic.go:356] "Generic (PLEG): container finished" podID="2c405838-dac2-46b5-b583-5d722dc0b4af" containerID="5e6f95f3fbc9796e0b7a2a11b33a0fea7d0cbb049f00be18946c8464c1e10ac3" exitCode=0
Jul 09 15:10:13.263756 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:10:13.263734    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79d77fd896-mnzfc" event={"ID":"2c405838-dac2-46b5-b583-5d722dc0b4af","Type":"ContainerDied","Data":"5e6f95f3fbc9796e0b7a2a11b33a0fea7d0cbb049f00be18946c8464c1e10ac3"}
Jul 09 15:10:13.264029 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:10:13.263800    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79d77fd896-mnzfc" event={"ID":"2c405838-dac2-46b5-b583-5d722dc0b4af","Type":"ContainerDied","Data":"84c1fefab2b0247f2d9cf9ae1090be0260982e2f0fdb34f91ce8933ba8ddd81d"}
Jul 09 15:10:13.264029 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:10:13.263755    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79d77fd896-mnzfc"
Jul 09 15:10:13.264029 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:10:13.263831    2575 scope.go:117] "RemoveContainer" containerID="5e6f95f3fbc9796e0b7a2a11b33a0fea7d0cbb049f00be18946c8464c1e10ac3"
Jul 09 15:10:13.273022 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:10:13.273004    2575 scope.go:117] "RemoveContainer" containerID="5e6f95f3fbc9796e0b7a2a11b33a0fea7d0cbb049f00be18946c8464c1e10ac3"
Jul 09 15:10:13.273285 ip-10-0-137-94 kubenswrapper[2575]: E0709 15:10:13.273267    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e6f95f3fbc9796e0b7a2a11b33a0fea7d0cbb049f00be18946c8464c1e10ac3\": container with ID starting with 5e6f95f3fbc9796e0b7a2a11b33a0fea7d0cbb049f00be18946c8464c1e10ac3 not found: ID does not exist" containerID="5e6f95f3fbc9796e0b7a2a11b33a0fea7d0cbb049f00be18946c8464c1e10ac3"
Jul 09 15:10:13.273344 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:10:13.273292    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e6f95f3fbc9796e0b7a2a11b33a0fea7d0cbb049f00be18946c8464c1e10ac3"} err="failed to get container status \"5e6f95f3fbc9796e0b7a2a11b33a0fea7d0cbb049f00be18946c8464c1e10ac3\": rpc error: code = NotFound desc = could not find container \"5e6f95f3fbc9796e0b7a2a11b33a0fea7d0cbb049f00be18946c8464c1e10ac3\": container with ID starting with 5e6f95f3fbc9796e0b7a2a11b33a0fea7d0cbb049f00be18946c8464c1e10ac3 not found: ID does not exist"
Jul 09 15:10:13.287077 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:10:13.287053    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-79d77fd896-mnzfc"]
Jul 09 15:10:13.296169 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:10:13.296148    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-79d77fd896-mnzfc"]
Jul 09 15:10:13.318500 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:10:13.318477    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c405838-dac2-46b5-b583-5d722dc0b4af" path="/var/lib/kubelet/pods/2c405838-dac2-46b5-b583-5d722dc0b4af/volumes"
Jul 09 15:10:13.979503 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:10:13.979467    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:10:14.096611 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:10:14.096577    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-79d77fd896-bjg7z"]
Jul 09 15:10:14.097013 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:10:14.096996    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c405838-dac2-46b5-b583-5d722dc0b4af" containerName="manager"
Jul 09 15:10:14.097013 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:10:14.097014    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c405838-dac2-46b5-b583-5d722dc0b4af" containerName="manager"
Jul 09 15:10:14.097170 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:10:14.097088    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c405838-dac2-46b5-b583-5d722dc0b4af" containerName="manager"
Jul 09 15:10:14.101294 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:10:14.101279    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79d77fd896-bjg7z"
Jul 09 15:10:14.103982 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:10:14.103963    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 09 15:10:14.104995 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:10:14.104973    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 09 15:10:14.105183 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:10:14.105154    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-btvm9\""
Jul 09 15:10:14.111542 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:10:14.111519    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-79d77fd896-bjg7z"]
Jul 09 15:10:14.226167 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:10:14.226132    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-766p2\" (UniqueName: \"kubernetes.io/projected/81a9da88-5e62-452f-ba09-b8cfcbfa7e45-kube-api-access-766p2\") pod \"maas-controller-79d77fd896-bjg7z\" (UID: \"81a9da88-5e62-452f-ba09-b8cfcbfa7e45\") " pod="opendatahub/maas-controller-79d77fd896-bjg7z"
Jul 09 15:10:14.226330 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:10:14.226190    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/81a9da88-5e62-452f-ba09-b8cfcbfa7e45-webhook-cert\") pod \"maas-controller-79d77fd896-bjg7z\" (UID: \"81a9da88-5e62-452f-ba09-b8cfcbfa7e45\") " pod="opendatahub/maas-controller-79d77fd896-bjg7z"
Jul 09 15:10:14.326823 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:10:14.326736    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-766p2\" (UniqueName: \"kubernetes.io/projected/81a9da88-5e62-452f-ba09-b8cfcbfa7e45-kube-api-access-766p2\") pod \"maas-controller-79d77fd896-bjg7z\" (UID: \"81a9da88-5e62-452f-ba09-b8cfcbfa7e45\") " pod="opendatahub/maas-controller-79d77fd896-bjg7z"
Jul 09 15:10:14.326823 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:10:14.326814    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/81a9da88-5e62-452f-ba09-b8cfcbfa7e45-webhook-cert\") pod \"maas-controller-79d77fd896-bjg7z\" (UID: \"81a9da88-5e62-452f-ba09-b8cfcbfa7e45\") " pod="opendatahub/maas-controller-79d77fd896-bjg7z"
Jul 09 15:10:14.329299 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:10:14.329281    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/81a9da88-5e62-452f-ba09-b8cfcbfa7e45-webhook-cert\") pod \"maas-controller-79d77fd896-bjg7z\" (UID: \"81a9da88-5e62-452f-ba09-b8cfcbfa7e45\") " pod="opendatahub/maas-controller-79d77fd896-bjg7z"
Jul 09 15:10:14.335097 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:10:14.335076    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-766p2\" (UniqueName: \"kubernetes.io/projected/81a9da88-5e62-452f-ba09-b8cfcbfa7e45-kube-api-access-766p2\") pod \"maas-controller-79d77fd896-bjg7z\" (UID: \"81a9da88-5e62-452f-ba09-b8cfcbfa7e45\") " pod="opendatahub/maas-controller-79d77fd896-bjg7z"
Jul 09 15:10:14.413015 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:10:14.412986    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79d77fd896-bjg7z"
Jul 09 15:10:14.545960 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:10:14.545916    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-79d77fd896-bjg7z"]
Jul 09 15:10:14.548975 ip-10-0-137-94 kubenswrapper[2575]: W0709 15:10:14.548949    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81a9da88_5e62_452f_ba09_b8cfcbfa7e45.slice/crio-e1d30cad94847c3e45baec76a86ffe18fcc64df512d3429bdf1d06ff86834182 WatchSource:0}: Error finding container e1d30cad94847c3e45baec76a86ffe18fcc64df512d3429bdf1d06ff86834182: Status 404 returned error can't find the container with id e1d30cad94847c3e45baec76a86ffe18fcc64df512d3429bdf1d06ff86834182
Jul 09 15:10:15.275586 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:10:15.275547    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79d77fd896-bjg7z" event={"ID":"81a9da88-5e62-452f-ba09-b8cfcbfa7e45","Type":"ContainerStarted","Data":"e1d30cad94847c3e45baec76a86ffe18fcc64df512d3429bdf1d06ff86834182"}
Jul 09 15:10:17.287293 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:10:17.287253    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79d77fd896-bjg7z" event={"ID":"81a9da88-5e62-452f-ba09-b8cfcbfa7e45","Type":"ContainerStarted","Data":"005af93ad3160d09edc15eeb59ac0d0a2a5157e49255140653702f1c3baa1417"}
Jul 09 15:10:17.287671 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:10:17.287336    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-79d77fd896-bjg7z"
Jul 09 15:10:17.313487 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:10:17.313440    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-79d77fd896-bjg7z" podStartSLOduration=1.05188211 podStartE2EDuration="3.313401216s" totalImagesPullingTime="2.261519106s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:10:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:10:17.309754539 +0000 UTC m=+925.152287468" watchObservedRunningTime="2026-07-09 15:10:17.313401216 +0000 UTC m=+925.155934153"
Jul 09 15:10:28.307458 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:10:28.307426    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-79d77fd896-bjg7z"
Jul 09 15:10:54.721402 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:10:54.721355    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:10:54.828202 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:10:54.828160    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:10:54.942199 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:10:54.942163    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:11:01.159974 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:11:01.159938    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:11:01.318893 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:11:01.318860    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:11:01.412870 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:11:01.412787    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:11:01.530882 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:11:01.530842    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:11:07.676319 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:11:07.676283    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:11:07.750941 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:11:07.750904    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:13:22.718963 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:13:22.718933    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:14:54.244192 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:14:54.244148    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:15:05.744561 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:15:05.744517    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mknfh"]
Jul 09 15:15:05.744998 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:15:05.744836    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mknfh" podUID="fcd3efaa-aeac-4dcd-b4d9-df4294053d7b" containerName="manager" containerID="cri-o://22ac7410952c7debfda72b7216f965125708677b784247cdd64fd56dc6d2ce1e" gracePeriod=10
Jul 09 15:15:09.210615 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:15:09.210591    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mknfh"
Jul 09 15:15:09.380734 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:15:09.380610    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q5f6h\" (UniqueName: \"kubernetes.io/projected/fcd3efaa-aeac-4dcd-b4d9-df4294053d7b-kube-api-access-q5f6h\") pod \"fcd3efaa-aeac-4dcd-b4d9-df4294053d7b\" (UID: \"fcd3efaa-aeac-4dcd-b4d9-df4294053d7b\") "
Jul 09 15:15:09.380734 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:15:09.380669    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fcd3efaa-aeac-4dcd-b4d9-df4294053d7b-extensions-socket-volume\") pod \"fcd3efaa-aeac-4dcd-b4d9-df4294053d7b\" (UID: \"fcd3efaa-aeac-4dcd-b4d9-df4294053d7b\") "
Jul 09 15:15:09.381041 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:15:09.381018    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fcd3efaa-aeac-4dcd-b4d9-df4294053d7b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "fcd3efaa-aeac-4dcd-b4d9-df4294053d7b" (UID: "fcd3efaa-aeac-4dcd-b4d9-df4294053d7b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:15:09.382698 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:15:09.382667    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fcd3efaa-aeac-4dcd-b4d9-df4294053d7b-kube-api-access-q5f6h" (OuterVolumeSpecName: "kube-api-access-q5f6h") pod "fcd3efaa-aeac-4dcd-b4d9-df4294053d7b" (UID: "fcd3efaa-aeac-4dcd-b4d9-df4294053d7b"). InnerVolumeSpecName "kube-api-access-q5f6h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:15:09.482281 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:15:09.482247    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q5f6h\" (UniqueName: \"kubernetes.io/projected/fcd3efaa-aeac-4dcd-b4d9-df4294053d7b-kube-api-access-q5f6h\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:15:09.482281 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:15:09.482279    2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fcd3efaa-aeac-4dcd-b4d9-df4294053d7b-extensions-socket-volume\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:15:09.797992 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:15:09.797903    2575 generic.go:356] "Generic (PLEG): container finished" podID="fcd3efaa-aeac-4dcd-b4d9-df4294053d7b" containerID="22ac7410952c7debfda72b7216f965125708677b784247cdd64fd56dc6d2ce1e" exitCode=0
Jul 09 15:15:09.797992 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:15:09.797955    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mknfh"
Jul 09 15:15:09.798170 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:15:09.797992    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mknfh" event={"ID":"fcd3efaa-aeac-4dcd-b4d9-df4294053d7b","Type":"ContainerDied","Data":"22ac7410952c7debfda72b7216f965125708677b784247cdd64fd56dc6d2ce1e"}
Jul 09 15:15:09.798170 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:15:09.798049    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mknfh" event={"ID":"fcd3efaa-aeac-4dcd-b4d9-df4294053d7b","Type":"ContainerDied","Data":"d1abfcef557398630fcb05c079c665144677677e8b55953268328bfadebcabc6"}
Jul 09 15:15:09.798170 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:15:09.798071    2575 scope.go:117] "RemoveContainer" containerID="22ac7410952c7debfda72b7216f965125708677b784247cdd64fd56dc6d2ce1e"
Jul 09 15:15:09.808386 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:15:09.808336    2575 scope.go:117] "RemoveContainer" containerID="22ac7410952c7debfda72b7216f965125708677b784247cdd64fd56dc6d2ce1e"
Jul 09 15:15:09.808612 ip-10-0-137-94 kubenswrapper[2575]: E0709 15:15:09.808588    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22ac7410952c7debfda72b7216f965125708677b784247cdd64fd56dc6d2ce1e\": container with ID starting with 22ac7410952c7debfda72b7216f965125708677b784247cdd64fd56dc6d2ce1e not found: ID does not exist" containerID="22ac7410952c7debfda72b7216f965125708677b784247cdd64fd56dc6d2ce1e"
Jul 09 15:15:09.808660 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:15:09.808622    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22ac7410952c7debfda72b7216f965125708677b784247cdd64fd56dc6d2ce1e"} err="failed to get container status \"22ac7410952c7debfda72b7216f965125708677b784247cdd64fd56dc6d2ce1e\": rpc error: code = NotFound desc = could not find container \"22ac7410952c7debfda72b7216f965125708677b784247cdd64fd56dc6d2ce1e\": container with ID starting with 22ac7410952c7debfda72b7216f965125708677b784247cdd64fd56dc6d2ce1e not found: ID does not exist"
Jul 09 15:15:09.837738 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:15:09.837698    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mknfh"]
Jul 09 15:15:09.842870 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:15:09.842841    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mknfh"]
Jul 09 15:15:10.132993 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:15:10.132948    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:15:11.316930 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:15:11.316891    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fcd3efaa-aeac-4dcd-b4d9-df4294053d7b" path="/var/lib/kubelet/pods/fcd3efaa-aeac-4dcd-b4d9-df4294053d7b/volumes"
Jul 09 15:15:48.299182 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:15:48.299085    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:15:48.365684 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:15:48.365646    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:16:06.827105 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:16:06.827070    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bgzf9"]
Jul 09 15:16:06.827468 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:16:06.827444    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fcd3efaa-aeac-4dcd-b4d9-df4294053d7b" containerName="manager"
Jul 09 15:16:06.827468 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:16:06.827458    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="fcd3efaa-aeac-4dcd-b4d9-df4294053d7b" containerName="manager"
Jul 09 15:16:06.827548 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:16:06.827529    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="fcd3efaa-aeac-4dcd-b4d9-df4294053d7b" containerName="manager"
Jul 09 15:16:06.832519 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:16:06.832488    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bgzf9"
Jul 09 15:16:06.836140 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:16:06.836116    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-9s4bm\""
Jul 09 15:16:06.842449 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:16:06.842428    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bgzf9"]
Jul 09 15:16:06.881504 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:16:06.881474    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twqd5\" (UniqueName: \"kubernetes.io/projected/d084521d-52bd-41dd-8a95-c2f9a09f6604-kube-api-access-twqd5\") pod \"kuadrant-operator-controller-manager-86878c769f-bgzf9\" (UID: \"d084521d-52bd-41dd-8a95-c2f9a09f6604\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bgzf9"
Jul 09 15:16:06.881640 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:16:06.881541    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d084521d-52bd-41dd-8a95-c2f9a09f6604-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-bgzf9\" (UID: \"d084521d-52bd-41dd-8a95-c2f9a09f6604\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bgzf9"
Jul 09 15:16:06.982561 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:16:06.982526    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d084521d-52bd-41dd-8a95-c2f9a09f6604-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-bgzf9\" (UID: \"d084521d-52bd-41dd-8a95-c2f9a09f6604\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bgzf9"
Jul 09 15:16:06.982767 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:16:06.982589    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twqd5\" (UniqueName: \"kubernetes.io/projected/d084521d-52bd-41dd-8a95-c2f9a09f6604-kube-api-access-twqd5\") pod \"kuadrant-operator-controller-manager-86878c769f-bgzf9\" (UID: \"d084521d-52bd-41dd-8a95-c2f9a09f6604\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bgzf9"
Jul 09 15:16:06.982933 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:16:06.982912    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d084521d-52bd-41dd-8a95-c2f9a09f6604-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-bgzf9\" (UID: \"d084521d-52bd-41dd-8a95-c2f9a09f6604\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bgzf9"
Jul 09 15:16:06.992067 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:16:06.992035    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-twqd5\" (UniqueName: \"kubernetes.io/projected/d084521d-52bd-41dd-8a95-c2f9a09f6604-kube-api-access-twqd5\") pod \"kuadrant-operator-controller-manager-86878c769f-bgzf9\" (UID: \"d084521d-52bd-41dd-8a95-c2f9a09f6604\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bgzf9"
Jul 09 15:16:07.145141 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:16:07.145102    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bgzf9"
Jul 09 15:16:07.277798 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:16:07.277774    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bgzf9"]
Jul 09 15:16:07.279601 ip-10-0-137-94 kubenswrapper[2575]: W0709 15:16:07.279571    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd084521d_52bd_41dd_8a95_c2f9a09f6604.slice/crio-79e9a8279432365b571cd0016a0b45e8096bd68578b791b870af80262f5185fb WatchSource:0}: Error finding container 79e9a8279432365b571cd0016a0b45e8096bd68578b791b870af80262f5185fb: Status 404 returned error can't find the container with id 79e9a8279432365b571cd0016a0b45e8096bd68578b791b870af80262f5185fb
Jul 09 15:16:08.086417 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:16:08.086373    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bgzf9" event={"ID":"d084521d-52bd-41dd-8a95-c2f9a09f6604","Type":"ContainerStarted","Data":"8a7e2bcf9af4d64906a1b2634ec095e16096352fa994e168cb350790cbf9b6e9"}
Jul 09 15:16:08.086863 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:16:08.086439    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bgzf9" event={"ID":"d084521d-52bd-41dd-8a95-c2f9a09f6604","Type":"ContainerStarted","Data":"79e9a8279432365b571cd0016a0b45e8096bd68578b791b870af80262f5185fb"}
Jul 09 15:16:08.086863 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:16:08.086495    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bgzf9"
Jul 09 15:16:08.110217 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:16:08.110167    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bgzf9" podStartSLOduration=2.11015021 podStartE2EDuration="2.11015021s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:16:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:16:08.107418174 +0000 UTC m=+1275.949951124" watchObservedRunningTime="2026-07-09 15:16:08.11015021 +0000 UTC m=+1275.952683142"
Jul 09 15:16:19.093789 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:16:19.093748    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bgzf9"
Jul 09 15:17:45.024940 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:17:45.024908    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:17:45.109281 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:17:45.109240    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:19:56.255007 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:19:56.254972    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:20:01.430119 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:20:01.430088    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:21:32.482604 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:21:32.482569    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:22:05.976577 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:05.976469    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:22:06.076943 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:06.076905    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:22:06.495076 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:06.495033    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:22:12.768024 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:12.767973    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:22:12.834177 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:12.834127    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:22:12.961021 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:12.960980    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-3272abdd-openshift-default-7ccf588489-qfjkg"]
Jul 09 15:22:12.965295 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:12.965270    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3272abdd-openshift-default-7ccf588489-qfjkg"
Jul 09 15:22:12.968615 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:12.968596    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-3272abdd-openshift-default-dockercfg-dxtfj\""
Jul 09 15:22:13.000466 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:12.997337    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-3272abdd-openshift-default-7ccf588489-qfjkg"]
Jul 09 15:22:13.005941 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:13.005522    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/968f33d0-5748-464a-8647-bd2d4c1d5b27-credential-socket\") pod \"e2e-ait-3272abdd-openshift-default-7ccf588489-qfjkg\" (UID: \"968f33d0-5748-464a-8647-bd2d4c1d5b27\") " pod="openshift-ingress/e2e-ait-3272abdd-openshift-default-7ccf588489-qfjkg"
Jul 09 15:22:13.006179 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:13.006157    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/968f33d0-5748-464a-8647-bd2d4c1d5b27-workload-certs\") pod \"e2e-ait-3272abdd-openshift-default-7ccf588489-qfjkg\" (UID: \"968f33d0-5748-464a-8647-bd2d4c1d5b27\") " pod="openshift-ingress/e2e-ait-3272abdd-openshift-default-7ccf588489-qfjkg"
Jul 09 15:22:13.006275 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:13.006215    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/968f33d0-5748-464a-8647-bd2d4c1d5b27-istio-podinfo\") pod \"e2e-ait-3272abdd-openshift-default-7ccf588489-qfjkg\" (UID: \"968f33d0-5748-464a-8647-bd2d4c1d5b27\") " pod="openshift-ingress/e2e-ait-3272abdd-openshift-default-7ccf588489-qfjkg"
Jul 09 15:22:13.006333 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:13.006293    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/968f33d0-5748-464a-8647-bd2d4c1d5b27-istio-envoy\") pod \"e2e-ait-3272abdd-openshift-default-7ccf588489-qfjkg\" (UID: \"968f33d0-5748-464a-8647-bd2d4c1d5b27\") " pod="openshift-ingress/e2e-ait-3272abdd-openshift-default-7ccf588489-qfjkg"
Jul 09 15:22:13.006333 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:13.006325    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/968f33d0-5748-464a-8647-bd2d4c1d5b27-istio-data\") pod \"e2e-ait-3272abdd-openshift-default-7ccf588489-qfjkg\" (UID: \"968f33d0-5748-464a-8647-bd2d4c1d5b27\") " pod="openshift-ingress/e2e-ait-3272abdd-openshift-default-7ccf588489-qfjkg"
Jul 09 15:22:13.006441 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:13.006342    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/968f33d0-5748-464a-8647-bd2d4c1d5b27-istiod-ca-cert\") pod \"e2e-ait-3272abdd-openshift-default-7ccf588489-qfjkg\" (UID: \"968f33d0-5748-464a-8647-bd2d4c1d5b27\") " pod="openshift-ingress/e2e-ait-3272abdd-openshift-default-7ccf588489-qfjkg"
Jul 09 15:22:13.006441 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:13.006377    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnbw7\" (UniqueName: \"kubernetes.io/projected/968f33d0-5748-464a-8647-bd2d4c1d5b27-kube-api-access-hnbw7\") pod \"e2e-ait-3272abdd-openshift-default-7ccf588489-qfjkg\" (UID: \"968f33d0-5748-464a-8647-bd2d4c1d5b27\") " pod="openshift-ingress/e2e-ait-3272abdd-openshift-default-7ccf588489-qfjkg"
Jul 09 15:22:13.006557 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:13.006478    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:22:13.006613 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:13.006595    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/968f33d0-5748-464a-8647-bd2d4c1d5b27-istio-token\") pod \"e2e-ait-3272abdd-openshift-default-7ccf588489-qfjkg\" (UID: \"968f33d0-5748-464a-8647-bd2d4c1d5b27\") " pod="openshift-ingress/e2e-ait-3272abdd-openshift-default-7ccf588489-qfjkg"
Jul 09 15:22:13.006674 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:13.006650    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/968f33d0-5748-464a-8647-bd2d4c1d5b27-workload-socket\") pod \"e2e-ait-3272abdd-openshift-default-7ccf588489-qfjkg\" (UID: \"968f33d0-5748-464a-8647-bd2d4c1d5b27\") " pod="openshift-ingress/e2e-ait-3272abdd-openshift-default-7ccf588489-qfjkg"
Jul 09 15:22:13.074483 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:13.074391    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:22:13.107589 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:13.107555    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/968f33d0-5748-464a-8647-bd2d4c1d5b27-istio-podinfo\") pod \"e2e-ait-3272abdd-openshift-default-7ccf588489-qfjkg\" (UID: \"968f33d0-5748-464a-8647-bd2d4c1d5b27\") " pod="openshift-ingress/e2e-ait-3272abdd-openshift-default-7ccf588489-qfjkg"
Jul 09 15:22:13.107770 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:13.107608    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/968f33d0-5748-464a-8647-bd2d4c1d5b27-istio-envoy\") pod \"e2e-ait-3272abdd-openshift-default-7ccf588489-qfjkg\" (UID: \"968f33d0-5748-464a-8647-bd2d4c1d5b27\") " pod="openshift-ingress/e2e-ait-3272abdd-openshift-default-7ccf588489-qfjkg"
Jul 09 15:22:13.107770 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:13.107632    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/968f33d0-5748-464a-8647-bd2d4c1d5b27-istio-data\") pod \"e2e-ait-3272abdd-openshift-default-7ccf588489-qfjkg\" (UID: \"968f33d0-5748-464a-8647-bd2d4c1d5b27\") " pod="openshift-ingress/e2e-ait-3272abdd-openshift-default-7ccf588489-qfjkg"
Jul 09 15:22:13.107770 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:13.107654    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/968f33d0-5748-464a-8647-bd2d4c1d5b27-istiod-ca-cert\") pod \"e2e-ait-3272abdd-openshift-default-7ccf588489-qfjkg\" (UID: \"968f33d0-5748-464a-8647-bd2d4c1d5b27\") " pod="openshift-ingress/e2e-ait-3272abdd-openshift-default-7ccf588489-qfjkg"
Jul 09 15:22:13.107770 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:13.107701    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnbw7\" (UniqueName: \"kubernetes.io/projected/968f33d0-5748-464a-8647-bd2d4c1d5b27-kube-api-access-hnbw7\") pod \"e2e-ait-3272abdd-openshift-default-7ccf588489-qfjkg\" (UID: \"968f33d0-5748-464a-8647-bd2d4c1d5b27\") " pod="openshift-ingress/e2e-ait-3272abdd-openshift-default-7ccf588489-qfjkg"
Jul 09 15:22:13.108001 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:13.107790    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/968f33d0-5748-464a-8647-bd2d4c1d5b27-istio-token\") pod \"e2e-ait-3272abdd-openshift-default-7ccf588489-qfjkg\" (UID: \"968f33d0-5748-464a-8647-bd2d4c1d5b27\") " pod="openshift-ingress/e2e-ait-3272abdd-openshift-default-7ccf588489-qfjkg"
Jul 09 15:22:13.108001 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:13.107823    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/968f33d0-5748-464a-8647-bd2d4c1d5b27-workload-socket\") pod \"e2e-ait-3272abdd-openshift-default-7ccf588489-qfjkg\" (UID: \"968f33d0-5748-464a-8647-bd2d4c1d5b27\") " pod="openshift-ingress/e2e-ait-3272abdd-openshift-default-7ccf588489-qfjkg"
Jul 09 15:22:13.108001 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:13.107873    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/968f33d0-5748-464a-8647-bd2d4c1d5b27-credential-socket\") pod \"e2e-ait-3272abdd-openshift-default-7ccf588489-qfjkg\" (UID: \"968f33d0-5748-464a-8647-bd2d4c1d5b27\") " pod="openshift-ingress/e2e-ait-3272abdd-openshift-default-7ccf588489-qfjkg"
Jul 09 15:22:13.108001 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:13.107900    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/968f33d0-5748-464a-8647-bd2d4c1d5b27-workload-certs\") pod \"e2e-ait-3272abdd-openshift-default-7ccf588489-qfjkg\" (UID: \"968f33d0-5748-464a-8647-bd2d4c1d5b27\") " pod="openshift-ingress/e2e-ait-3272abdd-openshift-default-7ccf588489-qfjkg"
Jul 09 15:22:13.108550 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:13.108517    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/968f33d0-5748-464a-8647-bd2d4c1d5b27-istiod-ca-cert\") pod \"e2e-ait-3272abdd-openshift-default-7ccf588489-qfjkg\" (UID: \"968f33d0-5748-464a-8647-bd2d4c1d5b27\") " pod="openshift-ingress/e2e-ait-3272abdd-openshift-default-7ccf588489-qfjkg"
Jul 09 15:22:13.108727 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:13.108685    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/968f33d0-5748-464a-8647-bd2d4c1d5b27-workload-certs\") pod \"e2e-ait-3272abdd-openshift-default-7ccf588489-qfjkg\" (UID: \"968f33d0-5748-464a-8647-bd2d4c1d5b27\") " pod="openshift-ingress/e2e-ait-3272abdd-openshift-default-7ccf588489-qfjkg"
Jul 09 15:22:13.108838 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:13.108818    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/968f33d0-5748-464a-8647-bd2d4c1d5b27-workload-socket\") pod \"e2e-ait-3272abdd-openshift-default-7ccf588489-qfjkg\" (UID: \"968f33d0-5748-464a-8647-bd2d4c1d5b27\") " pod="openshift-ingress/e2e-ait-3272abdd-openshift-default-7ccf588489-qfjkg"
Jul 09 15:22:13.108909 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:13.108845    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/968f33d0-5748-464a-8647-bd2d4c1d5b27-credential-socket\") pod \"e2e-ait-3272abdd-openshift-default-7ccf588489-qfjkg\" (UID: \"968f33d0-5748-464a-8647-bd2d4c1d5b27\") " pod="openshift-ingress/e2e-ait-3272abdd-openshift-default-7ccf588489-qfjkg"
Jul 09 15:22:13.109085 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:13.109065    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/968f33d0-5748-464a-8647-bd2d4c1d5b27-istio-data\") pod \"e2e-ait-3272abdd-openshift-default-7ccf588489-qfjkg\" (UID: \"968f33d0-5748-464a-8647-bd2d4c1d5b27\") " pod="openshift-ingress/e2e-ait-3272abdd-openshift-default-7ccf588489-qfjkg"
Jul 09 15:22:13.110332 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:13.110306    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/968f33d0-5748-464a-8647-bd2d4c1d5b27-istio-podinfo\") pod \"e2e-ait-3272abdd-openshift-default-7ccf588489-qfjkg\" (UID: \"968f33d0-5748-464a-8647-bd2d4c1d5b27\") " pod="openshift-ingress/e2e-ait-3272abdd-openshift-default-7ccf588489-qfjkg"
Jul 09 15:22:13.110422 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:13.110310    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/968f33d0-5748-464a-8647-bd2d4c1d5b27-istio-envoy\") pod \"e2e-ait-3272abdd-openshift-default-7ccf588489-qfjkg\" (UID: \"968f33d0-5748-464a-8647-bd2d4c1d5b27\") " pod="openshift-ingress/e2e-ait-3272abdd-openshift-default-7ccf588489-qfjkg"
Jul 09 15:22:13.117186 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:13.117166    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/968f33d0-5748-464a-8647-bd2d4c1d5b27-istio-token\") pod \"e2e-ait-3272abdd-openshift-default-7ccf588489-qfjkg\" (UID: \"968f33d0-5748-464a-8647-bd2d4c1d5b27\") " pod="openshift-ingress/e2e-ait-3272abdd-openshift-default-7ccf588489-qfjkg"
Jul 09 15:22:13.117345 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:13.117323    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnbw7\" (UniqueName: \"kubernetes.io/projected/968f33d0-5748-464a-8647-bd2d4c1d5b27-kube-api-access-hnbw7\") pod \"e2e-ait-3272abdd-openshift-default-7ccf588489-qfjkg\" (UID: \"968f33d0-5748-464a-8647-bd2d4c1d5b27\") " pod="openshift-ingress/e2e-ait-3272abdd-openshift-default-7ccf588489-qfjkg"
Jul 09 15:22:13.276402 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:13.276373    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3272abdd-openshift-default-7ccf588489-qfjkg"
Jul 09 15:22:13.414973 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:13.414943    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-3272abdd-openshift-default-7ccf588489-qfjkg"]
Jul 09 15:22:13.416467 ip-10-0-137-94 kubenswrapper[2575]: W0709 15:22:13.416436    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod968f33d0_5748_464a_8647_bd2d4c1d5b27.slice/crio-51a0126dbb769bd5fc8bd6d2449210c14e33375fa72425c5eb62af5d7caaf9cc WatchSource:0}: Error finding container 51a0126dbb769bd5fc8bd6d2449210c14e33375fa72425c5eb62af5d7caaf9cc: Status 404 returned error can't find the container with id 51a0126dbb769bd5fc8bd6d2449210c14e33375fa72425c5eb62af5d7caaf9cc
Jul 09 15:22:13.418581 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:13.418545    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 15:22:13.418665 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:13.418617    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 15:22:13.418665 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:13.418647    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 15:22:13.959329 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:13.959291    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3272abdd-openshift-default-7ccf588489-qfjkg" event={"ID":"968f33d0-5748-464a-8647-bd2d4c1d5b27","Type":"ContainerStarted","Data":"272b618c3a1acae560dc3f987fb9392f6e8d6f305a5c40a982ee9b352e33ccf7"}
Jul 09 15:22:13.959696 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:13.959355    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3272abdd-openshift-default-7ccf588489-qfjkg" event={"ID":"968f33d0-5748-464a-8647-bd2d4c1d5b27","Type":"ContainerStarted","Data":"51a0126dbb769bd5fc8bd6d2449210c14e33375fa72425c5eb62af5d7caaf9cc"}
Jul 09 15:22:13.988165 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:13.988119    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-3272abdd-openshift-default-7ccf588489-qfjkg" podStartSLOduration=1.988102357 podStartE2EDuration="1.988102357s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:22:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:22:13.98576072 +0000 UTC m=+1641.828293677" watchObservedRunningTime="2026-07-09 15:22:13.988102357 +0000 UTC m=+1641.830635288"
Jul 09 15:22:14.198687 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:14.198648    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:22:14.277116 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:14.277032    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-3272abdd-openshift-default-7ccf588489-qfjkg"
Jul 09 15:22:14.282168 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:14.282144    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-3272abdd-openshift-default-7ccf588489-qfjkg"
Jul 09 15:22:14.286307 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:14.286285    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:22:14.288055 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:14.288034    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3272abdd-785d78944f-4qgk8"]
Jul 09 15:22:14.291528 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:14.291510    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3272abdd-785d78944f-4qgk8"
Jul 09 15:22:14.293994 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:14.293977    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-3272abdd-serving-cert\""
Jul 09 15:22:14.303858 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:14.303835    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3272abdd-785d78944f-4qgk8"]
Jul 09 15:22:14.359575 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:14.359542    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:22:14.420007 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:14.419967    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngfw8\" (UniqueName: \"kubernetes.io/projected/24540d74-e32e-4e47-bfed-1f24b2e6a5d2-kube-api-access-ngfw8\") pod \"maas-api-e2e-ait-3272abdd-785d78944f-4qgk8\" (UID: \"24540d74-e32e-4e47-bfed-1f24b2e6a5d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3272abdd-785d78944f-4qgk8"
Jul 09 15:22:14.420174 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:14.420089    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/24540d74-e32e-4e47-bfed-1f24b2e6a5d2-openshift-service-ca\") pod \"maas-api-e2e-ait-3272abdd-785d78944f-4qgk8\" (UID: \"24540d74-e32e-4e47-bfed-1f24b2e6a5d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3272abdd-785d78944f-4qgk8"
Jul 09 15:22:14.420174 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:14.420153    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/24540d74-e32e-4e47-bfed-1f24b2e6a5d2-maas-api-tls\") pod \"maas-api-e2e-ait-3272abdd-785d78944f-4qgk8\" (UID: \"24540d74-e32e-4e47-bfed-1f24b2e6a5d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3272abdd-785d78944f-4qgk8"
Jul 09 15:22:14.462972 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:14.462946    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:22:14.521392 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:14.521361    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngfw8\" (UniqueName: \"kubernetes.io/projected/24540d74-e32e-4e47-bfed-1f24b2e6a5d2-kube-api-access-ngfw8\") pod \"maas-api-e2e-ait-3272abdd-785d78944f-4qgk8\" (UID: \"24540d74-e32e-4e47-bfed-1f24b2e6a5d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3272abdd-785d78944f-4qgk8"
Jul 09 15:22:14.521566 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:14.521431    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/24540d74-e32e-4e47-bfed-1f24b2e6a5d2-openshift-service-ca\") pod \"maas-api-e2e-ait-3272abdd-785d78944f-4qgk8\" (UID: \"24540d74-e32e-4e47-bfed-1f24b2e6a5d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3272abdd-785d78944f-4qgk8"
Jul 09 15:22:14.521566 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:14.521475    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/24540d74-e32e-4e47-bfed-1f24b2e6a5d2-maas-api-tls\") pod \"maas-api-e2e-ait-3272abdd-785d78944f-4qgk8\" (UID: \"24540d74-e32e-4e47-bfed-1f24b2e6a5d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3272abdd-785d78944f-4qgk8"
Jul 09 15:22:14.522119 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:14.522096    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/24540d74-e32e-4e47-bfed-1f24b2e6a5d2-openshift-service-ca\") pod \"maas-api-e2e-ait-3272abdd-785d78944f-4qgk8\" (UID: \"24540d74-e32e-4e47-bfed-1f24b2e6a5d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3272abdd-785d78944f-4qgk8"
Jul 09 15:22:14.524022 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:14.524002    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/24540d74-e32e-4e47-bfed-1f24b2e6a5d2-maas-api-tls\") pod \"maas-api-e2e-ait-3272abdd-785d78944f-4qgk8\" (UID: \"24540d74-e32e-4e47-bfed-1f24b2e6a5d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3272abdd-785d78944f-4qgk8"
Jul 09 15:22:14.530338 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:14.530282    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngfw8\" (UniqueName: \"kubernetes.io/projected/24540d74-e32e-4e47-bfed-1f24b2e6a5d2-kube-api-access-ngfw8\") pod \"maas-api-e2e-ait-3272abdd-785d78944f-4qgk8\" (UID: \"24540d74-e32e-4e47-bfed-1f24b2e6a5d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3272abdd-785d78944f-4qgk8"
Jul 09 15:22:14.602617 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:14.602585    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3272abdd-785d78944f-4qgk8"
Jul 09 15:22:14.771129 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:14.771101    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3272abdd-785d78944f-4qgk8"]
Jul 09 15:22:14.773288 ip-10-0-137-94 kubenswrapper[2575]: W0709 15:22:14.773262    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24540d74_e32e_4e47_bfed_1f24b2e6a5d2.slice/crio-ed48ec94bb6e35065173fcfb7bf5e6852e56d1f66c94341fdcd21d8c5d592256 WatchSource:0}: Error finding container ed48ec94bb6e35065173fcfb7bf5e6852e56d1f66c94341fdcd21d8c5d592256: Status 404 returned error can't find the container with id ed48ec94bb6e35065173fcfb7bf5e6852e56d1f66c94341fdcd21d8c5d592256
Jul 09 15:22:14.774694 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:14.774679    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 15:22:14.853392 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:14.853364    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:22:14.966157 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:14.966113    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3272abdd-785d78944f-4qgk8" event={"ID":"24540d74-e32e-4e47-bfed-1f24b2e6a5d2","Type":"ContainerStarted","Data":"ed48ec94bb6e35065173fcfb7bf5e6852e56d1f66c94341fdcd21d8c5d592256"}
Jul 09 15:22:14.966692 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:14.966382    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-3272abdd-openshift-default-7ccf588489-qfjkg"
Jul 09 15:22:14.966692 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:14.966484    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:22:14.967364 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:14.967347    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-3272abdd-openshift-default-7ccf588489-qfjkg"
Jul 09 15:22:15.973629 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:15.973580    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3272abdd-785d78944f-4qgk8" event={"ID":"24540d74-e32e-4e47-bfed-1f24b2e6a5d2","Type":"ContainerStarted","Data":"87f145581400533f26ad469cba5cc6f442104a7dce6abeed1a555edcc27d17d9"}
Jul 09 15:22:15.974102 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:15.973785    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3272abdd-785d78944f-4qgk8"
Jul 09 15:22:15.993833 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:15.993788    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3272abdd-785d78944f-4qgk8" podStartSLOduration=1.4995719840000001 podStartE2EDuration="1.993772363s" totalImagesPullingTime="494.200379ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:22:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:22:15.991617118 +0000 UTC m=+1643.834150051" watchObservedRunningTime="2026-07-09 15:22:15.993772363 +0000 UTC m=+1643.836305295"
Jul 09 15:22:17.115318 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:17.115277    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:22:19.403173 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:19.403141    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:22:19.594244 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:19.594214    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-3272abdd-openshift-default-7ccf588489-qfjkg"]
Jul 09 15:22:19.594432 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:19.594407    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-3272abdd-openshift-default-7ccf588489-qfjkg" podUID="968f33d0-5748-464a-8647-bd2d4c1d5b27" containerName="istio-proxy" containerID="cri-o://272b618c3a1acae560dc3f987fb9392f6e8d6f305a5c40a982ee9b352e33ccf7" gracePeriod=30
Jul 09 15:22:19.624970 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:19.624926    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:22:19.723195 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:19.723072    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:22:19.920749 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:19.920695    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3272abdd-785d78944f-4qgk8"]
Jul 09 15:22:19.921192 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:19.921158    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3272abdd-785d78944f-4qgk8" podUID="24540d74-e32e-4e47-bfed-1f24b2e6a5d2" containerName="maas-api" containerID="cri-o://87f145581400533f26ad469cba5cc6f442104a7dce6abeed1a555edcc27d17d9" gracePeriod=30
Jul 09 15:22:19.958005 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:19.957978    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:22:20.196760 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:20.196736    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3272abdd-785d78944f-4qgk8"
Jul 09 15:22:20.278721 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:20.278671    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ngfw8\" (UniqueName: \"kubernetes.io/projected/24540d74-e32e-4e47-bfed-1f24b2e6a5d2-kube-api-access-ngfw8\") pod \"24540d74-e32e-4e47-bfed-1f24b2e6a5d2\" (UID: \"24540d74-e32e-4e47-bfed-1f24b2e6a5d2\") "
Jul 09 15:22:20.278895 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:20.278849    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/24540d74-e32e-4e47-bfed-1f24b2e6a5d2-maas-api-tls\") pod \"24540d74-e32e-4e47-bfed-1f24b2e6a5d2\" (UID: \"24540d74-e32e-4e47-bfed-1f24b2e6a5d2\") "
Jul 09 15:22:20.278895 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:20.278891    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/24540d74-e32e-4e47-bfed-1f24b2e6a5d2-openshift-service-ca\") pod \"24540d74-e32e-4e47-bfed-1f24b2e6a5d2\" (UID: \"24540d74-e32e-4e47-bfed-1f24b2e6a5d2\") "
Jul 09 15:22:20.279277 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:20.279250    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24540d74-e32e-4e47-bfed-1f24b2e6a5d2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "24540d74-e32e-4e47-bfed-1f24b2e6a5d2" (UID: "24540d74-e32e-4e47-bfed-1f24b2e6a5d2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 15:22:20.281450 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:20.281417    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24540d74-e32e-4e47-bfed-1f24b2e6a5d2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "24540d74-e32e-4e47-bfed-1f24b2e6a5d2" (UID: "24540d74-e32e-4e47-bfed-1f24b2e6a5d2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 15:22:20.281532 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:20.281450    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24540d74-e32e-4e47-bfed-1f24b2e6a5d2-kube-api-access-ngfw8" (OuterVolumeSpecName: "kube-api-access-ngfw8") pod "24540d74-e32e-4e47-bfed-1f24b2e6a5d2" (UID: "24540d74-e32e-4e47-bfed-1f24b2e6a5d2"). InnerVolumeSpecName "kube-api-access-ngfw8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:22:20.380169 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:20.379962    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/24540d74-e32e-4e47-bfed-1f24b2e6a5d2-maas-api-tls\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:22:20.380169 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:20.380019    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/24540d74-e32e-4e47-bfed-1f24b2e6a5d2-openshift-service-ca\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:22:20.380169 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:20.380035    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ngfw8\" (UniqueName: \"kubernetes.io/projected/24540d74-e32e-4e47-bfed-1f24b2e6a5d2-kube-api-access-ngfw8\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:22:20.999954 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:20.999920    2575 generic.go:356] "Generic (PLEG): container finished" podID="24540d74-e32e-4e47-bfed-1f24b2e6a5d2" containerID="87f145581400533f26ad469cba5cc6f442104a7dce6abeed1a555edcc27d17d9" exitCode=0
Jul 09 15:22:21.000334 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:20.999964    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3272abdd-785d78944f-4qgk8"
Jul 09 15:22:21.000334 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:21.000006    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3272abdd-785d78944f-4qgk8" event={"ID":"24540d74-e32e-4e47-bfed-1f24b2e6a5d2","Type":"ContainerDied","Data":"87f145581400533f26ad469cba5cc6f442104a7dce6abeed1a555edcc27d17d9"}
Jul 09 15:22:21.000334 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:21.000060    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3272abdd-785d78944f-4qgk8" event={"ID":"24540d74-e32e-4e47-bfed-1f24b2e6a5d2","Type":"ContainerDied","Data":"ed48ec94bb6e35065173fcfb7bf5e6852e56d1f66c94341fdcd21d8c5d592256"}
Jul 09 15:22:21.000334 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:21.000082    2575 scope.go:117] "RemoveContainer" containerID="87f145581400533f26ad469cba5cc6f442104a7dce6abeed1a555edcc27d17d9"
Jul 09 15:22:21.011945 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:21.011341    2575 scope.go:117] "RemoveContainer" containerID="87f145581400533f26ad469cba5cc6f442104a7dce6abeed1a555edcc27d17d9"
Jul 09 15:22:21.016866 ip-10-0-137-94 kubenswrapper[2575]: E0709 15:22:21.016832    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87f145581400533f26ad469cba5cc6f442104a7dce6abeed1a555edcc27d17d9\": container with ID starting with 87f145581400533f26ad469cba5cc6f442104a7dce6abeed1a555edcc27d17d9 not found: ID does not exist" containerID="87f145581400533f26ad469cba5cc6f442104a7dce6abeed1a555edcc27d17d9"
Jul 09 15:22:21.016966 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:21.016877    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87f145581400533f26ad469cba5cc6f442104a7dce6abeed1a555edcc27d17d9"} err="failed to get container status \"87f145581400533f26ad469cba5cc6f442104a7dce6abeed1a555edcc27d17d9\": rpc error: code = NotFound desc = could not find container \"87f145581400533f26ad469cba5cc6f442104a7dce6abeed1a555edcc27d17d9\": container with ID starting with 87f145581400533f26ad469cba5cc6f442104a7dce6abeed1a555edcc27d17d9 not found: ID does not exist"
Jul 09 15:22:21.033529 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:21.033493    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3272abdd-785d78944f-4qgk8"]
Jul 09 15:22:21.038361 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:21.038336    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3272abdd-785d78944f-4qgk8"]
Jul 09 15:22:21.140203 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:21.140170    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:22:21.322331 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:21.322227    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24540d74-e32e-4e47-bfed-1f24b2e6a5d2" path="/var/lib/kubelet/pods/24540d74-e32e-4e47-bfed-1f24b2e6a5d2/volumes"
Jul 09 15:22:25.458983 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:25.458955    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3272abdd-openshift-default-7ccf588489-qfjkg"
Jul 09 15:22:25.528094 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:25.528020    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/968f33d0-5748-464a-8647-bd2d4c1d5b27-workload-socket\") pod \"968f33d0-5748-464a-8647-bd2d4c1d5b27\" (UID: \"968f33d0-5748-464a-8647-bd2d4c1d5b27\") "
Jul 09 15:22:25.528094 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:25.528088    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/968f33d0-5748-464a-8647-bd2d4c1d5b27-workload-certs\") pod \"968f33d0-5748-464a-8647-bd2d4c1d5b27\" (UID: \"968f33d0-5748-464a-8647-bd2d4c1d5b27\") "
Jul 09 15:22:25.528306 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:25.528111    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/968f33d0-5748-464a-8647-bd2d4c1d5b27-credential-socket\") pod \"968f33d0-5748-464a-8647-bd2d4c1d5b27\" (UID: \"968f33d0-5748-464a-8647-bd2d4c1d5b27\") "
Jul 09 15:22:25.528306 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:25.528138    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hnbw7\" (UniqueName: \"kubernetes.io/projected/968f33d0-5748-464a-8647-bd2d4c1d5b27-kube-api-access-hnbw7\") pod \"968f33d0-5748-464a-8647-bd2d4c1d5b27\" (UID: \"968f33d0-5748-464a-8647-bd2d4c1d5b27\") "
Jul 09 15:22:25.528306 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:25.528152    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/968f33d0-5748-464a-8647-bd2d4c1d5b27-istio-token\") pod \"968f33d0-5748-464a-8647-bd2d4c1d5b27\" (UID: \"968f33d0-5748-464a-8647-bd2d4c1d5b27\") "
Jul 09 15:22:25.528306 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:25.528206    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/968f33d0-5748-464a-8647-bd2d4c1d5b27-istiod-ca-cert\") pod \"968f33d0-5748-464a-8647-bd2d4c1d5b27\" (UID: \"968f33d0-5748-464a-8647-bd2d4c1d5b27\") "
Jul 09 15:22:25.528306 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:25.528230    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/968f33d0-5748-464a-8647-bd2d4c1d5b27-istio-podinfo\") pod \"968f33d0-5748-464a-8647-bd2d4c1d5b27\" (UID: \"968f33d0-5748-464a-8647-bd2d4c1d5b27\") "
Jul 09 15:22:25.528306 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:25.528251    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/968f33d0-5748-464a-8647-bd2d4c1d5b27-istio-envoy\") pod \"968f33d0-5748-464a-8647-bd2d4c1d5b27\" (UID: \"968f33d0-5748-464a-8647-bd2d4c1d5b27\") "
Jul 09 15:22:25.528306 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:25.528288    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/968f33d0-5748-464a-8647-bd2d4c1d5b27-istio-data\") pod \"968f33d0-5748-464a-8647-bd2d4c1d5b27\" (UID: \"968f33d0-5748-464a-8647-bd2d4c1d5b27\") "
Jul 09 15:22:25.528627 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:25.528325    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/968f33d0-5748-464a-8647-bd2d4c1d5b27-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "968f33d0-5748-464a-8647-bd2d4c1d5b27" (UID: "968f33d0-5748-464a-8647-bd2d4c1d5b27"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:22:25.528627 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:25.528422    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/968f33d0-5748-464a-8647-bd2d4c1d5b27-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "968f33d0-5748-464a-8647-bd2d4c1d5b27" (UID: "968f33d0-5748-464a-8647-bd2d4c1d5b27"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:22:25.528627 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:25.528489    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/968f33d0-5748-464a-8647-bd2d4c1d5b27-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "968f33d0-5748-464a-8647-bd2d4c1d5b27" (UID: "968f33d0-5748-464a-8647-bd2d4c1d5b27"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:22:25.528627 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:25.528558    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/968f33d0-5748-464a-8647-bd2d4c1d5b27-workload-socket\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:22:25.528627 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:25.528578    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/968f33d0-5748-464a-8647-bd2d4c1d5b27-workload-certs\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:22:25.528915 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:25.528691    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/968f33d0-5748-464a-8647-bd2d4c1d5b27-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "968f33d0-5748-464a-8647-bd2d4c1d5b27" (UID: "968f33d0-5748-464a-8647-bd2d4c1d5b27"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 15:22:25.529112 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:25.529090    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/968f33d0-5748-464a-8647-bd2d4c1d5b27-istio-data" (OuterVolumeSpecName: "istio-data") pod "968f33d0-5748-464a-8647-bd2d4c1d5b27" (UID: "968f33d0-5748-464a-8647-bd2d4c1d5b27"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:22:25.530504 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:25.530477    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/968f33d0-5748-464a-8647-bd2d4c1d5b27-istio-token" (OuterVolumeSpecName: "istio-token") pod "968f33d0-5748-464a-8647-bd2d4c1d5b27" (UID: "968f33d0-5748-464a-8647-bd2d4c1d5b27"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:22:25.530614 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:25.530517    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/968f33d0-5748-464a-8647-bd2d4c1d5b27-kube-api-access-hnbw7" (OuterVolumeSpecName: "kube-api-access-hnbw7") pod "968f33d0-5748-464a-8647-bd2d4c1d5b27" (UID: "968f33d0-5748-464a-8647-bd2d4c1d5b27"). InnerVolumeSpecName "kube-api-access-hnbw7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:22:25.530806 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:25.530783    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/968f33d0-5748-464a-8647-bd2d4c1d5b27-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "968f33d0-5748-464a-8647-bd2d4c1d5b27" (UID: "968f33d0-5748-464a-8647-bd2d4c1d5b27"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 15:22:25.530899 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:25.530817    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/968f33d0-5748-464a-8647-bd2d4c1d5b27-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "968f33d0-5748-464a-8647-bd2d4c1d5b27" (UID: "968f33d0-5748-464a-8647-bd2d4c1d5b27"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:22:25.630004 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:25.629972    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hnbw7\" (UniqueName: \"kubernetes.io/projected/968f33d0-5748-464a-8647-bd2d4c1d5b27-kube-api-access-hnbw7\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:22:25.630004 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:25.630000    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/968f33d0-5748-464a-8647-bd2d4c1d5b27-istio-token\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:22:25.630004 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:25.630009    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/968f33d0-5748-464a-8647-bd2d4c1d5b27-istiod-ca-cert\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:22:25.630270 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:25.630017    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/968f33d0-5748-464a-8647-bd2d4c1d5b27-istio-podinfo\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:22:25.630270 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:25.630025    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/968f33d0-5748-464a-8647-bd2d4c1d5b27-istio-envoy\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:22:25.630270 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:25.630032    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/968f33d0-5748-464a-8647-bd2d4c1d5b27-istio-data\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:22:25.630270 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:25.630040    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/968f33d0-5748-464a-8647-bd2d4c1d5b27-credential-socket\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:22:25.905780 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:25.905731    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:22:25.977729 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:25.977676    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:22:26.032205 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:26.032173    2575 generic.go:356] "Generic (PLEG): container finished" podID="968f33d0-5748-464a-8647-bd2d4c1d5b27" containerID="272b618c3a1acae560dc3f987fb9392f6e8d6f305a5c40a982ee9b352e33ccf7" exitCode=0
Jul 09 15:22:26.032375 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:26.032215    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3272abdd-openshift-default-7ccf588489-qfjkg"
Jul 09 15:22:26.032375 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:26.032240    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3272abdd-openshift-default-7ccf588489-qfjkg" event={"ID":"968f33d0-5748-464a-8647-bd2d4c1d5b27","Type":"ContainerDied","Data":"272b618c3a1acae560dc3f987fb9392f6e8d6f305a5c40a982ee9b352e33ccf7"}
Jul 09 15:22:26.032375 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:26.032279    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3272abdd-openshift-default-7ccf588489-qfjkg" event={"ID":"968f33d0-5748-464a-8647-bd2d4c1d5b27","Type":"ContainerDied","Data":"51a0126dbb769bd5fc8bd6d2449210c14e33375fa72425c5eb62af5d7caaf9cc"}
Jul 09 15:22:26.032375 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:26.032300    2575 scope.go:117] "RemoveContainer" containerID="272b618c3a1acae560dc3f987fb9392f6e8d6f305a5c40a982ee9b352e33ccf7"
Jul 09 15:22:26.042407 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:26.042391    2575 scope.go:117] "RemoveContainer" containerID="272b618c3a1acae560dc3f987fb9392f6e8d6f305a5c40a982ee9b352e33ccf7"
Jul 09 15:22:26.042645 ip-10-0-137-94 kubenswrapper[2575]: E0709 15:22:26.042626    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"272b618c3a1acae560dc3f987fb9392f6e8d6f305a5c40a982ee9b352e33ccf7\": container with ID starting with 272b618c3a1acae560dc3f987fb9392f6e8d6f305a5c40a982ee9b352e33ccf7 not found: ID does not exist" containerID="272b618c3a1acae560dc3f987fb9392f6e8d6f305a5c40a982ee9b352e33ccf7"
Jul 09 15:22:26.042778 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:26.042657    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"272b618c3a1acae560dc3f987fb9392f6e8d6f305a5c40a982ee9b352e33ccf7"} err="failed to get container status \"272b618c3a1acae560dc3f987fb9392f6e8d6f305a5c40a982ee9b352e33ccf7\": rpc error: code = NotFound desc = could not find container \"272b618c3a1acae560dc3f987fb9392f6e8d6f305a5c40a982ee9b352e33ccf7\": container with ID starting with 272b618c3a1acae560dc3f987fb9392f6e8d6f305a5c40a982ee9b352e33ccf7 not found: ID does not exist"
Jul 09 15:22:26.065286 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:26.065259    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-3272abdd-openshift-default-7ccf588489-qfjkg"]
Jul 09 15:22:26.075321 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:26.075290    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-3272abdd-openshift-default-7ccf588489-qfjkg"]
Jul 09 15:22:26.148555 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:26.148524    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-3c66ec23-openshift-default-67c7544fd5-8dk72"]
Jul 09 15:22:26.149106 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:26.149088    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="968f33d0-5748-464a-8647-bd2d4c1d5b27" containerName="istio-proxy"
Jul 09 15:22:26.149177 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:26.149108    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="968f33d0-5748-464a-8647-bd2d4c1d5b27" containerName="istio-proxy"
Jul 09 15:22:26.149177 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:26.149143    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24540d74-e32e-4e47-bfed-1f24b2e6a5d2" containerName="maas-api"
Jul 09 15:22:26.149177 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:26.149152    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="24540d74-e32e-4e47-bfed-1f24b2e6a5d2" containerName="maas-api"
Jul 09 15:22:26.149273 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:26.149242    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="968f33d0-5748-464a-8647-bd2d4c1d5b27" containerName="istio-proxy"
Jul 09 15:22:26.149273 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:26.149254    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="24540d74-e32e-4e47-bfed-1f24b2e6a5d2" containerName="maas-api"
Jul 09 15:22:26.154051 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:26.154033    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3c66ec23-openshift-default-67c7544fd5-8dk72"
Jul 09 15:22:26.162084 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:26.161843    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-3c66ec23-openshift-default-dockercfg-2z5dm\""
Jul 09 15:22:26.198301 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:26.198267    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-3c66ec23-openshift-default-67c7544fd5-8dk72"]
Jul 09 15:22:26.213501 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:26.213462    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:22:26.235885 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:26.235856    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8121cde-7d75-458a-ae4a-2bf161be3fa5-istio-data\") pod \"e2e-ait-3c66ec23-openshift-default-67c7544fd5-8dk72\" (UID: \"e8121cde-7d75-458a-ae4a-2bf161be3fa5\") " pod="openshift-ingress/e2e-ait-3c66ec23-openshift-default-67c7544fd5-8dk72"
Jul 09 15:22:26.236054 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:26.235891    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8121cde-7d75-458a-ae4a-2bf161be3fa5-credential-socket\") pod \"e2e-ait-3c66ec23-openshift-default-67c7544fd5-8dk72\" (UID: \"e8121cde-7d75-458a-ae4a-2bf161be3fa5\") " pod="openshift-ingress/e2e-ait-3c66ec23-openshift-default-67c7544fd5-8dk72"
Jul 09 15:22:26.236054 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:26.235924    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8121cde-7d75-458a-ae4a-2bf161be3fa5-workload-socket\") pod \"e2e-ait-3c66ec23-openshift-default-67c7544fd5-8dk72\" (UID: \"e8121cde-7d75-458a-ae4a-2bf161be3fa5\") " pod="openshift-ingress/e2e-ait-3c66ec23-openshift-default-67c7544fd5-8dk72"
Jul 09 15:22:26.236054 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:26.235948    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8121cde-7d75-458a-ae4a-2bf161be3fa5-istio-token\") pod \"e2e-ait-3c66ec23-openshift-default-67c7544fd5-8dk72\" (UID: \"e8121cde-7d75-458a-ae4a-2bf161be3fa5\") " pod="openshift-ingress/e2e-ait-3c66ec23-openshift-default-67c7544fd5-8dk72"
Jul 09 15:22:26.236054 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:26.235992    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wcvr\" (UniqueName: \"kubernetes.io/projected/e8121cde-7d75-458a-ae4a-2bf161be3fa5-kube-api-access-9wcvr\") pod \"e2e-ait-3c66ec23-openshift-default-67c7544fd5-8dk72\" (UID: \"e8121cde-7d75-458a-ae4a-2bf161be3fa5\") " pod="openshift-ingress/e2e-ait-3c66ec23-openshift-default-67c7544fd5-8dk72"
Jul 09 15:22:26.236201 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:26.236084    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8121cde-7d75-458a-ae4a-2bf161be3fa5-istio-podinfo\") pod \"e2e-ait-3c66ec23-openshift-default-67c7544fd5-8dk72\" (UID: \"e8121cde-7d75-458a-ae4a-2bf161be3fa5\") " pod="openshift-ingress/e2e-ait-3c66ec23-openshift-default-67c7544fd5-8dk72"
Jul 09 15:22:26.236201 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:26.236114    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8121cde-7d75-458a-ae4a-2bf161be3fa5-istio-envoy\") pod \"e2e-ait-3c66ec23-openshift-default-67c7544fd5-8dk72\" (UID: \"e8121cde-7d75-458a-ae4a-2bf161be3fa5\") " pod="openshift-ingress/e2e-ait-3c66ec23-openshift-default-67c7544fd5-8dk72"
Jul 09 15:22:26.236201 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:26.236139    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8121cde-7d75-458a-ae4a-2bf161be3fa5-workload-certs\") pod \"e2e-ait-3c66ec23-openshift-default-67c7544fd5-8dk72\" (UID: \"e8121cde-7d75-458a-ae4a-2bf161be3fa5\") " pod="openshift-ingress/e2e-ait-3c66ec23-openshift-default-67c7544fd5-8dk72"
Jul 09 15:22:26.236201 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:26.236156    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8121cde-7d75-458a-ae4a-2bf161be3fa5-istiod-ca-cert\") pod \"e2e-ait-3c66ec23-openshift-default-67c7544fd5-8dk72\" (UID: \"e8121cde-7d75-458a-ae4a-2bf161be3fa5\") " pod="openshift-ingress/e2e-ait-3c66ec23-openshift-default-67c7544fd5-8dk72"
Jul 09 15:22:26.318931 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:26.318898    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:22:26.337434 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:26.337406    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8121cde-7d75-458a-ae4a-2bf161be3fa5-istio-podinfo\") pod \"e2e-ait-3c66ec23-openshift-default-67c7544fd5-8dk72\" (UID: \"e8121cde-7d75-458a-ae4a-2bf161be3fa5\") " pod="openshift-ingress/e2e-ait-3c66ec23-openshift-default-67c7544fd5-8dk72"
Jul 09 15:22:26.337572 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:26.337441    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8121cde-7d75-458a-ae4a-2bf161be3fa5-istio-envoy\") pod \"e2e-ait-3c66ec23-openshift-default-67c7544fd5-8dk72\" (UID: \"e8121cde-7d75-458a-ae4a-2bf161be3fa5\") " pod="openshift-ingress/e2e-ait-3c66ec23-openshift-default-67c7544fd5-8dk72"
Jul 09 15:22:26.337572 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:26.337476    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8121cde-7d75-458a-ae4a-2bf161be3fa5-workload-certs\") pod \"e2e-ait-3c66ec23-openshift-default-67c7544fd5-8dk72\" (UID: \"e8121cde-7d75-458a-ae4a-2bf161be3fa5\") " pod="openshift-ingress/e2e-ait-3c66ec23-openshift-default-67c7544fd5-8dk72"
Jul 09 15:22:26.337649 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:26.337602    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8121cde-7d75-458a-ae4a-2bf161be3fa5-istiod-ca-cert\") pod \"e2e-ait-3c66ec23-openshift-default-67c7544fd5-8dk72\" (UID: \"e8121cde-7d75-458a-ae4a-2bf161be3fa5\") " pod="openshift-ingress/e2e-ait-3c66ec23-openshift-default-67c7544fd5-8dk72"
Jul 09 15:22:26.337682 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:26.337662    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8121cde-7d75-458a-ae4a-2bf161be3fa5-istio-data\") pod \"e2e-ait-3c66ec23-openshift-default-67c7544fd5-8dk72\" (UID: \"e8121cde-7d75-458a-ae4a-2bf161be3fa5\") " pod="openshift-ingress/e2e-ait-3c66ec23-openshift-default-67c7544fd5-8dk72"
Jul 09 15:22:26.337757 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:26.337693    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8121cde-7d75-458a-ae4a-2bf161be3fa5-credential-socket\") pod \"e2e-ait-3c66ec23-openshift-default-67c7544fd5-8dk72\" (UID: \"e8121cde-7d75-458a-ae4a-2bf161be3fa5\") " pod="openshift-ingress/e2e-ait-3c66ec23-openshift-default-67c7544fd5-8dk72"
Jul 09 15:22:26.337800 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:26.337767    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8121cde-7d75-458a-ae4a-2bf161be3fa5-workload-socket\") pod \"e2e-ait-3c66ec23-openshift-default-67c7544fd5-8dk72\" (UID: \"e8121cde-7d75-458a-ae4a-2bf161be3fa5\") " pod="openshift-ingress/e2e-ait-3c66ec23-openshift-default-67c7544fd5-8dk72"
Jul 09 15:22:26.337800 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:26.337792    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8121cde-7d75-458a-ae4a-2bf161be3fa5-istio-token\") pod \"e2e-ait-3c66ec23-openshift-default-67c7544fd5-8dk72\" (UID: \"e8121cde-7d75-458a-ae4a-2bf161be3fa5\") " pod="openshift-ingress/e2e-ait-3c66ec23-openshift-default-67c7544fd5-8dk72"
Jul 09 15:22:26.337899 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:26.337823    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wcvr\" (UniqueName: \"kubernetes.io/projected/e8121cde-7d75-458a-ae4a-2bf161be3fa5-kube-api-access-9wcvr\") pod \"e2e-ait-3c66ec23-openshift-default-67c7544fd5-8dk72\" (UID: \"e8121cde-7d75-458a-ae4a-2bf161be3fa5\") " pod="openshift-ingress/e2e-ait-3c66ec23-openshift-default-67c7544fd5-8dk72"
Jul 09 15:22:26.338196 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:26.338080    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8121cde-7d75-458a-ae4a-2bf161be3fa5-istio-data\") pod \"e2e-ait-3c66ec23-openshift-default-67c7544fd5-8dk72\" (UID: \"e8121cde-7d75-458a-ae4a-2bf161be3fa5\") " pod="openshift-ingress/e2e-ait-3c66ec23-openshift-default-67c7544fd5-8dk72"
Jul 09 15:22:26.338196 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:26.338131    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8121cde-7d75-458a-ae4a-2bf161be3fa5-workload-socket\") pod \"e2e-ait-3c66ec23-openshift-default-67c7544fd5-8dk72\" (UID: \"e8121cde-7d75-458a-ae4a-2bf161be3fa5\") " pod="openshift-ingress/e2e-ait-3c66ec23-openshift-default-67c7544fd5-8dk72"
Jul 09 15:22:26.338196 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:26.338158    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8121cde-7d75-458a-ae4a-2bf161be3fa5-workload-certs\") pod \"e2e-ait-3c66ec23-openshift-default-67c7544fd5-8dk72\" (UID: \"e8121cde-7d75-458a-ae4a-2bf161be3fa5\") " pod="openshift-ingress/e2e-ait-3c66ec23-openshift-default-67c7544fd5-8dk72"
Jul 09 15:22:26.338366 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:26.338341    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8121cde-7d75-458a-ae4a-2bf161be3fa5-credential-socket\") pod \"e2e-ait-3c66ec23-openshift-default-67c7544fd5-8dk72\" (UID: \"e8121cde-7d75-458a-ae4a-2bf161be3fa5\") " pod="openshift-ingress/e2e-ait-3c66ec23-openshift-default-67c7544fd5-8dk72"
Jul 09 15:22:26.338468 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:26.338446    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8121cde-7d75-458a-ae4a-2bf161be3fa5-istiod-ca-cert\") pod \"e2e-ait-3c66ec23-openshift-default-67c7544fd5-8dk72\" (UID: \"e8121cde-7d75-458a-ae4a-2bf161be3fa5\") " pod="openshift-ingress/e2e-ait-3c66ec23-openshift-default-67c7544fd5-8dk72"
Jul 09 15:22:26.339783 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:26.339761    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8121cde-7d75-458a-ae4a-2bf161be3fa5-istio-envoy\") pod \"e2e-ait-3c66ec23-openshift-default-67c7544fd5-8dk72\" (UID: \"e8121cde-7d75-458a-ae4a-2bf161be3fa5\") " pod="openshift-ingress/e2e-ait-3c66ec23-openshift-default-67c7544fd5-8dk72"
Jul 09 15:22:26.340034 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:26.340014    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8121cde-7d75-458a-ae4a-2bf161be3fa5-istio-podinfo\") pod \"e2e-ait-3c66ec23-openshift-default-67c7544fd5-8dk72\" (UID: \"e8121cde-7d75-458a-ae4a-2bf161be3fa5\") " pod="openshift-ingress/e2e-ait-3c66ec23-openshift-default-67c7544fd5-8dk72"
Jul 09 15:22:26.365259 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:26.365224    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8121cde-7d75-458a-ae4a-2bf161be3fa5-istio-token\") pod \"e2e-ait-3c66ec23-openshift-default-67c7544fd5-8dk72\" (UID: \"e8121cde-7d75-458a-ae4a-2bf161be3fa5\") " pod="openshift-ingress/e2e-ait-3c66ec23-openshift-default-67c7544fd5-8dk72"
Jul 09 15:22:26.365413 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:26.365389    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wcvr\" (UniqueName: \"kubernetes.io/projected/e8121cde-7d75-458a-ae4a-2bf161be3fa5-kube-api-access-9wcvr\") pod \"e2e-ait-3c66ec23-openshift-default-67c7544fd5-8dk72\" (UID: \"e8121cde-7d75-458a-ae4a-2bf161be3fa5\") " pod="openshift-ingress/e2e-ait-3c66ec23-openshift-default-67c7544fd5-8dk72"
Jul 09 15:22:26.466411 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:26.466325    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3c66ec23-openshift-default-67c7544fd5-8dk72"
Jul 09 15:22:26.653190 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:26.653160    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-3c66ec23-openshift-default-67c7544fd5-8dk72"]
Jul 09 15:22:26.653822 ip-10-0-137-94 kubenswrapper[2575]: W0709 15:22:26.653798    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8121cde_7d75_458a_ae4a_2bf161be3fa5.slice/crio-5b62c2abf3690f982dc84409ba46f64680c1f9a7b15d373d0ff7ef1b92f9e9b8 WatchSource:0}: Error finding container 5b62c2abf3690f982dc84409ba46f64680c1f9a7b15d373d0ff7ef1b92f9e9b8: Status 404 returned error can't find the container with id 5b62c2abf3690f982dc84409ba46f64680c1f9a7b15d373d0ff7ef1b92f9e9b8
Jul 09 15:22:26.660928 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:26.660872    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 15:22:26.661166 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:26.661143    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 15:22:26.661368 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:26.661342    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 15:22:27.041013 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:27.040935    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3c66ec23-openshift-default-67c7544fd5-8dk72" event={"ID":"e8121cde-7d75-458a-ae4a-2bf161be3fa5","Type":"ContainerStarted","Data":"7a5b8a679354f7c353f8e3de62c7049a2bb4088bb8e3271936231a602cc9d1cd"}
Jul 09 15:22:27.041150 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:27.041014    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3c66ec23-openshift-default-67c7544fd5-8dk72" event={"ID":"e8121cde-7d75-458a-ae4a-2bf161be3fa5","Type":"ContainerStarted","Data":"5b62c2abf3690f982dc84409ba46f64680c1f9a7b15d373d0ff7ef1b92f9e9b8"}
Jul 09 15:22:27.100948 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:27.100896    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-3c66ec23-openshift-default-67c7544fd5-8dk72" podStartSLOduration=1.100880475 podStartE2EDuration="1.100880475s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:22:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:22:27.098297799 +0000 UTC m=+1654.940830732" watchObservedRunningTime="2026-07-09 15:22:27.100880475 +0000 UTC m=+1654.943413631"
Jul 09 15:22:27.317559 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:27.317478    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="968f33d0-5748-464a-8647-bd2d4c1d5b27" path="/var/lib/kubelet/pods/968f33d0-5748-464a-8647-bd2d4c1d5b27/volumes"
Jul 09 15:22:27.410617 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:27.410581    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:22:27.466611 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:27.466582    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-3c66ec23-openshift-default-67c7544fd5-8dk72"
Jul 09 15:22:27.471489 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:27.471467    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-3c66ec23-openshift-default-67c7544fd5-8dk72"
Jul 09 15:22:27.537822 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:27.537790    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3c66ec23-66694f5c9f-fc9rm"]
Jul 09 15:22:27.541602 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:27.541579    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3c66ec23-66694f5c9f-fc9rm"
Jul 09 15:22:27.544774 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:27.544752    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-3c66ec23-serving-cert\""
Jul 09 15:22:27.546002 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:27.545975    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:22:27.566357 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:27.566327    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3c66ec23-66694f5c9f-fc9rm"]
Jul 09 15:22:27.619614 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:27.619500    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:22:27.650316 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:27.650286    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/13beb37b-41ac-41ca-81b6-3652e4175db6-maas-api-tls\") pod \"maas-api-e2e-ait-3c66ec23-66694f5c9f-fc9rm\" (UID: \"13beb37b-41ac-41ca-81b6-3652e4175db6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3c66ec23-66694f5c9f-fc9rm"
Jul 09 15:22:27.650508 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:27.650326    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tqrw\" (UniqueName: \"kubernetes.io/projected/13beb37b-41ac-41ca-81b6-3652e4175db6-kube-api-access-7tqrw\") pod \"maas-api-e2e-ait-3c66ec23-66694f5c9f-fc9rm\" (UID: \"13beb37b-41ac-41ca-81b6-3652e4175db6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3c66ec23-66694f5c9f-fc9rm"
Jul 09 15:22:27.650508 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:27.650405    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/13beb37b-41ac-41ca-81b6-3652e4175db6-openshift-service-ca\") pod \"maas-api-e2e-ait-3c66ec23-66694f5c9f-fc9rm\" (UID: \"13beb37b-41ac-41ca-81b6-3652e4175db6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3c66ec23-66694f5c9f-fc9rm"
Jul 09 15:22:27.751130 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:27.751097    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/13beb37b-41ac-41ca-81b6-3652e4175db6-maas-api-tls\") pod \"maas-api-e2e-ait-3c66ec23-66694f5c9f-fc9rm\" (UID: \"13beb37b-41ac-41ca-81b6-3652e4175db6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3c66ec23-66694f5c9f-fc9rm"
Jul 09 15:22:27.751298 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:27.751137    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tqrw\" (UniqueName: \"kubernetes.io/projected/13beb37b-41ac-41ca-81b6-3652e4175db6-kube-api-access-7tqrw\") pod \"maas-api-e2e-ait-3c66ec23-66694f5c9f-fc9rm\" (UID: \"13beb37b-41ac-41ca-81b6-3652e4175db6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3c66ec23-66694f5c9f-fc9rm"
Jul 09 15:22:27.751298 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:27.751187    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/13beb37b-41ac-41ca-81b6-3652e4175db6-openshift-service-ca\") pod \"maas-api-e2e-ait-3c66ec23-66694f5c9f-fc9rm\" (UID: \"13beb37b-41ac-41ca-81b6-3652e4175db6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3c66ec23-66694f5c9f-fc9rm"
Jul 09 15:22:27.751913 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:27.751893    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/13beb37b-41ac-41ca-81b6-3652e4175db6-openshift-service-ca\") pod \"maas-api-e2e-ait-3c66ec23-66694f5c9f-fc9rm\" (UID: \"13beb37b-41ac-41ca-81b6-3652e4175db6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3c66ec23-66694f5c9f-fc9rm"
Jul 09 15:22:27.753509 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:27.753490    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/13beb37b-41ac-41ca-81b6-3652e4175db6-maas-api-tls\") pod \"maas-api-e2e-ait-3c66ec23-66694f5c9f-fc9rm\" (UID: \"13beb37b-41ac-41ca-81b6-3652e4175db6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3c66ec23-66694f5c9f-fc9rm"
Jul 09 15:22:27.761454 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:27.761431    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tqrw\" (UniqueName: \"kubernetes.io/projected/13beb37b-41ac-41ca-81b6-3652e4175db6-kube-api-access-7tqrw\") pod \"maas-api-e2e-ait-3c66ec23-66694f5c9f-fc9rm\" (UID: \"13beb37b-41ac-41ca-81b6-3652e4175db6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3c66ec23-66694f5c9f-fc9rm"
Jul 09 15:22:27.763413 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:27.763391    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:22:27.854668 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:27.854640    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3c66ec23-66694f5c9f-fc9rm"
Jul 09 15:22:27.992015 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:27.991987    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3c66ec23-66694f5c9f-fc9rm"]
Jul 09 15:22:27.993449 ip-10-0-137-94 kubenswrapper[2575]: W0709 15:22:27.993426    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13beb37b_41ac_41ca_81b6_3652e4175db6.slice/crio-4deef809c08aa8d807e3ae27375ba8c08bae7f4bdeecbbd89c998255fc0c3a08 WatchSource:0}: Error finding container 4deef809c08aa8d807e3ae27375ba8c08bae7f4bdeecbbd89c998255fc0c3a08: Status 404 returned error can't find the container with id 4deef809c08aa8d807e3ae27375ba8c08bae7f4bdeecbbd89c998255fc0c3a08
Jul 09 15:22:28.048366 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:28.048335    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3c66ec23-66694f5c9f-fc9rm" event={"ID":"13beb37b-41ac-41ca-81b6-3652e4175db6","Type":"ContainerStarted","Data":"4deef809c08aa8d807e3ae27375ba8c08bae7f4bdeecbbd89c998255fc0c3a08"}
Jul 09 15:22:28.048741 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:28.048674    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-3c66ec23-openshift-default-67c7544fd5-8dk72"
Jul 09 15:22:28.049419 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:28.049400    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-3c66ec23-openshift-default-67c7544fd5-8dk72"
Jul 09 15:22:28.087351 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:28.087318    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:22:28.184739 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:28.184634    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:22:29.055024 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:29.054988    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3c66ec23-66694f5c9f-fc9rm" event={"ID":"13beb37b-41ac-41ca-81b6-3652e4175db6","Type":"ContainerStarted","Data":"f90c350d667432f993de1fab23d3931ef10f716b34363fc956e70cc33af506c2"}
Jul 09 15:22:29.055395 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:29.055127    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3c66ec23-66694f5c9f-fc9rm"
Jul 09 15:22:29.075046 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:29.075003    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3c66ec23-66694f5c9f-fc9rm" podStartSLOduration=1.740834022 podStartE2EDuration="2.074989607s" totalImagesPullingTime="334.155585ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:22:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:22:29.073479798 +0000 UTC m=+1656.916012753" watchObservedRunningTime="2026-07-09 15:22:29.074989607 +0000 UTC m=+1656.917522538"
Jul 09 15:22:29.912311 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:29.912249    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:22:32.913774 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:32.913740    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3c66ec23-66694f5c9f-fc9rm"]
Jul 09 15:22:32.915149 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:32.914518    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3c66ec23-66694f5c9f-fc9rm" podUID="13beb37b-41ac-41ca-81b6-3652e4175db6" containerName="maas-api" containerID="cri-o://f90c350d667432f993de1fab23d3931ef10f716b34363fc956e70cc33af506c2" gracePeriod=30
Jul 09 15:22:33.079059 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:33.079027    2575 generic.go:356] "Generic (PLEG): container finished" podID="13beb37b-41ac-41ca-81b6-3652e4175db6" containerID="f90c350d667432f993de1fab23d3931ef10f716b34363fc956e70cc33af506c2" exitCode=0
Jul 09 15:22:33.079212 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:33.079098    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3c66ec23-66694f5c9f-fc9rm" event={"ID":"13beb37b-41ac-41ca-81b6-3652e4175db6","Type":"ContainerDied","Data":"f90c350d667432f993de1fab23d3931ef10f716b34363fc956e70cc33af506c2"}
Jul 09 15:22:33.196972 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:33.196947    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3c66ec23-66694f5c9f-fc9rm"
Jul 09 15:22:33.323735 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:33.320233    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/13beb37b-41ac-41ca-81b6-3652e4175db6-openshift-service-ca\") pod \"13beb37b-41ac-41ca-81b6-3652e4175db6\" (UID: \"13beb37b-41ac-41ca-81b6-3652e4175db6\") "
Jul 09 15:22:33.323735 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:33.320324    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7tqrw\" (UniqueName: \"kubernetes.io/projected/13beb37b-41ac-41ca-81b6-3652e4175db6-kube-api-access-7tqrw\") pod \"13beb37b-41ac-41ca-81b6-3652e4175db6\" (UID: \"13beb37b-41ac-41ca-81b6-3652e4175db6\") "
Jul 09 15:22:33.323735 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:33.320431    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/13beb37b-41ac-41ca-81b6-3652e4175db6-maas-api-tls\") pod \"13beb37b-41ac-41ca-81b6-3652e4175db6\" (UID: \"13beb37b-41ac-41ca-81b6-3652e4175db6\") "
Jul 09 15:22:33.323735 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:33.323409    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13beb37b-41ac-41ca-81b6-3652e4175db6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "13beb37b-41ac-41ca-81b6-3652e4175db6" (UID: "13beb37b-41ac-41ca-81b6-3652e4175db6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 15:22:33.323735 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:33.323663    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13beb37b-41ac-41ca-81b6-3652e4175db6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "13beb37b-41ac-41ca-81b6-3652e4175db6" (UID: "13beb37b-41ac-41ca-81b6-3652e4175db6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 15:22:33.334994 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:33.334951    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13beb37b-41ac-41ca-81b6-3652e4175db6-kube-api-access-7tqrw" (OuterVolumeSpecName: "kube-api-access-7tqrw") pod "13beb37b-41ac-41ca-81b6-3652e4175db6" (UID: "13beb37b-41ac-41ca-81b6-3652e4175db6"). InnerVolumeSpecName "kube-api-access-7tqrw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:22:33.421977 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:33.421900    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7tqrw\" (UniqueName: \"kubernetes.io/projected/13beb37b-41ac-41ca-81b6-3652e4175db6-kube-api-access-7tqrw\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:22:33.421977 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:33.421936    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/13beb37b-41ac-41ca-81b6-3652e4175db6-maas-api-tls\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:22:33.421977 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:33.421951    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/13beb37b-41ac-41ca-81b6-3652e4175db6-openshift-service-ca\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:22:34.085848 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:34.085823    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3c66ec23-66694f5c9f-fc9rm"
Jul 09 15:22:34.086222 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:34.085857    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3c66ec23-66694f5c9f-fc9rm" event={"ID":"13beb37b-41ac-41ca-81b6-3652e4175db6","Type":"ContainerDied","Data":"4deef809c08aa8d807e3ae27375ba8c08bae7f4bdeecbbd89c998255fc0c3a08"}
Jul 09 15:22:34.086222 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:34.085920    2575 scope.go:117] "RemoveContainer" containerID="f90c350d667432f993de1fab23d3931ef10f716b34363fc956e70cc33af506c2"
Jul 09 15:22:34.110304 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:34.110273    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3c66ec23-66694f5c9f-fc9rm"]
Jul 09 15:22:34.114051 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:34.114021    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3c66ec23-66694f5c9f-fc9rm"]
Jul 09 15:22:34.972925 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:34.972888    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:22:35.037010 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:35.036978    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:22:35.320938 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:35.320837    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13beb37b-41ac-41ca-81b6-3652e4175db6" path="/var/lib/kubelet/pods/13beb37b-41ac-41ca-81b6-3652e4175db6/volumes"
Jul 09 15:22:38.601776 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:38.601675    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-3c66ec23-openshift-default-67c7544fd5-8dk72"]
Jul 09 15:22:38.602236 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:38.601892    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-3c66ec23-openshift-default-67c7544fd5-8dk72" podUID="e8121cde-7d75-458a-ae4a-2bf161be3fa5" containerName="istio-proxy" containerID="cri-o://7a5b8a679354f7c353f8e3de62c7049a2bb4088bb8e3271936231a602cc9d1cd" gracePeriod=30
Jul 09 15:22:38.617109 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:38.617070    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:22:38.716360 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:38.716325    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:22:38.769169 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:38.769147    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3c66ec23-openshift-default-67c7544fd5-8dk72"
Jul 09 15:22:38.874195 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:38.874163    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8121cde-7d75-458a-ae4a-2bf161be3fa5-istio-token\") pod \"e8121cde-7d75-458a-ae4a-2bf161be3fa5\" (UID: \"e8121cde-7d75-458a-ae4a-2bf161be3fa5\") "
Jul 09 15:22:38.874359 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:38.874220    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8121cde-7d75-458a-ae4a-2bf161be3fa5-credential-socket\") pod \"e8121cde-7d75-458a-ae4a-2bf161be3fa5\" (UID: \"e8121cde-7d75-458a-ae4a-2bf161be3fa5\") "
Jul 09 15:22:38.874359 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:38.874243    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8121cde-7d75-458a-ae4a-2bf161be3fa5-istiod-ca-cert\") pod \"e8121cde-7d75-458a-ae4a-2bf161be3fa5\" (UID: \"e8121cde-7d75-458a-ae4a-2bf161be3fa5\") "
Jul 09 15:22:38.874359 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:38.874284    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8121cde-7d75-458a-ae4a-2bf161be3fa5-workload-certs\") pod \"e8121cde-7d75-458a-ae4a-2bf161be3fa5\" (UID: \"e8121cde-7d75-458a-ae4a-2bf161be3fa5\") "
Jul 09 15:22:38.874359 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:38.874302    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9wcvr\" (UniqueName: \"kubernetes.io/projected/e8121cde-7d75-458a-ae4a-2bf161be3fa5-kube-api-access-9wcvr\") pod \"e8121cde-7d75-458a-ae4a-2bf161be3fa5\" (UID: \"e8121cde-7d75-458a-ae4a-2bf161be3fa5\") "
Jul 09 15:22:38.874359 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:38.874330    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8121cde-7d75-458a-ae4a-2bf161be3fa5-workload-socket\") pod \"e8121cde-7d75-458a-ae4a-2bf161be3fa5\" (UID: \"e8121cde-7d75-458a-ae4a-2bf161be3fa5\") "
Jul 09 15:22:38.874359 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:38.874345    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8121cde-7d75-458a-ae4a-2bf161be3fa5-istio-podinfo\") pod \"e8121cde-7d75-458a-ae4a-2bf161be3fa5\" (UID: \"e8121cde-7d75-458a-ae4a-2bf161be3fa5\") "
Jul 09 15:22:38.874687 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:38.874429    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8121cde-7d75-458a-ae4a-2bf161be3fa5-istio-envoy\") pod \"e8121cde-7d75-458a-ae4a-2bf161be3fa5\" (UID: \"e8121cde-7d75-458a-ae4a-2bf161be3fa5\") "
Jul 09 15:22:38.874687 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:38.874478    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8121cde-7d75-458a-ae4a-2bf161be3fa5-istio-data\") pod \"e8121cde-7d75-458a-ae4a-2bf161be3fa5\" (UID: \"e8121cde-7d75-458a-ae4a-2bf161be3fa5\") "
Jul 09 15:22:38.874687 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:38.874507    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8121cde-7d75-458a-ae4a-2bf161be3fa5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e8121cde-7d75-458a-ae4a-2bf161be3fa5" (UID: "e8121cde-7d75-458a-ae4a-2bf161be3fa5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:22:38.874687 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:38.874657    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8121cde-7d75-458a-ae4a-2bf161be3fa5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e8121cde-7d75-458a-ae4a-2bf161be3fa5" (UID: "e8121cde-7d75-458a-ae4a-2bf161be3fa5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:22:38.874939 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:38.874773    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8121cde-7d75-458a-ae4a-2bf161be3fa5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e8121cde-7d75-458a-ae4a-2bf161be3fa5" (UID: "e8121cde-7d75-458a-ae4a-2bf161be3fa5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 15:22:38.875000 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:38.874974    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8121cde-7d75-458a-ae4a-2bf161be3fa5-credential-socket\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:22:38.875000 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:38.874996    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8121cde-7d75-458a-ae4a-2bf161be3fa5-istiod-ca-cert\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:22:38.875103 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:38.875010    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8121cde-7d75-458a-ae4a-2bf161be3fa5-workload-socket\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:22:38.875161 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:38.875110    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8121cde-7d75-458a-ae4a-2bf161be3fa5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e8121cde-7d75-458a-ae4a-2bf161be3fa5" (UID: "e8121cde-7d75-458a-ae4a-2bf161be3fa5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:22:38.875493 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:38.875467    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8121cde-7d75-458a-ae4a-2bf161be3fa5-istio-data" (OuterVolumeSpecName: "istio-data") pod "e8121cde-7d75-458a-ae4a-2bf161be3fa5" (UID: "e8121cde-7d75-458a-ae4a-2bf161be3fa5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:22:38.876611 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:38.876577    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8121cde-7d75-458a-ae4a-2bf161be3fa5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e8121cde-7d75-458a-ae4a-2bf161be3fa5" (UID: "e8121cde-7d75-458a-ae4a-2bf161be3fa5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:22:38.876746 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:38.876641    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e8121cde-7d75-458a-ae4a-2bf161be3fa5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e8121cde-7d75-458a-ae4a-2bf161be3fa5" (UID: "e8121cde-7d75-458a-ae4a-2bf161be3fa5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 15:22:38.876869 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:38.876845    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8121cde-7d75-458a-ae4a-2bf161be3fa5-istio-token" (OuterVolumeSpecName: "istio-token") pod "e8121cde-7d75-458a-ae4a-2bf161be3fa5" (UID: "e8121cde-7d75-458a-ae4a-2bf161be3fa5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:22:38.876933 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:38.876845    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8121cde-7d75-458a-ae4a-2bf161be3fa5-kube-api-access-9wcvr" (OuterVolumeSpecName: "kube-api-access-9wcvr") pod "e8121cde-7d75-458a-ae4a-2bf161be3fa5" (UID: "e8121cde-7d75-458a-ae4a-2bf161be3fa5"). InnerVolumeSpecName "kube-api-access-9wcvr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:22:38.975453 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:38.975420    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8121cde-7d75-458a-ae4a-2bf161be3fa5-istio-data\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:22:38.975453 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:38.975446    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8121cde-7d75-458a-ae4a-2bf161be3fa5-istio-token\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:22:38.975453 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:38.975455    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8121cde-7d75-458a-ae4a-2bf161be3fa5-workload-certs\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:22:38.975679 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:38.975464    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9wcvr\" (UniqueName: \"kubernetes.io/projected/e8121cde-7d75-458a-ae4a-2bf161be3fa5-kube-api-access-9wcvr\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:22:38.975679 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:38.975475    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8121cde-7d75-458a-ae4a-2bf161be3fa5-istio-podinfo\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:22:38.975679 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:38.975483    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8121cde-7d75-458a-ae4a-2bf161be3fa5-istio-envoy\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:22:39.115885 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:39.115793    2575 generic.go:356] "Generic (PLEG): container finished" podID="e8121cde-7d75-458a-ae4a-2bf161be3fa5" containerID="7a5b8a679354f7c353f8e3de62c7049a2bb4088bb8e3271936231a602cc9d1cd" exitCode=0
Jul 09 15:22:39.115885 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:39.115846    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3c66ec23-openshift-default-67c7544fd5-8dk72"
Jul 09 15:22:39.115885 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:39.115875    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3c66ec23-openshift-default-67c7544fd5-8dk72" event={"ID":"e8121cde-7d75-458a-ae4a-2bf161be3fa5","Type":"ContainerDied","Data":"7a5b8a679354f7c353f8e3de62c7049a2bb4088bb8e3271936231a602cc9d1cd"}
Jul 09 15:22:39.116109 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:39.115963    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3c66ec23-openshift-default-67c7544fd5-8dk72" event={"ID":"e8121cde-7d75-458a-ae4a-2bf161be3fa5","Type":"ContainerDied","Data":"5b62c2abf3690f982dc84409ba46f64680c1f9a7b15d373d0ff7ef1b92f9e9b8"}
Jul 09 15:22:39.116109 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:39.115987    2575 scope.go:117] "RemoveContainer" containerID="7a5b8a679354f7c353f8e3de62c7049a2bb4088bb8e3271936231a602cc9d1cd"
Jul 09 15:22:39.125519 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:39.125500    2575 scope.go:117] "RemoveContainer" containerID="7a5b8a679354f7c353f8e3de62c7049a2bb4088bb8e3271936231a602cc9d1cd"
Jul 09 15:22:39.125755 ip-10-0-137-94 kubenswrapper[2575]: E0709 15:22:39.125737    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a5b8a679354f7c353f8e3de62c7049a2bb4088bb8e3271936231a602cc9d1cd\": container with ID starting with 7a5b8a679354f7c353f8e3de62c7049a2bb4088bb8e3271936231a602cc9d1cd not found: ID does not exist" containerID="7a5b8a679354f7c353f8e3de62c7049a2bb4088bb8e3271936231a602cc9d1cd"
Jul 09 15:22:39.125809 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:39.125763    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a5b8a679354f7c353f8e3de62c7049a2bb4088bb8e3271936231a602cc9d1cd"} err="failed to get container status \"7a5b8a679354f7c353f8e3de62c7049a2bb4088bb8e3271936231a602cc9d1cd\": rpc error: code = NotFound desc = could not find container \"7a5b8a679354f7c353f8e3de62c7049a2bb4088bb8e3271936231a602cc9d1cd\": container with ID starting with 7a5b8a679354f7c353f8e3de62c7049a2bb4088bb8e3271936231a602cc9d1cd not found: ID does not exist"
Jul 09 15:22:39.139810 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:39.139785    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-3c66ec23-openshift-default-67c7544fd5-8dk72"]
Jul 09 15:22:39.144630 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:39.144606    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-3c66ec23-openshift-default-67c7544fd5-8dk72"]
Jul 09 15:22:39.317223 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:39.317191    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8121cde-7d75-458a-ae4a-2bf161be3fa5" path="/var/lib/kubelet/pods/e8121cde-7d75-458a-ae4a-2bf161be3fa5/volumes"
Jul 09 15:22:40.241261 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:40.241217    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:22:45.091545 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:45.091514    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:22:45.163687 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:45.163660    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:22:45.283847 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:45.283811    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-389e1fd1-openshift-default-65dcd9566c-bphkv"]
Jul 09 15:22:45.284271 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:45.284254    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8121cde-7d75-458a-ae4a-2bf161be3fa5" containerName="istio-proxy"
Jul 09 15:22:45.284375 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:45.284273    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8121cde-7d75-458a-ae4a-2bf161be3fa5" containerName="istio-proxy"
Jul 09 15:22:45.284375 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:45.284286    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13beb37b-41ac-41ca-81b6-3652e4175db6" containerName="maas-api"
Jul 09 15:22:45.284375 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:45.284294    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="13beb37b-41ac-41ca-81b6-3652e4175db6" containerName="maas-api"
Jul 09 15:22:45.284523 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:45.284381    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8121cde-7d75-458a-ae4a-2bf161be3fa5" containerName="istio-proxy"
Jul 09 15:22:45.284523 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:45.284395    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="13beb37b-41ac-41ca-81b6-3652e4175db6" containerName="maas-api"
Jul 09 15:22:45.288782 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:45.288761    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-389e1fd1-openshift-default-65dcd9566c-bphkv"
Jul 09 15:22:45.292046 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:45.292027    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-389e1fd1-openshift-default-dockercfg-tgq8l\""
Jul 09 15:22:45.305119 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:45.305092    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-389e1fd1-openshift-default-65dcd9566c-bphkv"]
Jul 09 15:22:45.325891 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:45.325863    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90a6ead5-8654-45a8-a0e1-7dcd196c2d7b-workload-socket\") pod \"e2e-derive-389e1fd1-openshift-default-65dcd9566c-bphkv\" (UID: \"90a6ead5-8654-45a8-a0e1-7dcd196c2d7b\") " pod="openshift-ingress/e2e-derive-389e1fd1-openshift-default-65dcd9566c-bphkv"
Jul 09 15:22:45.326014 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:45.325901    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90a6ead5-8654-45a8-a0e1-7dcd196c2d7b-istio-envoy\") pod \"e2e-derive-389e1fd1-openshift-default-65dcd9566c-bphkv\" (UID: \"90a6ead5-8654-45a8-a0e1-7dcd196c2d7b\") " pod="openshift-ingress/e2e-derive-389e1fd1-openshift-default-65dcd9566c-bphkv"
Jul 09 15:22:45.326014 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:45.325925    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90a6ead5-8654-45a8-a0e1-7dcd196c2d7b-workload-certs\") pod \"e2e-derive-389e1fd1-openshift-default-65dcd9566c-bphkv\" (UID: \"90a6ead5-8654-45a8-a0e1-7dcd196c2d7b\") " pod="openshift-ingress/e2e-derive-389e1fd1-openshift-default-65dcd9566c-bphkv"
Jul 09 15:22:45.326014 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:45.325967    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90a6ead5-8654-45a8-a0e1-7dcd196c2d7b-istio-data\") pod \"e2e-derive-389e1fd1-openshift-default-65dcd9566c-bphkv\" (UID: \"90a6ead5-8654-45a8-a0e1-7dcd196c2d7b\") " pod="openshift-ingress/e2e-derive-389e1fd1-openshift-default-65dcd9566c-bphkv"
Jul 09 15:22:45.326133 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:45.326009    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90a6ead5-8654-45a8-a0e1-7dcd196c2d7b-istiod-ca-cert\") pod \"e2e-derive-389e1fd1-openshift-default-65dcd9566c-bphkv\" (UID: \"90a6ead5-8654-45a8-a0e1-7dcd196c2d7b\") " pod="openshift-ingress/e2e-derive-389e1fd1-openshift-default-65dcd9566c-bphkv"
Jul 09 15:22:45.326133 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:45.326074    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90a6ead5-8654-45a8-a0e1-7dcd196c2d7b-istio-token\") pod \"e2e-derive-389e1fd1-openshift-default-65dcd9566c-bphkv\" (UID: \"90a6ead5-8654-45a8-a0e1-7dcd196c2d7b\") " pod="openshift-ingress/e2e-derive-389e1fd1-openshift-default-65dcd9566c-bphkv"
Jul 09 15:22:45.326225 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:45.326130    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90a6ead5-8654-45a8-a0e1-7dcd196c2d7b-credential-socket\") pod \"e2e-derive-389e1fd1-openshift-default-65dcd9566c-bphkv\" (UID: \"90a6ead5-8654-45a8-a0e1-7dcd196c2d7b\") " pod="openshift-ingress/e2e-derive-389e1fd1-openshift-default-65dcd9566c-bphkv"
Jul 09 15:22:45.326225 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:45.326167    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90a6ead5-8654-45a8-a0e1-7dcd196c2d7b-istio-podinfo\") pod \"e2e-derive-389e1fd1-openshift-default-65dcd9566c-bphkv\" (UID: \"90a6ead5-8654-45a8-a0e1-7dcd196c2d7b\") " pod="openshift-ingress/e2e-derive-389e1fd1-openshift-default-65dcd9566c-bphkv"
Jul 09 15:22:45.326225 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:45.326195    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mq2pf\" (UniqueName: \"kubernetes.io/projected/90a6ead5-8654-45a8-a0e1-7dcd196c2d7b-kube-api-access-mq2pf\") pod \"e2e-derive-389e1fd1-openshift-default-65dcd9566c-bphkv\" (UID: \"90a6ead5-8654-45a8-a0e1-7dcd196c2d7b\") " pod="openshift-ingress/e2e-derive-389e1fd1-openshift-default-65dcd9566c-bphkv"
Jul 09 15:22:45.326814 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:45.326791    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:22:45.426557 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:45.426517    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:22:45.426754 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:45.426626    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90a6ead5-8654-45a8-a0e1-7dcd196c2d7b-workload-certs\") pod \"e2e-derive-389e1fd1-openshift-default-65dcd9566c-bphkv\" (UID: \"90a6ead5-8654-45a8-a0e1-7dcd196c2d7b\") " pod="openshift-ingress/e2e-derive-389e1fd1-openshift-default-65dcd9566c-bphkv"
Jul 09 15:22:45.426754 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:45.426656    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90a6ead5-8654-45a8-a0e1-7dcd196c2d7b-istio-data\") pod \"e2e-derive-389e1fd1-openshift-default-65dcd9566c-bphkv\" (UID: \"90a6ead5-8654-45a8-a0e1-7dcd196c2d7b\") " pod="openshift-ingress/e2e-derive-389e1fd1-openshift-default-65dcd9566c-bphkv"
Jul 09 15:22:45.426754 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:45.426683    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90a6ead5-8654-45a8-a0e1-7dcd196c2d7b-istiod-ca-cert\") pod \"e2e-derive-389e1fd1-openshift-default-65dcd9566c-bphkv\" (UID: \"90a6ead5-8654-45a8-a0e1-7dcd196c2d7b\") " pod="openshift-ingress/e2e-derive-389e1fd1-openshift-default-65dcd9566c-bphkv"
Jul 09 15:22:45.426754 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:45.426749    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90a6ead5-8654-45a8-a0e1-7dcd196c2d7b-istio-token\") pod \"e2e-derive-389e1fd1-openshift-default-65dcd9566c-bphkv\" (UID: \"90a6ead5-8654-45a8-a0e1-7dcd196c2d7b\") " pod="openshift-ingress/e2e-derive-389e1fd1-openshift-default-65dcd9566c-bphkv"
Jul 09 15:22:45.426936 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:45.426789    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90a6ead5-8654-45a8-a0e1-7dcd196c2d7b-credential-socket\") pod \"e2e-derive-389e1fd1-openshift-default-65dcd9566c-bphkv\" (UID: \"90a6ead5-8654-45a8-a0e1-7dcd196c2d7b\") " pod="openshift-ingress/e2e-derive-389e1fd1-openshift-default-65dcd9566c-bphkv"
Jul 09 15:22:45.426936 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:45.426822    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90a6ead5-8654-45a8-a0e1-7dcd196c2d7b-istio-podinfo\") pod \"e2e-derive-389e1fd1-openshift-default-65dcd9566c-bphkv\" (UID: \"90a6ead5-8654-45a8-a0e1-7dcd196c2d7b\") " pod="openshift-ingress/e2e-derive-389e1fd1-openshift-default-65dcd9566c-bphkv"
Jul 09 15:22:45.426936 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:45.426848    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mq2pf\" (UniqueName: \"kubernetes.io/projected/90a6ead5-8654-45a8-a0e1-7dcd196c2d7b-kube-api-access-mq2pf\") pod \"e2e-derive-389e1fd1-openshift-default-65dcd9566c-bphkv\" (UID: \"90a6ead5-8654-45a8-a0e1-7dcd196c2d7b\") " pod="openshift-ingress/e2e-derive-389e1fd1-openshift-default-65dcd9566c-bphkv"
Jul 09 15:22:45.427124 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:45.427103    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90a6ead5-8654-45a8-a0e1-7dcd196c2d7b-workload-socket\") pod \"e2e-derive-389e1fd1-openshift-default-65dcd9566c-bphkv\" (UID: \"90a6ead5-8654-45a8-a0e1-7dcd196c2d7b\") " pod="openshift-ingress/e2e-derive-389e1fd1-openshift-default-65dcd9566c-bphkv"
Jul 09 15:22:45.427165 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:45.427125    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90a6ead5-8654-45a8-a0e1-7dcd196c2d7b-istio-data\") pod \"e2e-derive-389e1fd1-openshift-default-65dcd9566c-bphkv\" (UID: \"90a6ead5-8654-45a8-a0e1-7dcd196c2d7b\") " pod="openshift-ingress/e2e-derive-389e1fd1-openshift-default-65dcd9566c-bphkv"
Jul 09 15:22:45.427165 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:45.427139    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90a6ead5-8654-45a8-a0e1-7dcd196c2d7b-istio-envoy\") pod \"e2e-derive-389e1fd1-openshift-default-65dcd9566c-bphkv\" (UID: \"90a6ead5-8654-45a8-a0e1-7dcd196c2d7b\") " pod="openshift-ingress/e2e-derive-389e1fd1-openshift-default-65dcd9566c-bphkv"
Jul 09 15:22:45.427359 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:45.427338    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90a6ead5-8654-45a8-a0e1-7dcd196c2d7b-workload-certs\") pod \"e2e-derive-389e1fd1-openshift-default-65dcd9566c-bphkv\" (UID: \"90a6ead5-8654-45a8-a0e1-7dcd196c2d7b\") " pod="openshift-ingress/e2e-derive-389e1fd1-openshift-default-65dcd9566c-bphkv"
Jul 09 15:22:45.427484 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:45.427437    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90a6ead5-8654-45a8-a0e1-7dcd196c2d7b-credential-socket\") pod \"e2e-derive-389e1fd1-openshift-default-65dcd9566c-bphkv\" (UID: \"90a6ead5-8654-45a8-a0e1-7dcd196c2d7b\") " pod="openshift-ingress/e2e-derive-389e1fd1-openshift-default-65dcd9566c-bphkv"
Jul 09 15:22:45.427550 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:45.427526    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90a6ead5-8654-45a8-a0e1-7dcd196c2d7b-workload-socket\") pod \"e2e-derive-389e1fd1-openshift-default-65dcd9566c-bphkv\" (UID: \"90a6ead5-8654-45a8-a0e1-7dcd196c2d7b\") " pod="openshift-ingress/e2e-derive-389e1fd1-openshift-default-65dcd9566c-bphkv"
Jul 09 15:22:45.427723 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:45.427686    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90a6ead5-8654-45a8-a0e1-7dcd196c2d7b-istiod-ca-cert\") pod \"e2e-derive-389e1fd1-openshift-default-65dcd9566c-bphkv\" (UID: \"90a6ead5-8654-45a8-a0e1-7dcd196c2d7b\") " pod="openshift-ingress/e2e-derive-389e1fd1-openshift-default-65dcd9566c-bphkv"
Jul 09 15:22:45.429459 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:45.429440    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90a6ead5-8654-45a8-a0e1-7dcd196c2d7b-istio-podinfo\") pod \"e2e-derive-389e1fd1-openshift-default-65dcd9566c-bphkv\" (UID: \"90a6ead5-8654-45a8-a0e1-7dcd196c2d7b\") " pod="openshift-ingress/e2e-derive-389e1fd1-openshift-default-65dcd9566c-bphkv"
Jul 09 15:22:45.429530 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:45.429444    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90a6ead5-8654-45a8-a0e1-7dcd196c2d7b-istio-envoy\") pod \"e2e-derive-389e1fd1-openshift-default-65dcd9566c-bphkv\" (UID: \"90a6ead5-8654-45a8-a0e1-7dcd196c2d7b\") " pod="openshift-ingress/e2e-derive-389e1fd1-openshift-default-65dcd9566c-bphkv"
Jul 09 15:22:45.439090 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:45.439059    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90a6ead5-8654-45a8-a0e1-7dcd196c2d7b-istio-token\") pod \"e2e-derive-389e1fd1-openshift-default-65dcd9566c-bphkv\" (UID: \"90a6ead5-8654-45a8-a0e1-7dcd196c2d7b\") " pod="openshift-ingress/e2e-derive-389e1fd1-openshift-default-65dcd9566c-bphkv"
Jul 09 15:22:45.439448 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:45.439429    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mq2pf\" (UniqueName: \"kubernetes.io/projected/90a6ead5-8654-45a8-a0e1-7dcd196c2d7b-kube-api-access-mq2pf\") pod \"e2e-derive-389e1fd1-openshift-default-65dcd9566c-bphkv\" (UID: \"90a6ead5-8654-45a8-a0e1-7dcd196c2d7b\") " pod="openshift-ingress/e2e-derive-389e1fd1-openshift-default-65dcd9566c-bphkv"
Jul 09 15:22:45.599786 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:45.599745    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-389e1fd1-openshift-default-65dcd9566c-bphkv"
Jul 09 15:22:45.741473 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:45.741443    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-389e1fd1-openshift-default-65dcd9566c-bphkv"]
Jul 09 15:22:45.743351 ip-10-0-137-94 kubenswrapper[2575]: W0709 15:22:45.743314    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90a6ead5_8654_45a8_a0e1_7dcd196c2d7b.slice/crio-4c790b20971a5c72ab10ec073b2db51f1ee96e86d251d0026270a9c94ee706f3 WatchSource:0}: Error finding container 4c790b20971a5c72ab10ec073b2db51f1ee96e86d251d0026270a9c94ee706f3: Status 404 returned error can't find the container with id 4c790b20971a5c72ab10ec073b2db51f1ee96e86d251d0026270a9c94ee706f3
Jul 09 15:22:45.745450 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:45.745419    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 15:22:45.745550 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:45.745492    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 15:22:45.745550 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:45.745539    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 15:22:46.155529 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:46.155501    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-389e1fd1-openshift-default-65dcd9566c-bphkv" event={"ID":"90a6ead5-8654-45a8-a0e1-7dcd196c2d7b","Type":"ContainerStarted","Data":"ad47535d09f18b5ba700de8ef608bc24c518dd39ee53639179ada4d7c66f1cb7"}
Jul 09 15:22:46.156025 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:46.155549    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-389e1fd1-openshift-default-65dcd9566c-bphkv" event={"ID":"90a6ead5-8654-45a8-a0e1-7dcd196c2d7b","Type":"ContainerStarted","Data":"4c790b20971a5c72ab10ec073b2db51f1ee96e86d251d0026270a9c94ee706f3"}
Jul 09 15:22:46.181640 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:46.181592    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-389e1fd1-openshift-default-65dcd9566c-bphkv" podStartSLOduration=1.181576704 podStartE2EDuration="1.181576704s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:22:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:22:46.179480344 +0000 UTC m=+1674.022013275" watchObservedRunningTime="2026-07-09 15:22:46.181576704 +0000 UTC m=+1674.024109636"
Jul 09 15:22:46.527473 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:46.527385    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:22:46.600696 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:46.600663    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-389e1fd1-openshift-default-65dcd9566c-bphkv"
Jul 09 15:22:46.606285 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:46.606256    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-389e1fd1-openshift-default-65dcd9566c-bphkv"
Jul 09 15:22:46.625769 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:46.625735    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:22:46.772791 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:46.772759    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-389e1fd1-7bb778f464-g5l56"]
Jul 09 15:22:46.776932 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:46.776910    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-389e1fd1-7bb778f464-g5l56"
Jul 09 15:22:46.779680 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:46.779622    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-389e1fd1-serving-cert\""
Jul 09 15:22:46.790384 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:46.790362    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-389e1fd1-7bb778f464-g5l56"]
Jul 09 15:22:46.811893 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:46.811853    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:22:46.838194 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:46.838160    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7cea8b7b-60f4-478c-9742-c42ac5d13192-maas-api-tls\") pod \"maas-api-e2e-derive-389e1fd1-7bb778f464-g5l56\" (UID: \"7cea8b7b-60f4-478c-9742-c42ac5d13192\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-389e1fd1-7bb778f464-g5l56"
Jul 09 15:22:46.838319 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:46.838238    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7cea8b7b-60f4-478c-9742-c42ac5d13192-openshift-service-ca\") pod \"maas-api-e2e-derive-389e1fd1-7bb778f464-g5l56\" (UID: \"7cea8b7b-60f4-478c-9742-c42ac5d13192\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-389e1fd1-7bb778f464-g5l56"
Jul 09 15:22:46.838319 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:46.838263    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfbdc\" (UniqueName: \"kubernetes.io/projected/7cea8b7b-60f4-478c-9742-c42ac5d13192-kube-api-access-dfbdc\") pod \"maas-api-e2e-derive-389e1fd1-7bb778f464-g5l56\" (UID: \"7cea8b7b-60f4-478c-9742-c42ac5d13192\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-389e1fd1-7bb778f464-g5l56"
Jul 09 15:22:46.938974 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:46.938940    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7cea8b7b-60f4-478c-9742-c42ac5d13192-maas-api-tls\") pod \"maas-api-e2e-derive-389e1fd1-7bb778f464-g5l56\" (UID: \"7cea8b7b-60f4-478c-9742-c42ac5d13192\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-389e1fd1-7bb778f464-g5l56"
Jul 09 15:22:46.939118 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:46.939020    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7cea8b7b-60f4-478c-9742-c42ac5d13192-openshift-service-ca\") pod \"maas-api-e2e-derive-389e1fd1-7bb778f464-g5l56\" (UID: \"7cea8b7b-60f4-478c-9742-c42ac5d13192\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-389e1fd1-7bb778f464-g5l56"
Jul 09 15:22:46.939118 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:46.939043    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfbdc\" (UniqueName: \"kubernetes.io/projected/7cea8b7b-60f4-478c-9742-c42ac5d13192-kube-api-access-dfbdc\") pod \"maas-api-e2e-derive-389e1fd1-7bb778f464-g5l56\" (UID: \"7cea8b7b-60f4-478c-9742-c42ac5d13192\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-389e1fd1-7bb778f464-g5l56"
Jul 09 15:22:46.939717 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:46.939690    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7cea8b7b-60f4-478c-9742-c42ac5d13192-openshift-service-ca\") pod \"maas-api-e2e-derive-389e1fd1-7bb778f464-g5l56\" (UID: \"7cea8b7b-60f4-478c-9742-c42ac5d13192\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-389e1fd1-7bb778f464-g5l56"
Jul 09 15:22:46.941362 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:46.941341    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7cea8b7b-60f4-478c-9742-c42ac5d13192-maas-api-tls\") pod \"maas-api-e2e-derive-389e1fd1-7bb778f464-g5l56\" (UID: \"7cea8b7b-60f4-478c-9742-c42ac5d13192\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-389e1fd1-7bb778f464-g5l56"
Jul 09 15:22:46.945323 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:46.945296    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:22:46.948225 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:46.948204    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfbdc\" (UniqueName: \"kubernetes.io/projected/7cea8b7b-60f4-478c-9742-c42ac5d13192-kube-api-access-dfbdc\") pod \"maas-api-e2e-derive-389e1fd1-7bb778f464-g5l56\" (UID: \"7cea8b7b-60f4-478c-9742-c42ac5d13192\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-389e1fd1-7bb778f464-g5l56"
Jul 09 15:22:47.089681 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:47.089588    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-389e1fd1-7bb778f464-g5l56"
Jul 09 15:22:47.161232 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:47.161204    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-389e1fd1-openshift-default-65dcd9566c-bphkv"
Jul 09 15:22:47.162091 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:47.162074    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-389e1fd1-openshift-default-65dcd9566c-bphkv"
Jul 09 15:22:47.238309 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:47.238278    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-389e1fd1-7bb778f464-g5l56"]
Jul 09 15:22:47.240735 ip-10-0-137-94 kubenswrapper[2575]: W0709 15:22:47.240697    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cea8b7b_60f4_478c_9742_c42ac5d13192.slice/crio-528a112343c7204c2aec865a1d324b876cb81375f4d617361ffb5d23168cd0d3 WatchSource:0}: Error finding container 528a112343c7204c2aec865a1d324b876cb81375f4d617361ffb5d23168cd0d3: Status 404 returned error can't find the container with id 528a112343c7204c2aec865a1d324b876cb81375f4d617361ffb5d23168cd0d3
Jul 09 15:22:47.308063 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:47.308026    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:22:47.410514 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:47.410478    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:22:48.167829 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:48.167787    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-389e1fd1-7bb778f464-g5l56" event={"ID":"7cea8b7b-60f4-478c-9742-c42ac5d13192","Type":"ContainerStarted","Data":"ad1498a79dadd7d7f1f7c13a9fb6d1cad86cd60f28d023df5c9a53ec0abe754b"}
Jul 09 15:22:48.168204 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:48.167876    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-389e1fd1-7bb778f464-g5l56" event={"ID":"7cea8b7b-60f4-478c-9742-c42ac5d13192","Type":"ContainerStarted","Data":"528a112343c7204c2aec865a1d324b876cb81375f4d617361ffb5d23168cd0d3"}
Jul 09 15:22:48.187702 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:48.187651    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-389e1fd1-7bb778f464-g5l56" podStartSLOduration=1.769102999 podStartE2EDuration="2.187637924s" totalImagesPullingTime="418.534925ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:22:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:22:48.18702888 +0000 UTC m=+1676.029561818" watchObservedRunningTime="2026-07-09 15:22:48.187637924 +0000 UTC m=+1676.030170855"
Jul 09 15:22:48.731673 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:48.731633    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:22:49.173192 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:49.173159    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-389e1fd1-7bb778f464-g5l56"
Jul 09 15:22:50.915311 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:50.915272    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:22:51.097513 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:51.097475    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-389e1fd1-openshift-default-65dcd9566c-bphkv"]
Jul 09 15:22:51.097687 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:51.097665    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-389e1fd1-openshift-default-65dcd9566c-bphkv" podUID="90a6ead5-8654-45a8-a0e1-7dcd196c2d7b" containerName="istio-proxy" containerID="cri-o://ad47535d09f18b5ba700de8ef608bc24c518dd39ee53639179ada4d7c66f1cb7" gracePeriod=30
Jul 09 15:22:51.121403 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:51.121348    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:22:51.222090 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:51.221995    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:22:51.489254 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:51.489156    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-389e1fd1-7bb778f464-g5l56"]
Jul 09 15:22:51.489420 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:51.489395    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-389e1fd1-7bb778f464-g5l56" podUID="7cea8b7b-60f4-478c-9742-c42ac5d13192" containerName="maas-api" containerID="cri-o://ad1498a79dadd7d7f1f7c13a9fb6d1cad86cd60f28d023df5c9a53ec0abe754b" gracePeriod=30
Jul 09 15:22:51.526170 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:51.526116    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:22:51.769056 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:51.769033    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-389e1fd1-7bb778f464-g5l56"
Jul 09 15:22:51.887018 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:51.886980    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dfbdc\" (UniqueName: \"kubernetes.io/projected/7cea8b7b-60f4-478c-9742-c42ac5d13192-kube-api-access-dfbdc\") pod \"7cea8b7b-60f4-478c-9742-c42ac5d13192\" (UID: \"7cea8b7b-60f4-478c-9742-c42ac5d13192\") "
Jul 09 15:22:51.887191 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:51.887025    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7cea8b7b-60f4-478c-9742-c42ac5d13192-maas-api-tls\") pod \"7cea8b7b-60f4-478c-9742-c42ac5d13192\" (UID: \"7cea8b7b-60f4-478c-9742-c42ac5d13192\") "
Jul 09 15:22:51.887191 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:51.887137    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7cea8b7b-60f4-478c-9742-c42ac5d13192-openshift-service-ca\") pod \"7cea8b7b-60f4-478c-9742-c42ac5d13192\" (UID: \"7cea8b7b-60f4-478c-9742-c42ac5d13192\") "
Jul 09 15:22:51.887488 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:51.887459    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7cea8b7b-60f4-478c-9742-c42ac5d13192-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7cea8b7b-60f4-478c-9742-c42ac5d13192" (UID: "7cea8b7b-60f4-478c-9742-c42ac5d13192"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 15:22:51.889109 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:51.889082    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7cea8b7b-60f4-478c-9742-c42ac5d13192-kube-api-access-dfbdc" (OuterVolumeSpecName: "kube-api-access-dfbdc") pod "7cea8b7b-60f4-478c-9742-c42ac5d13192" (UID: "7cea8b7b-60f4-478c-9742-c42ac5d13192"). InnerVolumeSpecName "kube-api-access-dfbdc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:22:51.889109 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:51.889094    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7cea8b7b-60f4-478c-9742-c42ac5d13192-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7cea8b7b-60f4-478c-9742-c42ac5d13192" (UID: "7cea8b7b-60f4-478c-9742-c42ac5d13192"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 15:22:51.988505 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:51.988474    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7cea8b7b-60f4-478c-9742-c42ac5d13192-openshift-service-ca\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:22:51.988505 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:51.988500    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dfbdc\" (UniqueName: \"kubernetes.io/projected/7cea8b7b-60f4-478c-9742-c42ac5d13192-kube-api-access-dfbdc\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:22:51.988505 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:51.988511    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7cea8b7b-60f4-478c-9742-c42ac5d13192-maas-api-tls\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:22:52.190672 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:52.190632    2575 generic.go:356] "Generic (PLEG): container finished" podID="7cea8b7b-60f4-478c-9742-c42ac5d13192" containerID="ad1498a79dadd7d7f1f7c13a9fb6d1cad86cd60f28d023df5c9a53ec0abe754b" exitCode=0
Jul 09 15:22:52.190672 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:52.190673    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-389e1fd1-7bb778f464-g5l56" event={"ID":"7cea8b7b-60f4-478c-9742-c42ac5d13192","Type":"ContainerDied","Data":"ad1498a79dadd7d7f1f7c13a9fb6d1cad86cd60f28d023df5c9a53ec0abe754b"}
Jul 09 15:22:52.190939 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:52.190678    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-389e1fd1-7bb778f464-g5l56"
Jul 09 15:22:52.190939 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:52.190739    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-389e1fd1-7bb778f464-g5l56" event={"ID":"7cea8b7b-60f4-478c-9742-c42ac5d13192","Type":"ContainerDied","Data":"528a112343c7204c2aec865a1d324b876cb81375f4d617361ffb5d23168cd0d3"}
Jul 09 15:22:52.190939 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:52.190763    2575 scope.go:117] "RemoveContainer" containerID="ad1498a79dadd7d7f1f7c13a9fb6d1cad86cd60f28d023df5c9a53ec0abe754b"
Jul 09 15:22:52.200421 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:52.200404    2575 scope.go:117] "RemoveContainer" containerID="ad1498a79dadd7d7f1f7c13a9fb6d1cad86cd60f28d023df5c9a53ec0abe754b"
Jul 09 15:22:52.200673 ip-10-0-137-94 kubenswrapper[2575]: E0709 15:22:52.200655    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad1498a79dadd7d7f1f7c13a9fb6d1cad86cd60f28d023df5c9a53ec0abe754b\": container with ID starting with ad1498a79dadd7d7f1f7c13a9fb6d1cad86cd60f28d023df5c9a53ec0abe754b not found: ID does not exist" containerID="ad1498a79dadd7d7f1f7c13a9fb6d1cad86cd60f28d023df5c9a53ec0abe754b"
Jul 09 15:22:52.200739 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:52.200683    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad1498a79dadd7d7f1f7c13a9fb6d1cad86cd60f28d023df5c9a53ec0abe754b"} err="failed to get container status \"ad1498a79dadd7d7f1f7c13a9fb6d1cad86cd60f28d023df5c9a53ec0abe754b\": rpc error: code = NotFound desc = could not find container \"ad1498a79dadd7d7f1f7c13a9fb6d1cad86cd60f28d023df5c9a53ec0abe754b\": container with ID starting with ad1498a79dadd7d7f1f7c13a9fb6d1cad86cd60f28d023df5c9a53ec0abe754b not found: ID does not exist"
Jul 09 15:22:52.215135 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:52.215067    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-389e1fd1-7bb778f464-g5l56"]
Jul 09 15:22:52.225736 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:52.223466    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-389e1fd1-7bb778f464-g5l56"]
Jul 09 15:22:52.646503 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:52.646462    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:22:53.330542 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:53.330504    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7cea8b7b-60f4-478c-9742-c42ac5d13192" path="/var/lib/kubelet/pods/7cea8b7b-60f4-478c-9742-c42ac5d13192/volumes"
Jul 09 15:22:57.371392 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:57.371356    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:22:57.437446 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:57.437402    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:22:57.867939 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:57.867891    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:22:57.960186 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:57.960139    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:22:58.121641 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:58.121547    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:22:58.226771 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:58.226703    2575 generic.go:356] "Generic (PLEG): container finished" podID="90a6ead5-8654-45a8-a0e1-7dcd196c2d7b" containerID="ad47535d09f18b5ba700de8ef608bc24c518dd39ee53639179ada4d7c66f1cb7" exitCode=0
Jul 09 15:22:58.226931 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:58.226781    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-389e1fd1-openshift-default-65dcd9566c-bphkv" event={"ID":"90a6ead5-8654-45a8-a0e1-7dcd196c2d7b","Type":"ContainerDied","Data":"ad47535d09f18b5ba700de8ef608bc24c518dd39ee53639179ada4d7c66f1cb7"}
Jul 09 15:22:58.559011 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:58.558985    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-389e1fd1-openshift-default-65dcd9566c-bphkv"
Jul 09 15:22:58.651643 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:58.651614    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90a6ead5-8654-45a8-a0e1-7dcd196c2d7b-istio-data\") pod \"90a6ead5-8654-45a8-a0e1-7dcd196c2d7b\" (UID: \"90a6ead5-8654-45a8-a0e1-7dcd196c2d7b\") "
Jul 09 15:22:58.651861 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:58.651657    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90a6ead5-8654-45a8-a0e1-7dcd196c2d7b-workload-socket\") pod \"90a6ead5-8654-45a8-a0e1-7dcd196c2d7b\" (UID: \"90a6ead5-8654-45a8-a0e1-7dcd196c2d7b\") "
Jul 09 15:22:58.651861 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:58.651691    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90a6ead5-8654-45a8-a0e1-7dcd196c2d7b-istio-token\") pod \"90a6ead5-8654-45a8-a0e1-7dcd196c2d7b\" (UID: \"90a6ead5-8654-45a8-a0e1-7dcd196c2d7b\") "
Jul 09 15:22:58.651861 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:58.651734    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mq2pf\" (UniqueName: \"kubernetes.io/projected/90a6ead5-8654-45a8-a0e1-7dcd196c2d7b-kube-api-access-mq2pf\") pod \"90a6ead5-8654-45a8-a0e1-7dcd196c2d7b\" (UID: \"90a6ead5-8654-45a8-a0e1-7dcd196c2d7b\") "
Jul 09 15:22:58.651861 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:58.651781    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90a6ead5-8654-45a8-a0e1-7dcd196c2d7b-workload-certs\") pod \"90a6ead5-8654-45a8-a0e1-7dcd196c2d7b\" (UID: \"90a6ead5-8654-45a8-a0e1-7dcd196c2d7b\") "
Jul 09 15:22:58.651861 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:58.651830    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90a6ead5-8654-45a8-a0e1-7dcd196c2d7b-credential-socket\") pod \"90a6ead5-8654-45a8-a0e1-7dcd196c2d7b\" (UID: \"90a6ead5-8654-45a8-a0e1-7dcd196c2d7b\") "
Jul 09 15:22:58.651861 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:58.651855    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90a6ead5-8654-45a8-a0e1-7dcd196c2d7b-istio-envoy\") pod \"90a6ead5-8654-45a8-a0e1-7dcd196c2d7b\" (UID: \"90a6ead5-8654-45a8-a0e1-7dcd196c2d7b\") "
Jul 09 15:22:58.652248 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:58.651880    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90a6ead5-8654-45a8-a0e1-7dcd196c2d7b-istiod-ca-cert\") pod \"90a6ead5-8654-45a8-a0e1-7dcd196c2d7b\" (UID: \"90a6ead5-8654-45a8-a0e1-7dcd196c2d7b\") "
Jul 09 15:22:58.652248 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:58.651927    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90a6ead5-8654-45a8-a0e1-7dcd196c2d7b-istio-podinfo\") pod \"90a6ead5-8654-45a8-a0e1-7dcd196c2d7b\" (UID: \"90a6ead5-8654-45a8-a0e1-7dcd196c2d7b\") "
Jul 09 15:22:58.652248 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:58.651976    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90a6ead5-8654-45a8-a0e1-7dcd196c2d7b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "90a6ead5-8654-45a8-a0e1-7dcd196c2d7b" (UID: "90a6ead5-8654-45a8-a0e1-7dcd196c2d7b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:22:58.652248 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:58.652145    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90a6ead5-8654-45a8-a0e1-7dcd196c2d7b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "90a6ead5-8654-45a8-a0e1-7dcd196c2d7b" (UID: "90a6ead5-8654-45a8-a0e1-7dcd196c2d7b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:22:58.652248 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:58.652246    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90a6ead5-8654-45a8-a0e1-7dcd196c2d7b-workload-certs\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:22:58.652504 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:58.652264    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90a6ead5-8654-45a8-a0e1-7dcd196c2d7b-workload-socket\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:22:58.652504 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:58.652447    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90a6ead5-8654-45a8-a0e1-7dcd196c2d7b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "90a6ead5-8654-45a8-a0e1-7dcd196c2d7b" (UID: "90a6ead5-8654-45a8-a0e1-7dcd196c2d7b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 15:22:58.652504 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:58.652445    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90a6ead5-8654-45a8-a0e1-7dcd196c2d7b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "90a6ead5-8654-45a8-a0e1-7dcd196c2d7b" (UID: "90a6ead5-8654-45a8-a0e1-7dcd196c2d7b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:22:58.652504 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:58.652448    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90a6ead5-8654-45a8-a0e1-7dcd196c2d7b-istio-data" (OuterVolumeSpecName: "istio-data") pod "90a6ead5-8654-45a8-a0e1-7dcd196c2d7b" (UID: "90a6ead5-8654-45a8-a0e1-7dcd196c2d7b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:22:58.654098 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:58.654069    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90a6ead5-8654-45a8-a0e1-7dcd196c2d7b-istio-token" (OuterVolumeSpecName: "istio-token") pod "90a6ead5-8654-45a8-a0e1-7dcd196c2d7b" (UID: "90a6ead5-8654-45a8-a0e1-7dcd196c2d7b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:22:58.654195 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:58.654131    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90a6ead5-8654-45a8-a0e1-7dcd196c2d7b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "90a6ead5-8654-45a8-a0e1-7dcd196c2d7b" (UID: "90a6ead5-8654-45a8-a0e1-7dcd196c2d7b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:22:58.654379 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:58.654345    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/90a6ead5-8654-45a8-a0e1-7dcd196c2d7b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "90a6ead5-8654-45a8-a0e1-7dcd196c2d7b" (UID: "90a6ead5-8654-45a8-a0e1-7dcd196c2d7b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 15:22:58.654379 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:58.654351    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90a6ead5-8654-45a8-a0e1-7dcd196c2d7b-kube-api-access-mq2pf" (OuterVolumeSpecName: "kube-api-access-mq2pf") pod "90a6ead5-8654-45a8-a0e1-7dcd196c2d7b" (UID: "90a6ead5-8654-45a8-a0e1-7dcd196c2d7b"). InnerVolumeSpecName "kube-api-access-mq2pf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:22:58.753067 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:58.752977    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90a6ead5-8654-45a8-a0e1-7dcd196c2d7b-istio-data\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:22:58.753067 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:58.753006    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90a6ead5-8654-45a8-a0e1-7dcd196c2d7b-istio-token\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:22:58.753067 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:58.753017    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mq2pf\" (UniqueName: \"kubernetes.io/projected/90a6ead5-8654-45a8-a0e1-7dcd196c2d7b-kube-api-access-mq2pf\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:22:58.753067 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:58.753028    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90a6ead5-8654-45a8-a0e1-7dcd196c2d7b-credential-socket\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:22:58.753067 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:58.753037    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90a6ead5-8654-45a8-a0e1-7dcd196c2d7b-istio-envoy\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:22:58.753067 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:58.753046    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90a6ead5-8654-45a8-a0e1-7dcd196c2d7b-istiod-ca-cert\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:22:58.753067 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:58.753053    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90a6ead5-8654-45a8-a0e1-7dcd196c2d7b-istio-podinfo\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:22:59.233600 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:59.233570    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-389e1fd1-openshift-default-65dcd9566c-bphkv"
Jul 09 15:22:59.233600 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:59.233577    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-389e1fd1-openshift-default-65dcd9566c-bphkv" event={"ID":"90a6ead5-8654-45a8-a0e1-7dcd196c2d7b","Type":"ContainerDied","Data":"4c790b20971a5c72ab10ec073b2db51f1ee96e86d251d0026270a9c94ee706f3"}
Jul 09 15:22:59.233898 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:59.233635    2575 scope.go:117] "RemoveContainer" containerID="ad47535d09f18b5ba700de8ef608bc24c518dd39ee53639179ada4d7c66f1cb7"
Jul 09 15:22:59.263993 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:59.263967    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-389e1fd1-openshift-default-65dcd9566c-bphkv"]
Jul 09 15:22:59.267380 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:59.267359    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-389e1fd1-openshift-default-65dcd9566c-bphkv"]
Jul 09 15:22:59.316561 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:59.316526    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90a6ead5-8654-45a8-a0e1-7dcd196c2d7b" path="/var/lib/kubelet/pods/90a6ead5-8654-45a8-a0e1-7dcd196c2d7b/volumes"
Jul 09 15:22:59.551007 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:22:59.550905    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:23:05.761384 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:23:05.761338    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:23:05.880971 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:23:05.880937    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:23:05.964800 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:23:05.964766    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:23:06.065811 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:23:06.065693    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:23:06.496778 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:23:06.496750    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:23:32.540203 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:23:32.540165    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:23:38.910038 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:23:38.910003    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:23:38.971633 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:23:38.971602    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:23:39.088051 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:23:39.088018    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:23:39.188522 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:23:39.188431    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:23:55.065075 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:23:55.065034    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:24:01.879737 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:01.879683    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:24:01.965089 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:01.965052    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:24:02.067695 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:02.067665    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:24:12.693854 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:12.693808    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:24:13.569204 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:13.569165    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:24:19.691433 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:19.691384    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:24:19.797107 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:19.797072    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:24:19.892373 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:19.892338    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:24:19.990550 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:19.990463    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:24:20.822879 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:20.822841    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:24:20.917970 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:20.917938    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:24:20.998671 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:20.998640    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:24:22.732794 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:22.732763    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:24:27.061149 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:27.061116    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:24:27.289096 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:27.289062    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:24:29.669952 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:29.669918    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:24:29.776948 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:29.776900    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:24:30.384594 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:30.384565    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:24:37.091394 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:37.091352    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:24:37.164096 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:37.164061    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:24:37.357297 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:37.357198    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:24:37.651037 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:37.650986    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb"]
Jul 09 15:24:37.651373 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:37.651360    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90a6ead5-8654-45a8-a0e1-7dcd196c2d7b" containerName="istio-proxy"
Jul 09 15:24:37.651418 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:37.651375    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="90a6ead5-8654-45a8-a0e1-7dcd196c2d7b" containerName="istio-proxy"
Jul 09 15:24:37.651418 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:37.651384    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7cea8b7b-60f4-478c-9742-c42ac5d13192" containerName="maas-api"
Jul 09 15:24:37.651418 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:37.651389    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="7cea8b7b-60f4-478c-9742-c42ac5d13192" containerName="maas-api"
Jul 09 15:24:37.651517 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:37.651455    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="90a6ead5-8654-45a8-a0e1-7dcd196c2d7b" containerName="istio-proxy"
Jul 09 15:24:37.651517 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:37.651462    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="7cea8b7b-60f4-478c-9742-c42ac5d13192" containerName="maas-api"
Jul 09 15:24:37.654525 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:37.654501    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb"
Jul 09 15:24:37.657123 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:37.657106    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-4c72e1bf-openshift-default-dockercfg-dbztp\""
Jul 09 15:24:37.680761 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:37.680731    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb"]
Jul 09 15:24:37.703018 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:37.702986    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:24:37.729834 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:37.729805    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/49b06d94-c6c3-4988-8621-fda2edf36ed6-istio-data\") pod \"e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb\" (UID: \"49b06d94-c6c3-4988-8621-fda2edf36ed6\") " pod="openshift-ingress/e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb"
Jul 09 15:24:37.729975 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:37.729846    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/49b06d94-c6c3-4988-8621-fda2edf36ed6-workload-certs\") pod \"e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb\" (UID: \"49b06d94-c6c3-4988-8621-fda2edf36ed6\") " pod="openshift-ingress/e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb"
Jul 09 15:24:37.729975 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:37.729884    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/49b06d94-c6c3-4988-8621-fda2edf36ed6-workload-socket\") pod \"e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb\" (UID: \"49b06d94-c6c3-4988-8621-fda2edf36ed6\") " pod="openshift-ingress/e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb"
Jul 09 15:24:37.729975 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:37.729943    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/49b06d94-c6c3-4988-8621-fda2edf36ed6-istio-podinfo\") pod \"e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb\" (UID: \"49b06d94-c6c3-4988-8621-fda2edf36ed6\") " pod="openshift-ingress/e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb"
Jul 09 15:24:37.730113 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:37.729975    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n77fn\" (UniqueName: \"kubernetes.io/projected/49b06d94-c6c3-4988-8621-fda2edf36ed6-kube-api-access-n77fn\") pod \"e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb\" (UID: \"49b06d94-c6c3-4988-8621-fda2edf36ed6\") " pod="openshift-ingress/e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb"
Jul 09 15:24:37.730113 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:37.729998    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49b06d94-c6c3-4988-8621-fda2edf36ed6-istio-token\") pod \"e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb\" (UID: \"49b06d94-c6c3-4988-8621-fda2edf36ed6\") " pod="openshift-ingress/e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb"
Jul 09 15:24:37.730113 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:37.730050    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/49b06d94-c6c3-4988-8621-fda2edf36ed6-credential-socket\") pod \"e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb\" (UID: \"49b06d94-c6c3-4988-8621-fda2edf36ed6\") " pod="openshift-ingress/e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb"
Jul 09 15:24:37.730113 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:37.730075    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/49b06d94-c6c3-4988-8621-fda2edf36ed6-istio-envoy\") pod \"e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb\" (UID: \"49b06d94-c6c3-4988-8621-fda2edf36ed6\") " pod="openshift-ingress/e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb"
Jul 09 15:24:37.730113 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:37.730099    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/49b06d94-c6c3-4988-8621-fda2edf36ed6-istiod-ca-cert\") pod \"e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb\" (UID: \"49b06d94-c6c3-4988-8621-fda2edf36ed6\") " pod="openshift-ingress/e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb"
Jul 09 15:24:37.800046 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:37.800011    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:24:37.831166 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:37.831122    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/49b06d94-c6c3-4988-8621-fda2edf36ed6-istio-data\") pod \"e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb\" (UID: \"49b06d94-c6c3-4988-8621-fda2edf36ed6\") " pod="openshift-ingress/e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb"
Jul 09 15:24:37.831365 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:37.831184    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/49b06d94-c6c3-4988-8621-fda2edf36ed6-workload-certs\") pod \"e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb\" (UID: \"49b06d94-c6c3-4988-8621-fda2edf36ed6\") " pod="openshift-ingress/e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb"
Jul 09 15:24:37.831365 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:37.831234    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/49b06d94-c6c3-4988-8621-fda2edf36ed6-workload-socket\") pod \"e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb\" (UID: \"49b06d94-c6c3-4988-8621-fda2edf36ed6\") " pod="openshift-ingress/e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb"
Jul 09 15:24:37.831365 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:37.831268    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/49b06d94-c6c3-4988-8621-fda2edf36ed6-istio-podinfo\") pod \"e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb\" (UID: \"49b06d94-c6c3-4988-8621-fda2edf36ed6\") " pod="openshift-ingress/e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb"
Jul 09 15:24:37.831365 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:37.831297    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n77fn\" (UniqueName: \"kubernetes.io/projected/49b06d94-c6c3-4988-8621-fda2edf36ed6-kube-api-access-n77fn\") pod \"e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb\" (UID: \"49b06d94-c6c3-4988-8621-fda2edf36ed6\") " pod="openshift-ingress/e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb"
Jul 09 15:24:37.831568 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:37.831376    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49b06d94-c6c3-4988-8621-fda2edf36ed6-istio-token\") pod \"e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb\" (UID: \"49b06d94-c6c3-4988-8621-fda2edf36ed6\") " pod="openshift-ingress/e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb"
Jul 09 15:24:37.831568 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:37.831433    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/49b06d94-c6c3-4988-8621-fda2edf36ed6-credential-socket\") pod \"e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb\" (UID: \"49b06d94-c6c3-4988-8621-fda2edf36ed6\") " pod="openshift-ingress/e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb"
Jul 09 15:24:37.831568 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:37.831460    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/49b06d94-c6c3-4988-8621-fda2edf36ed6-istio-envoy\") pod \"e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb\" (UID: \"49b06d94-c6c3-4988-8621-fda2edf36ed6\") " pod="openshift-ingress/e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb"
Jul 09 15:24:37.831568 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:37.831485    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/49b06d94-c6c3-4988-8621-fda2edf36ed6-istiod-ca-cert\") pod \"e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb\" (UID: \"49b06d94-c6c3-4988-8621-fda2edf36ed6\") " pod="openshift-ingress/e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb"
Jul 09 15:24:37.831924 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:37.831642    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/49b06d94-c6c3-4988-8621-fda2edf36ed6-workload-socket\") pod \"e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb\" (UID: \"49b06d94-c6c3-4988-8621-fda2edf36ed6\") " pod="openshift-ingress/e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb"
Jul 09 15:24:37.831924 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:37.831768    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/49b06d94-c6c3-4988-8621-fda2edf36ed6-credential-socket\") pod \"e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb\" (UID: \"49b06d94-c6c3-4988-8621-fda2edf36ed6\") " pod="openshift-ingress/e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb"
Jul 09 15:24:37.831924 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:37.831785    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/49b06d94-c6c3-4988-8621-fda2edf36ed6-workload-certs\") pod \"e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb\" (UID: \"49b06d94-c6c3-4988-8621-fda2edf36ed6\") " pod="openshift-ingress/e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb"
Jul 09 15:24:37.831924 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:37.831844    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/49b06d94-c6c3-4988-8621-fda2edf36ed6-istio-data\") pod \"e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb\" (UID: \"49b06d94-c6c3-4988-8621-fda2edf36ed6\") " pod="openshift-ingress/e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb"
Jul 09 15:24:37.832141 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:37.832125    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/49b06d94-c6c3-4988-8621-fda2edf36ed6-istiod-ca-cert\") pod \"e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb\" (UID: \"49b06d94-c6c3-4988-8621-fda2edf36ed6\") " pod="openshift-ingress/e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb"
Jul 09 15:24:37.833731 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:37.833691    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/49b06d94-c6c3-4988-8621-fda2edf36ed6-istio-envoy\") pod \"e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb\" (UID: \"49b06d94-c6c3-4988-8621-fda2edf36ed6\") " pod="openshift-ingress/e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb"
Jul 09 15:24:37.833830 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:37.833752    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/49b06d94-c6c3-4988-8621-fda2edf36ed6-istio-podinfo\") pod \"e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb\" (UID: \"49b06d94-c6c3-4988-8621-fda2edf36ed6\") " pod="openshift-ingress/e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb"
Jul 09 15:24:37.842002 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:37.841980    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49b06d94-c6c3-4988-8621-fda2edf36ed6-istio-token\") pod \"e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb\" (UID: \"49b06d94-c6c3-4988-8621-fda2edf36ed6\") " pod="openshift-ingress/e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb"
Jul 09 15:24:37.842762 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:37.842736    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n77fn\" (UniqueName: \"kubernetes.io/projected/49b06d94-c6c3-4988-8621-fda2edf36ed6-kube-api-access-n77fn\") pod \"e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb\" (UID: \"49b06d94-c6c3-4988-8621-fda2edf36ed6\") " pod="openshift-ingress/e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb"
Jul 09 15:24:37.965320 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:37.965238    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb"
Jul 09 15:24:38.100333 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:38.100309    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb"]
Jul 09 15:24:38.102610 ip-10-0-137-94 kubenswrapper[2575]: W0709 15:24:38.102585    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49b06d94_c6c3_4988_8621_fda2edf36ed6.slice/crio-67ab010d81eea79a1f65542f9b39afebafc24c1b80247a2d2fc160d9d9213131 WatchSource:0}: Error finding container 67ab010d81eea79a1f65542f9b39afebafc24c1b80247a2d2fc160d9d9213131: Status 404 returned error can't find the container with id 67ab010d81eea79a1f65542f9b39afebafc24c1b80247a2d2fc160d9d9213131
Jul 09 15:24:38.104957 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:38.104910    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 15:24:38.105046 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:38.104999    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 15:24:38.105083 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:38.105062    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 15:24:38.726169 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:38.726132    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb" event={"ID":"49b06d94-c6c3-4988-8621-fda2edf36ed6","Type":"ContainerStarted","Data":"a35a560bb3b9918db7fa8eb0eaa552b03c90d2ffe4e23d3bb96aab0fd521ea8a"}
Jul 09 15:24:38.726340 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:38.726188    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb" event={"ID":"49b06d94-c6c3-4988-8621-fda2edf36ed6","Type":"ContainerStarted","Data":"67ab010d81eea79a1f65542f9b39afebafc24c1b80247a2d2fc160d9d9213131"}
Jul 09 15:24:38.747856 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:38.747800    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb" podStartSLOduration=1.747782165 podStartE2EDuration="1.747782165s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:24:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:24:38.747769673 +0000 UTC m=+1786.590302626" watchObservedRunningTime="2026-07-09 15:24:38.747782165 +0000 UTC m=+1786.590315098"
Jul 09 15:24:38.965376 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:38.965344    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb"
Jul 09 15:24:39.971150 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:39.971116    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb"
Jul 09 15:24:40.737241 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:40.737201    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb"
Jul 09 15:24:40.738844 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:40.738808    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb"
Jul 09 15:24:40.739050 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:40.739023    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:24:40.838227 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:40.838195    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:24:40.974541 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:40.974509    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-4c72e1bf-f9fcc5fc9-nrtpd"]
Jul 09 15:24:40.978109 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:40.978084    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4c72e1bf-f9fcc5fc9-nrtpd"
Jul 09 15:24:40.980692 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:40.980670    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-4c72e1bf-serving-cert\""
Jul 09 15:24:40.989865 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:40.989816    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-4c72e1bf-f9fcc5fc9-nrtpd"]
Jul 09 15:24:41.043896 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:41.043865    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:24:41.060060 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:41.060031    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzdjn\" (UniqueName: \"kubernetes.io/projected/13876751-861f-4411-85d1-d9e6832f8ba8-kube-api-access-fzdjn\") pod \"maas-api-e2e-mt-4c72e1bf-f9fcc5fc9-nrtpd\" (UID: \"13876751-861f-4411-85d1-d9e6832f8ba8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4c72e1bf-f9fcc5fc9-nrtpd"
Jul 09 15:24:41.060211 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:41.060069    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/13876751-861f-4411-85d1-d9e6832f8ba8-maas-api-tls\") pod \"maas-api-e2e-mt-4c72e1bf-f9fcc5fc9-nrtpd\" (UID: \"13876751-861f-4411-85d1-d9e6832f8ba8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4c72e1bf-f9fcc5fc9-nrtpd"
Jul 09 15:24:41.060211 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:41.060086    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/13876751-861f-4411-85d1-d9e6832f8ba8-openshift-service-ca\") pod \"maas-api-e2e-mt-4c72e1bf-f9fcc5fc9-nrtpd\" (UID: \"13876751-861f-4411-85d1-d9e6832f8ba8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4c72e1bf-f9fcc5fc9-nrtpd"
Jul 09 15:24:41.160932 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:41.160899    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzdjn\" (UniqueName: \"kubernetes.io/projected/13876751-861f-4411-85d1-d9e6832f8ba8-kube-api-access-fzdjn\") pod \"maas-api-e2e-mt-4c72e1bf-f9fcc5fc9-nrtpd\" (UID: \"13876751-861f-4411-85d1-d9e6832f8ba8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4c72e1bf-f9fcc5fc9-nrtpd"
Jul 09 15:24:41.161084 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:41.160939    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/13876751-861f-4411-85d1-d9e6832f8ba8-maas-api-tls\") pod \"maas-api-e2e-mt-4c72e1bf-f9fcc5fc9-nrtpd\" (UID: \"13876751-861f-4411-85d1-d9e6832f8ba8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4c72e1bf-f9fcc5fc9-nrtpd"
Jul 09 15:24:41.161084 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:41.160957    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/13876751-861f-4411-85d1-d9e6832f8ba8-openshift-service-ca\") pod \"maas-api-e2e-mt-4c72e1bf-f9fcc5fc9-nrtpd\" (UID: \"13876751-861f-4411-85d1-d9e6832f8ba8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4c72e1bf-f9fcc5fc9-nrtpd"
Jul 09 15:24:41.161084 ip-10-0-137-94 kubenswrapper[2575]: E0709 15:24:41.161057    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-4c72e1bf-serving-cert: secret "maas-api-e2e-mt-4c72e1bf-serving-cert" not found
Jul 09 15:24:41.161188 ip-10-0-137-94 kubenswrapper[2575]: E0709 15:24:41.161129    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13876751-861f-4411-85d1-d9e6832f8ba8-maas-api-tls podName:13876751-861f-4411-85d1-d9e6832f8ba8 nodeName:}" failed. No retries permitted until 2026-07-09 15:24:41.661109532 +0000 UTC m=+1789.503642452 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/13876751-861f-4411-85d1-d9e6832f8ba8-maas-api-tls") pod "maas-api-e2e-mt-4c72e1bf-f9fcc5fc9-nrtpd" (UID: "13876751-861f-4411-85d1-d9e6832f8ba8") : secret "maas-api-e2e-mt-4c72e1bf-serving-cert" not found
Jul 09 15:24:41.161636 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:41.161618    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/13876751-861f-4411-85d1-d9e6832f8ba8-openshift-service-ca\") pod \"maas-api-e2e-mt-4c72e1bf-f9fcc5fc9-nrtpd\" (UID: \"13876751-861f-4411-85d1-d9e6832f8ba8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4c72e1bf-f9fcc5fc9-nrtpd"
Jul 09 15:24:41.169661 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:41.169641    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzdjn\" (UniqueName: \"kubernetes.io/projected/13876751-861f-4411-85d1-d9e6832f8ba8-kube-api-access-fzdjn\") pod \"maas-api-e2e-mt-4c72e1bf-f9fcc5fc9-nrtpd\" (UID: \"13876751-861f-4411-85d1-d9e6832f8ba8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4c72e1bf-f9fcc5fc9-nrtpd"
Jul 09 15:24:41.597139 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:41.597103    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:24:41.666110 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:41.666081    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/13876751-861f-4411-85d1-d9e6832f8ba8-maas-api-tls\") pod \"maas-api-e2e-mt-4c72e1bf-f9fcc5fc9-nrtpd\" (UID: \"13876751-861f-4411-85d1-d9e6832f8ba8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4c72e1bf-f9fcc5fc9-nrtpd"
Jul 09 15:24:41.668557 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:41.668529    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/13876751-861f-4411-85d1-d9e6832f8ba8-maas-api-tls\") pod \"maas-api-e2e-mt-4c72e1bf-f9fcc5fc9-nrtpd\" (UID: \"13876751-861f-4411-85d1-d9e6832f8ba8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4c72e1bf-f9fcc5fc9-nrtpd"
Jul 09 15:24:41.764834 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:41.764788    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:24:41.890243 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:41.890204    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4c72e1bf-f9fcc5fc9-nrtpd"
Jul 09 15:24:42.032005 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:42.031982    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-4c72e1bf-f9fcc5fc9-nrtpd"]
Jul 09 15:24:42.034020 ip-10-0-137-94 kubenswrapper[2575]: W0709 15:24:42.033992    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13876751_861f_4411_85d1_d9e6832f8ba8.slice/crio-cdda07c3cbfc6bf572316027e49390db710ed6be6137ddad09c0ce68b6a9e089 WatchSource:0}: Error finding container cdda07c3cbfc6bf572316027e49390db710ed6be6137ddad09c0ce68b6a9e089: Status 404 returned error can't find the container with id cdda07c3cbfc6bf572316027e49390db710ed6be6137ddad09c0ce68b6a9e089
Jul 09 15:24:42.749442 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:42.749401    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4c72e1bf-f9fcc5fc9-nrtpd" event={"ID":"13876751-861f-4411-85d1-d9e6832f8ba8","Type":"ContainerStarted","Data":"251dfbe92b7640582b98548ed7b71760d15041bd59526bf6162176d085d3cf79"}
Jul 09 15:24:42.749605 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:42.749466    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4c72e1bf-f9fcc5fc9-nrtpd" event={"ID":"13876751-861f-4411-85d1-d9e6832f8ba8","Type":"ContainerStarted","Data":"cdda07c3cbfc6bf572316027e49390db710ed6be6137ddad09c0ce68b6a9e089"}
Jul 09 15:24:42.749752 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:42.749733    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4c72e1bf-f9fcc5fc9-nrtpd"
Jul 09 15:24:42.771618 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:42.771577    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4c72e1bf-f9fcc5fc9-nrtpd" podStartSLOduration=2.227074651 podStartE2EDuration="2.771563328s" totalImagesPullingTime="544.488677ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:24:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:24:42.770612756 +0000 UTC m=+1790.613145687" watchObservedRunningTime="2026-07-09 15:24:42.771563328 +0000 UTC m=+1790.614096259"
Jul 09 15:24:45.285952 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:45.285871    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:24:46.085537 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:46.085504    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:24:46.186377 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:46.186348    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:24:46.435716 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:46.435672    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:24:48.761764 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:48.761729    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4c72e1bf-f9fcc5fc9-nrtpd"
Jul 09 15:24:52.565596 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:52.565562    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:24:52.636756 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:52.636725    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:24:52.993536 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:52.993502    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:24:53.411339 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:53.411302    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:24:53.432285 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:53.431278    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-4c72e1bf-f9fcc5fc9-nrtpd"]
Jul 09 15:24:53.432285 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:53.431528    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4c72e1bf-f9fcc5fc9-nrtpd" podUID="13876751-861f-4411-85d1-d9e6832f8ba8" containerName="maas-api" containerID="cri-o://251dfbe92b7640582b98548ed7b71760d15041bd59526bf6162176d085d3cf79" gracePeriod=30
Jul 09 15:24:53.472836 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:53.472802    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:24:53.685267 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:53.685242    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4c72e1bf-f9fcc5fc9-nrtpd"
Jul 09 15:24:53.784659 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:53.784631    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/13876751-861f-4411-85d1-d9e6832f8ba8-maas-api-tls\") pod \"13876751-861f-4411-85d1-d9e6832f8ba8\" (UID: \"13876751-861f-4411-85d1-d9e6832f8ba8\") "
Jul 09 15:24:53.784872 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:53.784675    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fzdjn\" (UniqueName: \"kubernetes.io/projected/13876751-861f-4411-85d1-d9e6832f8ba8-kube-api-access-fzdjn\") pod \"13876751-861f-4411-85d1-d9e6832f8ba8\" (UID: \"13876751-861f-4411-85d1-d9e6832f8ba8\") "
Jul 09 15:24:53.784872 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:53.784696    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/13876751-861f-4411-85d1-d9e6832f8ba8-openshift-service-ca\") pod \"13876751-861f-4411-85d1-d9e6832f8ba8\" (UID: \"13876751-861f-4411-85d1-d9e6832f8ba8\") "
Jul 09 15:24:53.785121 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:53.785093    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13876751-861f-4411-85d1-d9e6832f8ba8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "13876751-861f-4411-85d1-d9e6832f8ba8" (UID: "13876751-861f-4411-85d1-d9e6832f8ba8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 15:24:53.787096 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:53.787069    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13876751-861f-4411-85d1-d9e6832f8ba8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "13876751-861f-4411-85d1-d9e6832f8ba8" (UID: "13876751-861f-4411-85d1-d9e6832f8ba8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 15:24:53.787197 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:53.787114    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13876751-861f-4411-85d1-d9e6832f8ba8-kube-api-access-fzdjn" (OuterVolumeSpecName: "kube-api-access-fzdjn") pod "13876751-861f-4411-85d1-d9e6832f8ba8" (UID: "13876751-861f-4411-85d1-d9e6832f8ba8"). InnerVolumeSpecName "kube-api-access-fzdjn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:24:53.806525 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:53.806499    2575 generic.go:356] "Generic (PLEG): container finished" podID="13876751-861f-4411-85d1-d9e6832f8ba8" containerID="251dfbe92b7640582b98548ed7b71760d15041bd59526bf6162176d085d3cf79" exitCode=0
Jul 09 15:24:53.806642 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:53.806533    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4c72e1bf-f9fcc5fc9-nrtpd" event={"ID":"13876751-861f-4411-85d1-d9e6832f8ba8","Type":"ContainerDied","Data":"251dfbe92b7640582b98548ed7b71760d15041bd59526bf6162176d085d3cf79"}
Jul 09 15:24:53.806642 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:53.806559    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4c72e1bf-f9fcc5fc9-nrtpd"
Jul 09 15:24:53.806642 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:53.806602    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4c72e1bf-f9fcc5fc9-nrtpd" event={"ID":"13876751-861f-4411-85d1-d9e6832f8ba8","Type":"ContainerDied","Data":"cdda07c3cbfc6bf572316027e49390db710ed6be6137ddad09c0ce68b6a9e089"}
Jul 09 15:24:53.806642 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:53.806633    2575 scope.go:117] "RemoveContainer" containerID="251dfbe92b7640582b98548ed7b71760d15041bd59526bf6162176d085d3cf79"
Jul 09 15:24:53.808703 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:53.808666    2575 generic.go:356] "Generic (PLEG): container finished" podID="49b06d94-c6c3-4988-8621-fda2edf36ed6" containerID="a35a560bb3b9918db7fa8eb0eaa552b03c90d2ffe4e23d3bb96aab0fd521ea8a" exitCode=0
Jul 09 15:24:53.808836 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:53.808798    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb" event={"ID":"49b06d94-c6c3-4988-8621-fda2edf36ed6","Type":"ContainerDied","Data":"a35a560bb3b9918db7fa8eb0eaa552b03c90d2ffe4e23d3bb96aab0fd521ea8a"}
Jul 09 15:24:53.809160 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:53.809144    2575 scope.go:117] "RemoveContainer" containerID="a35a560bb3b9918db7fa8eb0eaa552b03c90d2ffe4e23d3bb96aab0fd521ea8a"
Jul 09 15:24:53.810364 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:53.810330    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 15:24:53.810471 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:53.810421    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 15:24:53.810529 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:53.810469    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 15:24:53.818453 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:53.818428    2575 scope.go:117] "RemoveContainer" containerID="251dfbe92b7640582b98548ed7b71760d15041bd59526bf6162176d085d3cf79"
Jul 09 15:24:53.818879 ip-10-0-137-94 kubenswrapper[2575]: E0709 15:24:53.818851    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"251dfbe92b7640582b98548ed7b71760d15041bd59526bf6162176d085d3cf79\": container with ID starting with 251dfbe92b7640582b98548ed7b71760d15041bd59526bf6162176d085d3cf79 not found: ID does not exist" containerID="251dfbe92b7640582b98548ed7b71760d15041bd59526bf6162176d085d3cf79"
Jul 09 15:24:53.818953 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:53.818891    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"251dfbe92b7640582b98548ed7b71760d15041bd59526bf6162176d085d3cf79"} err="failed to get container status \"251dfbe92b7640582b98548ed7b71760d15041bd59526bf6162176d085d3cf79\": rpc error: code = NotFound desc = could not find container \"251dfbe92b7640582b98548ed7b71760d15041bd59526bf6162176d085d3cf79\": container with ID starting with 251dfbe92b7640582b98548ed7b71760d15041bd59526bf6162176d085d3cf79 not found: ID does not exist"
Jul 09 15:24:53.848989 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:53.848962    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-4c72e1bf-f9fcc5fc9-nrtpd"]
Jul 09 15:24:53.855477 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:53.855450    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-4c72e1bf-f9fcc5fc9-nrtpd"]
Jul 09 15:24:53.885469 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:53.885447    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/13876751-861f-4411-85d1-d9e6832f8ba8-maas-api-tls\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:24:53.885469 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:53.885470    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fzdjn\" (UniqueName: \"kubernetes.io/projected/13876751-861f-4411-85d1-d9e6832f8ba8-kube-api-access-fzdjn\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:24:53.885606 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:53.885479    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/13876751-861f-4411-85d1-d9e6832f8ba8-openshift-service-ca\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:24:54.824317 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:54.824267    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb" event={"ID":"49b06d94-c6c3-4988-8621-fda2edf36ed6","Type":"ContainerStarted","Data":"d99a428ee65f9951a1a2efbc97842b1ddb271a2c27836a308504797fd5ca5477"}
Jul 09 15:24:54.965935 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:54.965895    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb"
Jul 09 15:24:54.967161 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:54.967140    2575 patch_prober.go:28] interesting pod/e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Jul 09 15:24:54.967237 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:54.967194    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb" podUID="49b06d94-c6c3-4988-8621-fda2edf36ed6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Jul 09 15:24:55.321734 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:55.321679    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13876751-861f-4411-85d1-d9e6832f8ba8" path="/var/lib/kubelet/pods/13876751-861f-4411-85d1-d9e6832f8ba8/volumes"
Jul 09 15:24:55.738162 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:55.738127    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb"
Jul 09 15:24:55.966111 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:55.966078    2575 patch_prober.go:28] interesting pod/e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Jul 09 15:24:55.966490 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:55.966143    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb" podUID="49b06d94-c6c3-4988-8621-fda2edf36ed6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Jul 09 15:24:56.966430 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:56.966397    2575 patch_prober.go:28] interesting pod/e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Jul 09 15:24:56.966844 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:56.966457    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb" podUID="49b06d94-c6c3-4988-8621-fda2edf36ed6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Jul 09 15:24:57.966461 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:57.966422    2575 patch_prober.go:28] interesting pod/e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Jul 09 15:24:57.966988 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:57.966498    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb" podUID="49b06d94-c6c3-4988-8621-fda2edf36ed6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Jul 09 15:24:58.969224 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:58.969192    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb"
Jul 09 15:24:58.970107 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:58.970087    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb"
Jul 09 15:24:59.550288 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:59.550247    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:24:59.621929 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:59.621894    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:24:59.787837 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:59.787802    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb"]
Jul 09 15:24:59.808587 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:59.808500    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:24:59.856759 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:24:59.856727    2575 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb" secret="" err="secret \"e2e-mt-4c72e1bf-openshift-default-dockercfg-dbztp\" not found"
Jul 09 15:25:00.043776 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:00.043723    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:25:00.183815 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:00.183775    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:25:00.280297 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:00.280262    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:25:00.400818 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:00.400779    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:25:00.861856 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:00.861817    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb" podUID="49b06d94-c6c3-4988-8621-fda2edf36ed6" containerName="istio-proxy" containerID="cri-o://d99a428ee65f9951a1a2efbc97842b1ddb271a2c27836a308504797fd5ca5477" gracePeriod=30
Jul 09 15:25:06.126220 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:06.126161    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb"
Jul 09 15:25:06.204213 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:06.204185    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49b06d94-c6c3-4988-8621-fda2edf36ed6-istio-token\") pod \"49b06d94-c6c3-4988-8621-fda2edf36ed6\" (UID: \"49b06d94-c6c3-4988-8621-fda2edf36ed6\") "
Jul 09 15:25:06.204404 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:06.204259    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/49b06d94-c6c3-4988-8621-fda2edf36ed6-workload-certs\") pod \"49b06d94-c6c3-4988-8621-fda2edf36ed6\" (UID: \"49b06d94-c6c3-4988-8621-fda2edf36ed6\") "
Jul 09 15:25:06.204404 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:06.204302    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/49b06d94-c6c3-4988-8621-fda2edf36ed6-istio-podinfo\") pod \"49b06d94-c6c3-4988-8621-fda2edf36ed6\" (UID: \"49b06d94-c6c3-4988-8621-fda2edf36ed6\") "
Jul 09 15:25:06.204404 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:06.204328    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/49b06d94-c6c3-4988-8621-fda2edf36ed6-istiod-ca-cert\") pod \"49b06d94-c6c3-4988-8621-fda2edf36ed6\" (UID: \"49b06d94-c6c3-4988-8621-fda2edf36ed6\") "
Jul 09 15:25:06.204404 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:06.204361    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/49b06d94-c6c3-4988-8621-fda2edf36ed6-istio-data\") pod \"49b06d94-c6c3-4988-8621-fda2edf36ed6\" (UID: \"49b06d94-c6c3-4988-8621-fda2edf36ed6\") "
Jul 09 15:25:06.204619 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:06.204407    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n77fn\" (UniqueName: \"kubernetes.io/projected/49b06d94-c6c3-4988-8621-fda2edf36ed6-kube-api-access-n77fn\") pod \"49b06d94-c6c3-4988-8621-fda2edf36ed6\" (UID: \"49b06d94-c6c3-4988-8621-fda2edf36ed6\") "
Jul 09 15:25:06.204678 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:06.204622    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49b06d94-c6c3-4988-8621-fda2edf36ed6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "49b06d94-c6c3-4988-8621-fda2edf36ed6" (UID: "49b06d94-c6c3-4988-8621-fda2edf36ed6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:25:06.204768 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:06.204739    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49b06d94-c6c3-4988-8621-fda2edf36ed6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "49b06d94-c6c3-4988-8621-fda2edf36ed6" (UID: "49b06d94-c6c3-4988-8621-fda2edf36ed6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 15:25:06.204926 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:06.204901    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/49b06d94-c6c3-4988-8621-fda2edf36ed6-workload-socket\") pod \"49b06d94-c6c3-4988-8621-fda2edf36ed6\" (UID: \"49b06d94-c6c3-4988-8621-fda2edf36ed6\") "
Jul 09 15:25:06.205059 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:06.204953    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/49b06d94-c6c3-4988-8621-fda2edf36ed6-istio-envoy\") pod \"49b06d94-c6c3-4988-8621-fda2edf36ed6\" (UID: \"49b06d94-c6c3-4988-8621-fda2edf36ed6\") "
Jul 09 15:25:06.205059 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:06.204985    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/49b06d94-c6c3-4988-8621-fda2edf36ed6-credential-socket\") pod \"49b06d94-c6c3-4988-8621-fda2edf36ed6\" (UID: \"49b06d94-c6c3-4988-8621-fda2edf36ed6\") "
Jul 09 15:25:06.205277 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:06.205261    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/49b06d94-c6c3-4988-8621-fda2edf36ed6-workload-certs\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:25:06.205396 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:06.205381    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/49b06d94-c6c3-4988-8621-fda2edf36ed6-istiod-ca-cert\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:25:06.205470 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:06.205324    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49b06d94-c6c3-4988-8621-fda2edf36ed6-istio-data" (OuterVolumeSpecName: "istio-data") pod "49b06d94-c6c3-4988-8621-fda2edf36ed6" (UID: "49b06d94-c6c3-4988-8621-fda2edf36ed6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:25:06.205470 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:06.205412    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49b06d94-c6c3-4988-8621-fda2edf36ed6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "49b06d94-c6c3-4988-8621-fda2edf36ed6" (UID: "49b06d94-c6c3-4988-8621-fda2edf36ed6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:25:06.205658 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:06.205627    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49b06d94-c6c3-4988-8621-fda2edf36ed6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "49b06d94-c6c3-4988-8621-fda2edf36ed6" (UID: "49b06d94-c6c3-4988-8621-fda2edf36ed6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:25:06.207073 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:06.207044    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/49b06d94-c6c3-4988-8621-fda2edf36ed6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "49b06d94-c6c3-4988-8621-fda2edf36ed6" (UID: "49b06d94-c6c3-4988-8621-fda2edf36ed6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 15:25:06.207195 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:06.207173    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49b06d94-c6c3-4988-8621-fda2edf36ed6-istio-token" (OuterVolumeSpecName: "istio-token") pod "49b06d94-c6c3-4988-8621-fda2edf36ed6" (UID: "49b06d94-c6c3-4988-8621-fda2edf36ed6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:25:06.207417 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:06.207385    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49b06d94-c6c3-4988-8621-fda2edf36ed6-kube-api-access-n77fn" (OuterVolumeSpecName: "kube-api-access-n77fn") pod "49b06d94-c6c3-4988-8621-fda2edf36ed6" (UID: "49b06d94-c6c3-4988-8621-fda2edf36ed6"). InnerVolumeSpecName "kube-api-access-n77fn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:25:06.207533 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:06.207470    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49b06d94-c6c3-4988-8621-fda2edf36ed6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "49b06d94-c6c3-4988-8621-fda2edf36ed6" (UID: "49b06d94-c6c3-4988-8621-fda2edf36ed6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:25:06.306155 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:06.306109    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49b06d94-c6c3-4988-8621-fda2edf36ed6-istio-token\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:25:06.306155 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:06.306143    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/49b06d94-c6c3-4988-8621-fda2edf36ed6-istio-podinfo\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:25:06.306155 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:06.306153    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/49b06d94-c6c3-4988-8621-fda2edf36ed6-istio-data\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:25:06.306155 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:06.306163    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n77fn\" (UniqueName: \"kubernetes.io/projected/49b06d94-c6c3-4988-8621-fda2edf36ed6-kube-api-access-n77fn\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:25:06.306532 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:06.306173    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/49b06d94-c6c3-4988-8621-fda2edf36ed6-workload-socket\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:25:06.306532 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:06.306181    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/49b06d94-c6c3-4988-8621-fda2edf36ed6-istio-envoy\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:25:06.306532 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:06.306190    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/49b06d94-c6c3-4988-8621-fda2edf36ed6-credential-socket\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:25:06.397906 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:06.397873    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:25:06.899336 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:06.899304    2575 generic.go:356] "Generic (PLEG): container finished" podID="49b06d94-c6c3-4988-8621-fda2edf36ed6" containerID="d99a428ee65f9951a1a2efbc97842b1ddb271a2c27836a308504797fd5ca5477" exitCode=0
Jul 09 15:25:06.899510 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:06.899357    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb"
Jul 09 15:25:06.899510 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:06.899363    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb" event={"ID":"49b06d94-c6c3-4988-8621-fda2edf36ed6","Type":"ContainerDied","Data":"d99a428ee65f9951a1a2efbc97842b1ddb271a2c27836a308504797fd5ca5477"}
Jul 09 15:25:06.899510 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:06.899484    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb" event={"ID":"49b06d94-c6c3-4988-8621-fda2edf36ed6","Type":"ContainerDied","Data":"67ab010d81eea79a1f65542f9b39afebafc24c1b80247a2d2fc160d9d9213131"}
Jul 09 15:25:06.899510 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:06.899504    2575 scope.go:117] "RemoveContainer" containerID="d99a428ee65f9951a1a2efbc97842b1ddb271a2c27836a308504797fd5ca5477"
Jul 09 15:25:06.909922 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:06.909904    2575 scope.go:117] "RemoveContainer" containerID="a35a560bb3b9918db7fa8eb0eaa552b03c90d2ffe4e23d3bb96aab0fd521ea8a"
Jul 09 15:25:06.917930 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:06.917907    2575 scope.go:117] "RemoveContainer" containerID="d99a428ee65f9951a1a2efbc97842b1ddb271a2c27836a308504797fd5ca5477"
Jul 09 15:25:06.918161 ip-10-0-137-94 kubenswrapper[2575]: E0709 15:25:06.918144    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d99a428ee65f9951a1a2efbc97842b1ddb271a2c27836a308504797fd5ca5477\": container with ID starting with d99a428ee65f9951a1a2efbc97842b1ddb271a2c27836a308504797fd5ca5477 not found: ID does not exist" containerID="d99a428ee65f9951a1a2efbc97842b1ddb271a2c27836a308504797fd5ca5477"
Jul 09 15:25:06.918216 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:06.918169    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d99a428ee65f9951a1a2efbc97842b1ddb271a2c27836a308504797fd5ca5477"} err="failed to get container status \"d99a428ee65f9951a1a2efbc97842b1ddb271a2c27836a308504797fd5ca5477\": rpc error: code = NotFound desc = could not find container \"d99a428ee65f9951a1a2efbc97842b1ddb271a2c27836a308504797fd5ca5477\": container with ID starting with d99a428ee65f9951a1a2efbc97842b1ddb271a2c27836a308504797fd5ca5477 not found: ID does not exist"
Jul 09 15:25:06.918216 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:06.918185    2575 scope.go:117] "RemoveContainer" containerID="a35a560bb3b9918db7fa8eb0eaa552b03c90d2ffe4e23d3bb96aab0fd521ea8a"
Jul 09 15:25:06.918443 ip-10-0-137-94 kubenswrapper[2575]: E0709 15:25:06.918425    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a35a560bb3b9918db7fa8eb0eaa552b03c90d2ffe4e23d3bb96aab0fd521ea8a\": container with ID starting with a35a560bb3b9918db7fa8eb0eaa552b03c90d2ffe4e23d3bb96aab0fd521ea8a not found: ID does not exist" containerID="a35a560bb3b9918db7fa8eb0eaa552b03c90d2ffe4e23d3bb96aab0fd521ea8a"
Jul 09 15:25:06.918484 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:06.918449    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a35a560bb3b9918db7fa8eb0eaa552b03c90d2ffe4e23d3bb96aab0fd521ea8a"} err="failed to get container status \"a35a560bb3b9918db7fa8eb0eaa552b03c90d2ffe4e23d3bb96aab0fd521ea8a\": rpc error: code = NotFound desc = could not find container \"a35a560bb3b9918db7fa8eb0eaa552b03c90d2ffe4e23d3bb96aab0fd521ea8a\": container with ID starting with a35a560bb3b9918db7fa8eb0eaa552b03c90d2ffe4e23d3bb96aab0fd521ea8a not found: ID does not exist"
Jul 09 15:25:06.923243 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:06.923222    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb"]
Jul 09 15:25:06.928888 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:06.928868    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-4c72e1bf-openshift-default-c4c9b888c-7lxqb"]
Jul 09 15:25:07.317021 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:07.316940    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49b06d94-c6c3-4988-8621-fda2edf36ed6" path="/var/lib/kubelet/pods/49b06d94-c6c3-4988-8621-fda2edf36ed6/volumes"
Jul 09 15:25:08.997588 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:08.997557    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:25:13.375833 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:13.375798    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:25:13.438664 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:13.438622    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:25:20.266648 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:20.266610    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:25:20.619050 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:20.618967    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77"]
Jul 09 15:25:20.619366 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:20.619344    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49b06d94-c6c3-4988-8621-fda2edf36ed6" containerName="istio-proxy"
Jul 09 15:25:20.619366 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:20.619362    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="49b06d94-c6c3-4988-8621-fda2edf36ed6" containerName="istio-proxy"
Jul 09 15:25:20.619559 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:20.619377    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49b06d94-c6c3-4988-8621-fda2edf36ed6" containerName="istio-proxy"
Jul 09 15:25:20.619559 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:20.619383    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="49b06d94-c6c3-4988-8621-fda2edf36ed6" containerName="istio-proxy"
Jul 09 15:25:20.619559 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:20.619395    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13876751-861f-4411-85d1-d9e6832f8ba8" containerName="maas-api"
Jul 09 15:25:20.619559 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:20.619401    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="13876751-861f-4411-85d1-d9e6832f8ba8" containerName="maas-api"
Jul 09 15:25:20.619559 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:20.619466    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="13876751-861f-4411-85d1-d9e6832f8ba8" containerName="maas-api"
Jul 09 15:25:20.619559 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:20.619474    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="49b06d94-c6c3-4988-8621-fda2edf36ed6" containerName="istio-proxy"
Jul 09 15:25:20.619559 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:20.619483    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="49b06d94-c6c3-4988-8621-fda2edf36ed6" containerName="istio-proxy"
Jul 09 15:25:20.624077 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:20.624055    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77"
Jul 09 15:25:20.627217 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:20.627191    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-bd3840f1-openshift-default-dockercfg-zhjrs\""
Jul 09 15:25:20.636655 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:20.636630    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77"]
Jul 09 15:25:20.650968 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:20.650909    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:25:20.732657 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:20.732622    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/342586b3-bcbe-4c62-8cf7-0390fba4d273-istio-data\") pod \"e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77\" (UID: \"342586b3-bcbe-4c62-8cf7-0390fba4d273\") " pod="openshift-ingress/e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77"
Jul 09 15:25:20.732657 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:20.732660    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/342586b3-bcbe-4c62-8cf7-0390fba4d273-istio-envoy\") pod \"e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77\" (UID: \"342586b3-bcbe-4c62-8cf7-0390fba4d273\") " pod="openshift-ingress/e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77"
Jul 09 15:25:20.732909 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:20.732697    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/342586b3-bcbe-4c62-8cf7-0390fba4d273-istiod-ca-cert\") pod \"e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77\" (UID: \"342586b3-bcbe-4c62-8cf7-0390fba4d273\") " pod="openshift-ingress/e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77"
Jul 09 15:25:20.732909 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:20.732732    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/342586b3-bcbe-4c62-8cf7-0390fba4d273-istio-podinfo\") pod \"e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77\" (UID: \"342586b3-bcbe-4c62-8cf7-0390fba4d273\") " pod="openshift-ingress/e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77"
Jul 09 15:25:20.732909 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:20.732797    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mv9x2\" (UniqueName: \"kubernetes.io/projected/342586b3-bcbe-4c62-8cf7-0390fba4d273-kube-api-access-mv9x2\") pod \"e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77\" (UID: \"342586b3-bcbe-4c62-8cf7-0390fba4d273\") " pod="openshift-ingress/e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77"
Jul 09 15:25:20.732909 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:20.732816    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/342586b3-bcbe-4c62-8cf7-0390fba4d273-istio-token\") pod \"e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77\" (UID: \"342586b3-bcbe-4c62-8cf7-0390fba4d273\") " pod="openshift-ingress/e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77"
Jul 09 15:25:20.732909 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:20.732850    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/342586b3-bcbe-4c62-8cf7-0390fba4d273-workload-socket\") pod \"e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77\" (UID: \"342586b3-bcbe-4c62-8cf7-0390fba4d273\") " pod="openshift-ingress/e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77"
Jul 09 15:25:20.732909 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:20.732866    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/342586b3-bcbe-4c62-8cf7-0390fba4d273-workload-certs\") pod \"e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77\" (UID: \"342586b3-bcbe-4c62-8cf7-0390fba4d273\") " pod="openshift-ingress/e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77"
Jul 09 15:25:20.732909 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:20.732884    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/342586b3-bcbe-4c62-8cf7-0390fba4d273-credential-socket\") pod \"e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77\" (UID: \"342586b3-bcbe-4c62-8cf7-0390fba4d273\") " pod="openshift-ingress/e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77"
Jul 09 15:25:20.833353 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:20.833316    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mv9x2\" (UniqueName: \"kubernetes.io/projected/342586b3-bcbe-4c62-8cf7-0390fba4d273-kube-api-access-mv9x2\") pod \"e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77\" (UID: \"342586b3-bcbe-4c62-8cf7-0390fba4d273\") " pod="openshift-ingress/e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77"
Jul 09 15:25:20.833353 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:20.833352    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/342586b3-bcbe-4c62-8cf7-0390fba4d273-istio-token\") pod \"e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77\" (UID: \"342586b3-bcbe-4c62-8cf7-0390fba4d273\") " pod="openshift-ingress/e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77"
Jul 09 15:25:20.833600 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:20.833379    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/342586b3-bcbe-4c62-8cf7-0390fba4d273-workload-socket\") pod \"e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77\" (UID: \"342586b3-bcbe-4c62-8cf7-0390fba4d273\") " pod="openshift-ingress/e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77"
Jul 09 15:25:20.833600 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:20.833396    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/342586b3-bcbe-4c62-8cf7-0390fba4d273-workload-certs\") pod \"e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77\" (UID: \"342586b3-bcbe-4c62-8cf7-0390fba4d273\") " pod="openshift-ingress/e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77"
Jul 09 15:25:20.833600 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:20.833415    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/342586b3-bcbe-4c62-8cf7-0390fba4d273-credential-socket\") pod \"e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77\" (UID: \"342586b3-bcbe-4c62-8cf7-0390fba4d273\") " pod="openshift-ingress/e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77"
Jul 09 15:25:20.833600 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:20.833535    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/342586b3-bcbe-4c62-8cf7-0390fba4d273-istio-data\") pod \"e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77\" (UID: \"342586b3-bcbe-4c62-8cf7-0390fba4d273\") " pod="openshift-ingress/e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77"
Jul 09 15:25:20.833600 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:20.833575    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/342586b3-bcbe-4c62-8cf7-0390fba4d273-istio-envoy\") pod \"e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77\" (UID: \"342586b3-bcbe-4c62-8cf7-0390fba4d273\") " pod="openshift-ingress/e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77"
Jul 09 15:25:20.833903 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:20.833653    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/342586b3-bcbe-4c62-8cf7-0390fba4d273-istiod-ca-cert\") pod \"e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77\" (UID: \"342586b3-bcbe-4c62-8cf7-0390fba4d273\") " pod="openshift-ingress/e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77"
Jul 09 15:25:20.833903 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:20.833683    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/342586b3-bcbe-4c62-8cf7-0390fba4d273-istio-podinfo\") pod \"e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77\" (UID: \"342586b3-bcbe-4c62-8cf7-0390fba4d273\") " pod="openshift-ingress/e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77"
Jul 09 15:25:20.833903 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:20.833849    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/342586b3-bcbe-4c62-8cf7-0390fba4d273-credential-socket\") pod \"e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77\" (UID: \"342586b3-bcbe-4c62-8cf7-0390fba4d273\") " pod="openshift-ingress/e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77"
Jul 09 15:25:20.834067 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:20.833899    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/342586b3-bcbe-4c62-8cf7-0390fba4d273-workload-socket\") pod \"e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77\" (UID: \"342586b3-bcbe-4c62-8cf7-0390fba4d273\") " pod="openshift-ingress/e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77"
Jul 09 15:25:20.834067 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:20.833968    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/342586b3-bcbe-4c62-8cf7-0390fba4d273-workload-certs\") pod \"e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77\" (UID: \"342586b3-bcbe-4c62-8cf7-0390fba4d273\") " pod="openshift-ingress/e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77"
Jul 09 15:25:20.834067 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:20.834053    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/342586b3-bcbe-4c62-8cf7-0390fba4d273-istio-data\") pod \"e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77\" (UID: \"342586b3-bcbe-4c62-8cf7-0390fba4d273\") " pod="openshift-ingress/e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77"
Jul 09 15:25:20.834371 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:20.834352    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/342586b3-bcbe-4c62-8cf7-0390fba4d273-istiod-ca-cert\") pod \"e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77\" (UID: \"342586b3-bcbe-4c62-8cf7-0390fba4d273\") " pod="openshift-ingress/e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77"
Jul 09 15:25:20.835865 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:20.835844    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/342586b3-bcbe-4c62-8cf7-0390fba4d273-istio-envoy\") pod \"e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77\" (UID: \"342586b3-bcbe-4c62-8cf7-0390fba4d273\") " pod="openshift-ingress/e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77"
Jul 09 15:25:20.835987 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:20.835970    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/342586b3-bcbe-4c62-8cf7-0390fba4d273-istio-podinfo\") pod \"e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77\" (UID: \"342586b3-bcbe-4c62-8cf7-0390fba4d273\") " pod="openshift-ingress/e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77"
Jul 09 15:25:20.847972 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:20.847943    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mv9x2\" (UniqueName: \"kubernetes.io/projected/342586b3-bcbe-4c62-8cf7-0390fba4d273-kube-api-access-mv9x2\") pod \"e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77\" (UID: \"342586b3-bcbe-4c62-8cf7-0390fba4d273\") " pod="openshift-ingress/e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77"
Jul 09 15:25:20.853490 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:20.853466    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/342586b3-bcbe-4c62-8cf7-0390fba4d273-istio-token\") pod \"e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77\" (UID: \"342586b3-bcbe-4c62-8cf7-0390fba4d273\") " pod="openshift-ingress/e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77"
Jul 09 15:25:20.890191 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:20.890159    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:25:20.935028 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:20.934996    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77"
Jul 09 15:25:21.075074 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:21.075045    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77"]
Jul 09 15:25:21.076777 ip-10-0-137-94 kubenswrapper[2575]: W0709 15:25:21.076750    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod342586b3_bcbe_4c62_8cf7_0390fba4d273.slice/crio-6610055376a7ba42d0f6fd96e5c7eb45f107426b99709db1ab10fa207ec24a1e WatchSource:0}: Error finding container 6610055376a7ba42d0f6fd96e5c7eb45f107426b99709db1ab10fa207ec24a1e: Status 404 returned error can't find the container with id 6610055376a7ba42d0f6fd96e5c7eb45f107426b99709db1ab10fa207ec24a1e
Jul 09 15:25:21.078873 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:21.078844    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 15:25:21.078956 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:21.078906    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 15:25:21.078956 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:21.078935    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 15:25:21.981549 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:21.981516    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77" event={"ID":"342586b3-bcbe-4c62-8cf7-0390fba4d273","Type":"ContainerStarted","Data":"04d1cd3b4d358400140f080e8e8097b5eed0dfa4c225821cae7ff085cca84577"}
Jul 09 15:25:21.981980 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:21.981574    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77" event={"ID":"342586b3-bcbe-4c62-8cf7-0390fba4d273","Type":"ContainerStarted","Data":"6610055376a7ba42d0f6fd96e5c7eb45f107426b99709db1ab10fa207ec24a1e"}
Jul 09 15:25:22.006906 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:22.006855    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77" podStartSLOduration=2.006840404 podStartE2EDuration="2.006840404s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:25:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:25:22.004630697 +0000 UTC m=+1829.847163648" watchObservedRunningTime="2026-07-09 15:25:22.006840404 +0000 UTC m=+1829.849373335"
Jul 09 15:25:22.935799 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:22.935764    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77"
Jul 09 15:25:22.940498 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:22.940470    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77"
Jul 09 15:25:22.986853 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:22.986825    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77"
Jul 09 15:25:22.987801 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:22.987782    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77"
Jul 09 15:25:23.933424 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:23.933393    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:25:24.033926 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:24.033892    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:25:24.172841 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:24.172803    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-bd3840f1-65ccff9f5c-vfksp"]
Jul 09 15:25:24.176526 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:24.176502    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bd3840f1-65ccff9f5c-vfksp"
Jul 09 15:25:24.179232 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:24.179211    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-bd3840f1-serving-cert\""
Jul 09 15:25:24.188478 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:24.188414    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-bd3840f1-65ccff9f5c-vfksp"]
Jul 09 15:25:24.207091 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:24.207064    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:25:24.267793 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:24.267760    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ccf551a1-75d1-4584-b6d4-41d48093210b-openshift-service-ca\") pod \"maas-api-e2e-mt-bd3840f1-65ccff9f5c-vfksp\" (UID: \"ccf551a1-75d1-4584-b6d4-41d48093210b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bd3840f1-65ccff9f5c-vfksp"
Jul 09 15:25:24.267950 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:24.267845    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ccf551a1-75d1-4584-b6d4-41d48093210b-maas-api-tls\") pod \"maas-api-e2e-mt-bd3840f1-65ccff9f5c-vfksp\" (UID: \"ccf551a1-75d1-4584-b6d4-41d48093210b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bd3840f1-65ccff9f5c-vfksp"
Jul 09 15:25:24.267950 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:24.267888    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4wz6\" (UniqueName: \"kubernetes.io/projected/ccf551a1-75d1-4584-b6d4-41d48093210b-kube-api-access-k4wz6\") pod \"maas-api-e2e-mt-bd3840f1-65ccff9f5c-vfksp\" (UID: \"ccf551a1-75d1-4584-b6d4-41d48093210b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bd3840f1-65ccff9f5c-vfksp"
Jul 09 15:25:24.368918 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:24.368885    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ccf551a1-75d1-4584-b6d4-41d48093210b-openshift-service-ca\") pod \"maas-api-e2e-mt-bd3840f1-65ccff9f5c-vfksp\" (UID: \"ccf551a1-75d1-4584-b6d4-41d48093210b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bd3840f1-65ccff9f5c-vfksp"
Jul 09 15:25:24.369162 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:24.368972    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ccf551a1-75d1-4584-b6d4-41d48093210b-maas-api-tls\") pod \"maas-api-e2e-mt-bd3840f1-65ccff9f5c-vfksp\" (UID: \"ccf551a1-75d1-4584-b6d4-41d48093210b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bd3840f1-65ccff9f5c-vfksp"
Jul 09 15:25:24.369162 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:24.369004    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4wz6\" (UniqueName: \"kubernetes.io/projected/ccf551a1-75d1-4584-b6d4-41d48093210b-kube-api-access-k4wz6\") pod \"maas-api-e2e-mt-bd3840f1-65ccff9f5c-vfksp\" (UID: \"ccf551a1-75d1-4584-b6d4-41d48093210b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bd3840f1-65ccff9f5c-vfksp"
Jul 09 15:25:24.369162 ip-10-0-137-94 kubenswrapper[2575]: E0709 15:25:24.369099    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-bd3840f1-serving-cert: secret "maas-api-e2e-mt-bd3840f1-serving-cert" not found
Jul 09 15:25:24.369338 ip-10-0-137-94 kubenswrapper[2575]: E0709 15:25:24.369176    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccf551a1-75d1-4584-b6d4-41d48093210b-maas-api-tls podName:ccf551a1-75d1-4584-b6d4-41d48093210b nodeName:}" failed. No retries permitted until 2026-07-09 15:25:24.869149887 +0000 UTC m=+1832.711682797 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ccf551a1-75d1-4584-b6d4-41d48093210b-maas-api-tls") pod "maas-api-e2e-mt-bd3840f1-65ccff9f5c-vfksp" (UID: "ccf551a1-75d1-4584-b6d4-41d48093210b") : secret "maas-api-e2e-mt-bd3840f1-serving-cert" not found
Jul 09 15:25:24.369619 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:24.369600    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ccf551a1-75d1-4584-b6d4-41d48093210b-openshift-service-ca\") pod \"maas-api-e2e-mt-bd3840f1-65ccff9f5c-vfksp\" (UID: \"ccf551a1-75d1-4584-b6d4-41d48093210b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bd3840f1-65ccff9f5c-vfksp"
Jul 09 15:25:24.380665 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:24.380637    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4wz6\" (UniqueName: \"kubernetes.io/projected/ccf551a1-75d1-4584-b6d4-41d48093210b-kube-api-access-k4wz6\") pod \"maas-api-e2e-mt-bd3840f1-65ccff9f5c-vfksp\" (UID: \"ccf551a1-75d1-4584-b6d4-41d48093210b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bd3840f1-65ccff9f5c-vfksp"
Jul 09 15:25:24.435194 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:24.435163    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:25:24.872647 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:24.872610    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ccf551a1-75d1-4584-b6d4-41d48093210b-maas-api-tls\") pod \"maas-api-e2e-mt-bd3840f1-65ccff9f5c-vfksp\" (UID: \"ccf551a1-75d1-4584-b6d4-41d48093210b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bd3840f1-65ccff9f5c-vfksp"
Jul 09 15:25:24.875198 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:24.875165    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ccf551a1-75d1-4584-b6d4-41d48093210b-maas-api-tls\") pod \"maas-api-e2e-mt-bd3840f1-65ccff9f5c-vfksp\" (UID: \"ccf551a1-75d1-4584-b6d4-41d48093210b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bd3840f1-65ccff9f5c-vfksp"
Jul 09 15:25:25.087815 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:25.087780    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bd3840f1-65ccff9f5c-vfksp"
Jul 09 15:25:25.237185 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:25.237156    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-bd3840f1-65ccff9f5c-vfksp"]
Jul 09 15:25:25.238847 ip-10-0-137-94 kubenswrapper[2575]: W0709 15:25:25.238816    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccf551a1_75d1_4584_b6d4_41d48093210b.slice/crio-31b504ce36f739d528473c2b2923c7731bbc7caf0ac3863b0c58b3788fa4c603 WatchSource:0}: Error finding container 31b504ce36f739d528473c2b2923c7731bbc7caf0ac3863b0c58b3788fa4c603: Status 404 returned error can't find the container with id 31b504ce36f739d528473c2b2923c7731bbc7caf0ac3863b0c58b3788fa4c603
Jul 09 15:25:25.564591 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:25.564559    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:25:25.663660 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:25.663628    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:25:26.005424 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:26.005384    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bd3840f1-65ccff9f5c-vfksp" event={"ID":"ccf551a1-75d1-4584-b6d4-41d48093210b","Type":"ContainerStarted","Data":"42bd5ea60df03ec6e5f5773fd6dc4ace61123a532affb96555677636ccec8b57"}
Jul 09 15:25:26.005604 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:26.005447    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bd3840f1-65ccff9f5c-vfksp" event={"ID":"ccf551a1-75d1-4584-b6d4-41d48093210b","Type":"ContainerStarted","Data":"31b504ce36f739d528473c2b2923c7731bbc7caf0ac3863b0c58b3788fa4c603"}
Jul 09 15:25:26.005604 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:26.005496    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bd3840f1-65ccff9f5c-vfksp"
Jul 09 15:25:26.026985 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:26.026938    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bd3840f1-65ccff9f5c-vfksp" podStartSLOduration=1.70999166 podStartE2EDuration="2.026923772s" totalImagesPullingTime="316.932112ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:25:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:25:26.024335068 +0000 UTC m=+1833.866868012" watchObservedRunningTime="2026-07-09 15:25:26.026923772 +0000 UTC m=+1833.869456704"
Jul 09 15:25:28.467291 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:28.467257    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:25:32.023739 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:32.022817    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bd3840f1-65ccff9f5c-vfksp"
Jul 09 15:25:36.602082 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:36.602041    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:25:37.072285 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:37.072207    2575 generic.go:356] "Generic (PLEG): container finished" podID="342586b3-bcbe-4c62-8cf7-0390fba4d273" containerID="04d1cd3b4d358400140f080e8e8097b5eed0dfa4c225821cae7ff085cca84577" exitCode=0
Jul 09 15:25:37.072472 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:37.072280    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77" event={"ID":"342586b3-bcbe-4c62-8cf7-0390fba4d273","Type":"ContainerDied","Data":"04d1cd3b4d358400140f080e8e8097b5eed0dfa4c225821cae7ff085cca84577"}
Jul 09 15:25:37.072668 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:37.072655    2575 scope.go:117] "RemoveContainer" containerID="04d1cd3b4d358400140f080e8e8097b5eed0dfa4c225821cae7ff085cca84577"
Jul 09 15:25:37.073638 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:37.073616    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 15:25:37.073687 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:37.073674    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 15:25:37.073743 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:37.073734    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 15:25:37.220181 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:37.220137    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:25:37.320025 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:37.319993    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:25:37.987348 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:37.987313    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77"
Jul 09 15:25:38.079637 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:38.079598    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77" event={"ID":"342586b3-bcbe-4c62-8cf7-0390fba4d273","Type":"ContainerStarted","Data":"083471aa5ca3f1c758d9bdc7252e16ca3e7ee51504f26be6fae10b536c468156"}
Jul 09 15:25:38.935544 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:38.935509    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77"
Jul 09 15:25:38.936820 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:38.936791    2575 patch_prober.go:28] interesting pod/e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 09 15:25:38.936950 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:38.936852    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77" podUID="342586b3-bcbe-4c62-8cf7-0390fba4d273" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 09 15:25:39.936425 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:39.936389    2575 patch_prober.go:28] interesting pod/e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 09 15:25:39.936843 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:39.936456    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77" podUID="342586b3-bcbe-4c62-8cf7-0390fba4d273" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 09 15:25:40.935845 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:40.935810    2575 patch_prober.go:28] interesting pod/e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 09 15:25:40.936025 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:40.935863    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77" podUID="342586b3-bcbe-4c62-8cf7-0390fba4d273" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 09 15:25:41.935681 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:41.935641    2575 patch_prober.go:28] interesting pod/e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 09 15:25:41.936102 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:41.935699    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77" podUID="342586b3-bcbe-4c62-8cf7-0390fba4d273" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 09 15:25:42.939396 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:42.939363    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77"
Jul 09 15:25:42.939837 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:42.939735    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77"
Jul 09 15:25:42.940480 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:42.940459    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77"
Jul 09 15:25:45.642925 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:45.642894    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:25:45.750536 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:25:45.750506    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:26:00.927207 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:26:00.927172    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:26:01.407141 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:26:01.407104    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-bd3840f1-65ccff9f5c-vfksp"]
Jul 09 15:26:01.407350 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:26:01.407323    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bd3840f1-65ccff9f5c-vfksp" podUID="ccf551a1-75d1-4584-b6d4-41d48093210b" containerName="maas-api" containerID="cri-o://42bd5ea60df03ec6e5f5773fd6dc4ace61123a532affb96555677636ccec8b57" gracePeriod=30
Jul 09 15:26:01.441601 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:26:01.441576    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:26:01.656242 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:26:01.656214    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bd3840f1-65ccff9f5c-vfksp"
Jul 09 15:26:01.718352 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:26:01.718271    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ccf551a1-75d1-4584-b6d4-41d48093210b-maas-api-tls\") pod \"ccf551a1-75d1-4584-b6d4-41d48093210b\" (UID: \"ccf551a1-75d1-4584-b6d4-41d48093210b\") "
Jul 09 15:26:01.718352 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:26:01.718326    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k4wz6\" (UniqueName: \"kubernetes.io/projected/ccf551a1-75d1-4584-b6d4-41d48093210b-kube-api-access-k4wz6\") pod \"ccf551a1-75d1-4584-b6d4-41d48093210b\" (UID: \"ccf551a1-75d1-4584-b6d4-41d48093210b\") "
Jul 09 15:26:01.718551 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:26:01.718357    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ccf551a1-75d1-4584-b6d4-41d48093210b-openshift-service-ca\") pod \"ccf551a1-75d1-4584-b6d4-41d48093210b\" (UID: \"ccf551a1-75d1-4584-b6d4-41d48093210b\") "
Jul 09 15:26:01.718829 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:26:01.718802    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ccf551a1-75d1-4584-b6d4-41d48093210b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ccf551a1-75d1-4584-b6d4-41d48093210b" (UID: "ccf551a1-75d1-4584-b6d4-41d48093210b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 15:26:01.720491 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:26:01.720461    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ccf551a1-75d1-4584-b6d4-41d48093210b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ccf551a1-75d1-4584-b6d4-41d48093210b" (UID: "ccf551a1-75d1-4584-b6d4-41d48093210b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 15:26:01.720491 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:26:01.720484    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ccf551a1-75d1-4584-b6d4-41d48093210b-kube-api-access-k4wz6" (OuterVolumeSpecName: "kube-api-access-k4wz6") pod "ccf551a1-75d1-4584-b6d4-41d48093210b" (UID: "ccf551a1-75d1-4584-b6d4-41d48093210b"). InnerVolumeSpecName "kube-api-access-k4wz6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:26:01.819385 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:26:01.819350    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ccf551a1-75d1-4584-b6d4-41d48093210b-openshift-service-ca\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:26:01.819385 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:26:01.819379    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ccf551a1-75d1-4584-b6d4-41d48093210b-maas-api-tls\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:26:01.819385 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:26:01.819389    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k4wz6\" (UniqueName: \"kubernetes.io/projected/ccf551a1-75d1-4584-b6d4-41d48093210b-kube-api-access-k4wz6\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:26:02.212927 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:26:02.212891    2575 generic.go:356] "Generic (PLEG): container finished" podID="ccf551a1-75d1-4584-b6d4-41d48093210b" containerID="42bd5ea60df03ec6e5f5773fd6dc4ace61123a532affb96555677636ccec8b57" exitCode=0
Jul 09 15:26:02.213400 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:26:02.212935    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bd3840f1-65ccff9f5c-vfksp"
Jul 09 15:26:02.213400 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:26:02.212971    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bd3840f1-65ccff9f5c-vfksp" event={"ID":"ccf551a1-75d1-4584-b6d4-41d48093210b","Type":"ContainerDied","Data":"42bd5ea60df03ec6e5f5773fd6dc4ace61123a532affb96555677636ccec8b57"}
Jul 09 15:26:02.213400 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:26:02.213025    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bd3840f1-65ccff9f5c-vfksp" event={"ID":"ccf551a1-75d1-4584-b6d4-41d48093210b","Type":"ContainerDied","Data":"31b504ce36f739d528473c2b2923c7731bbc7caf0ac3863b0c58b3788fa4c603"}
Jul 09 15:26:02.213400 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:26:02.213052    2575 scope.go:117] "RemoveContainer" containerID="42bd5ea60df03ec6e5f5773fd6dc4ace61123a532affb96555677636ccec8b57"
Jul 09 15:26:02.223160 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:26:02.223143    2575 scope.go:117] "RemoveContainer" containerID="42bd5ea60df03ec6e5f5773fd6dc4ace61123a532affb96555677636ccec8b57"
Jul 09 15:26:02.223440 ip-10-0-137-94 kubenswrapper[2575]: E0709 15:26:02.223420    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42bd5ea60df03ec6e5f5773fd6dc4ace61123a532affb96555677636ccec8b57\": container with ID starting with 42bd5ea60df03ec6e5f5773fd6dc4ace61123a532affb96555677636ccec8b57 not found: ID does not exist" containerID="42bd5ea60df03ec6e5f5773fd6dc4ace61123a532affb96555677636ccec8b57"
Jul 09 15:26:02.223485 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:26:02.223449    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42bd5ea60df03ec6e5f5773fd6dc4ace61123a532affb96555677636ccec8b57"} err="failed to get container status \"42bd5ea60df03ec6e5f5773fd6dc4ace61123a532affb96555677636ccec8b57\": rpc error: code = NotFound desc = could not find container \"42bd5ea60df03ec6e5f5773fd6dc4ace61123a532affb96555677636ccec8b57\": container with ID starting with 42bd5ea60df03ec6e5f5773fd6dc4ace61123a532affb96555677636ccec8b57 not found: ID does not exist"
Jul 09 15:26:02.237747 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:26:02.237692    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-bd3840f1-65ccff9f5c-vfksp"]
Jul 09 15:26:02.242236 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:26:02.242216    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-bd3840f1-65ccff9f5c-vfksp"]
Jul 09 15:26:03.317273 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:26:03.317239    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ccf551a1-75d1-4584-b6d4-41d48093210b" path="/var/lib/kubelet/pods/ccf551a1-75d1-4584-b6d4-41d48093210b/volumes"
Jul 09 15:26:07.051761 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:26:07.051724    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:26:12.125403 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:26:12.125367    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:26:48.902256 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:26:48.902219    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:26:50.171527 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:26:50.171493    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:26:56.503008 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:26:56.502974    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:26:56.574545 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:26:56.574510    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:26:56.795325 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:26:56.795245    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77"]
Jul 09 15:26:56.795520 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:26:56.795495    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77" podUID="342586b3-bcbe-4c62-8cf7-0390fba4d273" containerName="istio-proxy" containerID="cri-o://083471aa5ca3f1c758d9bdc7252e16ca3e7ee51504f26be6fae10b536c468156" gracePeriod=30
Jul 09 15:26:56.825820 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:26:56.825786    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:26:57.136196 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:26:57.136166    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:26:57.941973 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:26:57.941938    2575 patch_prober.go:28] interesting pod/e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 09 15:26:57.942328 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:26:57.941999    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77" podUID="342586b3-bcbe-4c62-8cf7-0390fba4d273" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 09 15:26:58.310025 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:26:58.309926    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:26:58.473437 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:26:58.473404    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:26:58.660823 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:26:58.660795    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:26:59.371227 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:26:59.371189    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:26:59.478144 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:26:59.478111    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:27:00.953500 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:00.953466    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:27:02.060027 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:02.059969    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77"
Jul 09 15:27:02.156962 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:02.156914    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/342586b3-bcbe-4c62-8cf7-0390fba4d273-istio-podinfo\") pod \"342586b3-bcbe-4c62-8cf7-0390fba4d273\" (UID: \"342586b3-bcbe-4c62-8cf7-0390fba4d273\") "
Jul 09 15:27:02.157160 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:02.157004    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/342586b3-bcbe-4c62-8cf7-0390fba4d273-istiod-ca-cert\") pod \"342586b3-bcbe-4c62-8cf7-0390fba4d273\" (UID: \"342586b3-bcbe-4c62-8cf7-0390fba4d273\") "
Jul 09 15:27:02.157160 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:02.157051    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/342586b3-bcbe-4c62-8cf7-0390fba4d273-istio-data\") pod \"342586b3-bcbe-4c62-8cf7-0390fba4d273\" (UID: \"342586b3-bcbe-4c62-8cf7-0390fba4d273\") "
Jul 09 15:27:02.157160 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:02.157073    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/342586b3-bcbe-4c62-8cf7-0390fba4d273-credential-socket\") pod \"342586b3-bcbe-4c62-8cf7-0390fba4d273\" (UID: \"342586b3-bcbe-4c62-8cf7-0390fba4d273\") "
Jul 09 15:27:02.157160 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:02.157108    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/342586b3-bcbe-4c62-8cf7-0390fba4d273-workload-socket\") pod \"342586b3-bcbe-4c62-8cf7-0390fba4d273\" (UID: \"342586b3-bcbe-4c62-8cf7-0390fba4d273\") "
Jul 09 15:27:02.157160 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:02.157134    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/342586b3-bcbe-4c62-8cf7-0390fba4d273-istio-token\") pod \"342586b3-bcbe-4c62-8cf7-0390fba4d273\" (UID: \"342586b3-bcbe-4c62-8cf7-0390fba4d273\") "
Jul 09 15:27:02.157416 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:02.157208    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/342586b3-bcbe-4c62-8cf7-0390fba4d273-istio-envoy\") pod \"342586b3-bcbe-4c62-8cf7-0390fba4d273\" (UID: \"342586b3-bcbe-4c62-8cf7-0390fba4d273\") "
Jul 09 15:27:02.157416 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:02.157236    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mv9x2\" (UniqueName: \"kubernetes.io/projected/342586b3-bcbe-4c62-8cf7-0390fba4d273-kube-api-access-mv9x2\") pod \"342586b3-bcbe-4c62-8cf7-0390fba4d273\" (UID: \"342586b3-bcbe-4c62-8cf7-0390fba4d273\") "
Jul 09 15:27:02.157416 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:02.157293    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/342586b3-bcbe-4c62-8cf7-0390fba4d273-workload-certs\") pod \"342586b3-bcbe-4c62-8cf7-0390fba4d273\" (UID: \"342586b3-bcbe-4c62-8cf7-0390fba4d273\") "
Jul 09 15:27:02.157573 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:02.157407    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/342586b3-bcbe-4c62-8cf7-0390fba4d273-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "342586b3-bcbe-4c62-8cf7-0390fba4d273" (UID: "342586b3-bcbe-4c62-8cf7-0390fba4d273"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:27:02.157573 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:02.157425    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/342586b3-bcbe-4c62-8cf7-0390fba4d273-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "342586b3-bcbe-4c62-8cf7-0390fba4d273" (UID: "342586b3-bcbe-4c62-8cf7-0390fba4d273"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 15:27:02.157681 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:02.157621    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/342586b3-bcbe-4c62-8cf7-0390fba4d273-istiod-ca-cert\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:27:02.157681 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:02.157640    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/342586b3-bcbe-4c62-8cf7-0390fba4d273-credential-socket\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:27:02.157681 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:02.157642    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/342586b3-bcbe-4c62-8cf7-0390fba4d273-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "342586b3-bcbe-4c62-8cf7-0390fba4d273" (UID: "342586b3-bcbe-4c62-8cf7-0390fba4d273"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:27:02.157681 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:02.157658    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/342586b3-bcbe-4c62-8cf7-0390fba4d273-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "342586b3-bcbe-4c62-8cf7-0390fba4d273" (UID: "342586b3-bcbe-4c62-8cf7-0390fba4d273"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:27:02.157924 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:02.157889    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/342586b3-bcbe-4c62-8cf7-0390fba4d273-istio-data" (OuterVolumeSpecName: "istio-data") pod "342586b3-bcbe-4c62-8cf7-0390fba4d273" (UID: "342586b3-bcbe-4c62-8cf7-0390fba4d273"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:27:02.159320 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:02.159287    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/342586b3-bcbe-4c62-8cf7-0390fba4d273-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "342586b3-bcbe-4c62-8cf7-0390fba4d273" (UID: "342586b3-bcbe-4c62-8cf7-0390fba4d273"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 15:27:02.159438 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:02.159329    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/342586b3-bcbe-4c62-8cf7-0390fba4d273-istio-token" (OuterVolumeSpecName: "istio-token") pod "342586b3-bcbe-4c62-8cf7-0390fba4d273" (UID: "342586b3-bcbe-4c62-8cf7-0390fba4d273"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:27:02.159438 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:02.159373    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/342586b3-bcbe-4c62-8cf7-0390fba4d273-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "342586b3-bcbe-4c62-8cf7-0390fba4d273" (UID: "342586b3-bcbe-4c62-8cf7-0390fba4d273"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:27:02.159568 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:02.159463    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/342586b3-bcbe-4c62-8cf7-0390fba4d273-kube-api-access-mv9x2" (OuterVolumeSpecName: "kube-api-access-mv9x2") pod "342586b3-bcbe-4c62-8cf7-0390fba4d273" (UID: "342586b3-bcbe-4c62-8cf7-0390fba4d273"). InnerVolumeSpecName "kube-api-access-mv9x2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:27:02.258583 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:02.258552    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/342586b3-bcbe-4c62-8cf7-0390fba4d273-istio-data\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:27:02.258583 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:02.258579    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/342586b3-bcbe-4c62-8cf7-0390fba4d273-workload-socket\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:27:02.258583 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:02.258589    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/342586b3-bcbe-4c62-8cf7-0390fba4d273-istio-token\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:27:02.258879 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:02.258597    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/342586b3-bcbe-4c62-8cf7-0390fba4d273-istio-envoy\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:27:02.258879 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:02.258606    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mv9x2\" (UniqueName: \"kubernetes.io/projected/342586b3-bcbe-4c62-8cf7-0390fba4d273-kube-api-access-mv9x2\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:27:02.258879 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:02.258615    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/342586b3-bcbe-4c62-8cf7-0390fba4d273-workload-certs\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:27:02.258879 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:02.258623    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/342586b3-bcbe-4c62-8cf7-0390fba4d273-istio-podinfo\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:27:02.519476 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:02.519435    2575 generic.go:356] "Generic (PLEG): container finished" podID="342586b3-bcbe-4c62-8cf7-0390fba4d273" containerID="083471aa5ca3f1c758d9bdc7252e16ca3e7ee51504f26be6fae10b536c468156" exitCode=0
Jul 09 15:27:02.519643 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:02.519480    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77"
Jul 09 15:27:02.519643 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:02.519522    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77" event={"ID":"342586b3-bcbe-4c62-8cf7-0390fba4d273","Type":"ContainerDied","Data":"083471aa5ca3f1c758d9bdc7252e16ca3e7ee51504f26be6fae10b536c468156"}
Jul 09 15:27:02.519643 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:02.519576    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77" event={"ID":"342586b3-bcbe-4c62-8cf7-0390fba4d273","Type":"ContainerDied","Data":"6610055376a7ba42d0f6fd96e5c7eb45f107426b99709db1ab10fa207ec24a1e"}
Jul 09 15:27:02.519643 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:02.519599    2575 scope.go:117] "RemoveContainer" containerID="083471aa5ca3f1c758d9bdc7252e16ca3e7ee51504f26be6fae10b536c468156"
Jul 09 15:27:02.535221 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:02.535164    2575 scope.go:117] "RemoveContainer" containerID="04d1cd3b4d358400140f080e8e8097b5eed0dfa4c225821cae7ff085cca84577"
Jul 09 15:27:02.543449 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:02.543429    2575 scope.go:117] "RemoveContainer" containerID="083471aa5ca3f1c758d9bdc7252e16ca3e7ee51504f26be6fae10b536c468156"
Jul 09 15:27:02.543695 ip-10-0-137-94 kubenswrapper[2575]: E0709 15:27:02.543675    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"083471aa5ca3f1c758d9bdc7252e16ca3e7ee51504f26be6fae10b536c468156\": container with ID starting with 083471aa5ca3f1c758d9bdc7252e16ca3e7ee51504f26be6fae10b536c468156 not found: ID does not exist" containerID="083471aa5ca3f1c758d9bdc7252e16ca3e7ee51504f26be6fae10b536c468156"
Jul 09 15:27:02.543782 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:02.543703    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"083471aa5ca3f1c758d9bdc7252e16ca3e7ee51504f26be6fae10b536c468156"} err="failed to get container status \"083471aa5ca3f1c758d9bdc7252e16ca3e7ee51504f26be6fae10b536c468156\": rpc error: code = NotFound desc = could not find container \"083471aa5ca3f1c758d9bdc7252e16ca3e7ee51504f26be6fae10b536c468156\": container with ID starting with 083471aa5ca3f1c758d9bdc7252e16ca3e7ee51504f26be6fae10b536c468156 not found: ID does not exist"
Jul 09 15:27:02.543782 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:02.543738    2575 scope.go:117] "RemoveContainer" containerID="04d1cd3b4d358400140f080e8e8097b5eed0dfa4c225821cae7ff085cca84577"
Jul 09 15:27:02.543990 ip-10-0-137-94 kubenswrapper[2575]: E0709 15:27:02.543971    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04d1cd3b4d358400140f080e8e8097b5eed0dfa4c225821cae7ff085cca84577\": container with ID starting with 04d1cd3b4d358400140f080e8e8097b5eed0dfa4c225821cae7ff085cca84577 not found: ID does not exist" containerID="04d1cd3b4d358400140f080e8e8097b5eed0dfa4c225821cae7ff085cca84577"
Jul 09 15:27:02.544039 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:02.543996    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04d1cd3b4d358400140f080e8e8097b5eed0dfa4c225821cae7ff085cca84577"} err="failed to get container status \"04d1cd3b4d358400140f080e8e8097b5eed0dfa4c225821cae7ff085cca84577\": rpc error: code = NotFound desc = could not find container \"04d1cd3b4d358400140f080e8e8097b5eed0dfa4c225821cae7ff085cca84577\": container with ID starting with 04d1cd3b4d358400140f080e8e8097b5eed0dfa4c225821cae7ff085cca84577 not found: ID does not exist"
Jul 09 15:27:02.549306 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:02.549271    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77"]
Jul 09 15:27:02.556391 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:02.556370    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-bd3840f1-openshift-default-848dd77c59-q6q77"]
Jul 09 15:27:03.317304 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:03.317273    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="342586b3-bcbe-4c62-8cf7-0390fba4d273" path="/var/lib/kubelet/pods/342586b3-bcbe-4c62-8cf7-0390fba4d273/volumes"
Jul 09 15:27:07.570678 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:07.570644    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:27:07.673424 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:07.673387    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:27:08.361435 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:08.361389    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:27:14.616100 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:14.616065    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:27:15.444017 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:15.443980    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:27:15.561871 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:15.561839    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:27:25.680542 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:25.680509    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:27:25.780654 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:25.780628    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:27:46.762355 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:46.762275    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:27:53.087616 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:53.087582    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:27:53.346744 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:53.346641    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:27:53.459196 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:53.459160    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:27:53.786989 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:53.786956    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9"]
Jul 09 15:27:53.788318 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:53.788287    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="342586b3-bcbe-4c62-8cf7-0390fba4d273" containerName="istio-proxy"
Jul 09 15:27:53.788318 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:53.788318    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="342586b3-bcbe-4c62-8cf7-0390fba4d273" containerName="istio-proxy"
Jul 09 15:27:53.788548 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:53.788335    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ccf551a1-75d1-4584-b6d4-41d48093210b" containerName="maas-api"
Jul 09 15:27:53.788548 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:53.788341    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ccf551a1-75d1-4584-b6d4-41d48093210b" containerName="maas-api"
Jul 09 15:27:53.788548 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:53.788438    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="342586b3-bcbe-4c62-8cf7-0390fba4d273" containerName="istio-proxy"
Jul 09 15:27:53.788548 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:53.788452    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="ccf551a1-75d1-4584-b6d4-41d48093210b" containerName="maas-api"
Jul 09 15:27:53.793178 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:53.793157    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9"
Jul 09 15:27:53.796439 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:53.796420    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-d783ed-openshift-default-dockercfg-vknxp\""
Jul 09 15:27:53.804876 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:53.804851    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9"]
Jul 09 15:27:53.813075 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:53.813043    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:27:53.913497 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:53.913451    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e-istio-podinfo\") pod \"e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9\" (UID: \"8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e\") " pod="openshift-ingress/e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9"
Jul 09 15:27:53.913684 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:53.913524    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e-workload-socket\") pod \"e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9\" (UID: \"8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e\") " pod="openshift-ingress/e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9"
Jul 09 15:27:53.913684 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:53.913554    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e-workload-certs\") pod \"e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9\" (UID: \"8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e\") " pod="openshift-ingress/e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9"
Jul 09 15:27:53.913684 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:53.913578    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e-istio-data\") pod \"e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9\" (UID: \"8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e\") " pod="openshift-ingress/e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9"
Jul 09 15:27:53.913684 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:53.913601    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e-istiod-ca-cert\") pod \"e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9\" (UID: \"8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e\") " pod="openshift-ingress/e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9"
Jul 09 15:27:53.913684 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:53.913676    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e-istio-envoy\") pod \"e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9\" (UID: \"8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e\") " pod="openshift-ingress/e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9"
Jul 09 15:27:53.913908 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:53.913701    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e-istio-token\") pod \"e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9\" (UID: \"8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e\") " pod="openshift-ingress/e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9"
Jul 09 15:27:53.913908 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:53.913770    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e-credential-socket\") pod \"e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9\" (UID: \"8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e\") " pod="openshift-ingress/e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9"
Jul 09 15:27:53.913908 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:53.913800    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9tnp\" (UniqueName: \"kubernetes.io/projected/8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e-kube-api-access-q9tnp\") pod \"e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9\" (UID: \"8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e\") " pod="openshift-ingress/e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9"
Jul 09 15:27:53.976556 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:53.976523    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:27:54.014931 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:54.014896    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e-istio-data\") pod \"e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9\" (UID: \"8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e\") " pod="openshift-ingress/e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9"
Jul 09 15:27:54.015122 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:54.014942    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e-istiod-ca-cert\") pod \"e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9\" (UID: \"8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e\") " pod="openshift-ingress/e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9"
Jul 09 15:27:54.015122 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:54.015014    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e-istio-envoy\") pod \"e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9\" (UID: \"8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e\") " pod="openshift-ingress/e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9"
Jul 09 15:27:54.015122 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:54.015037    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e-istio-token\") pod \"e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9\" (UID: \"8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e\") " pod="openshift-ingress/e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9"
Jul 09 15:27:54.015122 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:54.015064    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e-credential-socket\") pod \"e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9\" (UID: \"8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e\") " pod="openshift-ingress/e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9"
Jul 09 15:27:54.015122 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:54.015096    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9tnp\" (UniqueName: \"kubernetes.io/projected/8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e-kube-api-access-q9tnp\") pod \"e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9\" (UID: \"8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e\") " pod="openshift-ingress/e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9"
Jul 09 15:27:54.015377 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:54.015168    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e-istio-podinfo\") pod \"e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9\" (UID: \"8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e\") " pod="openshift-ingress/e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9"
Jul 09 15:27:54.015377 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:54.015223    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e-workload-socket\") pod \"e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9\" (UID: \"8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e\") " pod="openshift-ingress/e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9"
Jul 09 15:27:54.015377 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:54.015247    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e-workload-certs\") pod \"e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9\" (UID: \"8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e\") " pod="openshift-ingress/e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9"
Jul 09 15:27:54.015377 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:54.015308    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e-istio-data\") pod \"e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9\" (UID: \"8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e\") " pod="openshift-ingress/e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9"
Jul 09 15:27:54.015612 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:54.015433    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e-credential-socket\") pod \"e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9\" (UID: \"8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e\") " pod="openshift-ingress/e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9"
Jul 09 15:27:54.015612 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:54.015532    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e-workload-certs\") pod \"e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9\" (UID: \"8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e\") " pod="openshift-ingress/e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9"
Jul 09 15:27:54.015754 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:54.015737    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e-istiod-ca-cert\") pod \"e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9\" (UID: \"8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e\") " pod="openshift-ingress/e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9"
Jul 09 15:27:54.015813 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:54.015792    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e-workload-socket\") pod \"e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9\" (UID: \"8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e\") " pod="openshift-ingress/e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9"
Jul 09 15:27:54.017658 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:54.017633    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e-istio-envoy\") pod \"e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9\" (UID: \"8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e\") " pod="openshift-ingress/e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9"
Jul 09 15:27:54.017845 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:54.017825    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e-istio-podinfo\") pod \"e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9\" (UID: \"8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e\") " pod="openshift-ingress/e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9"
Jul 09 15:27:54.025796 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:54.025776    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e-istio-token\") pod \"e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9\" (UID: \"8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e\") " pod="openshift-ingress/e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9"
Jul 09 15:27:54.026600 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:54.026582    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9tnp\" (UniqueName: \"kubernetes.io/projected/8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e-kube-api-access-q9tnp\") pod \"e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9\" (UID: \"8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e\") " pod="openshift-ingress/e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9"
Jul 09 15:27:54.104473 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:54.104380    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9"
Jul 09 15:27:54.246569 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:54.246544    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9"]
Jul 09 15:27:54.248160 ip-10-0-137-94 kubenswrapper[2575]: W0709 15:27:54.248136    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cdfac9a_fae5_49fa_8ffb_7039e6d4e93e.slice/crio-68dd4b256452000e5ce04a67c06086c647b092d27eabcc838b48db50571adb06 WatchSource:0}: Error finding container 68dd4b256452000e5ce04a67c06086c647b092d27eabcc838b48db50571adb06: Status 404 returned error can't find the container with id 68dd4b256452000e5ce04a67c06086c647b092d27eabcc838b48db50571adb06
Jul 09 15:27:54.250176 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:54.250133    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 15:27:54.250289 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:54.250217    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 15:27:54.250289 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:54.250262    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 15:27:54.799182 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:54.799137    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9" event={"ID":"8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e","Type":"ContainerStarted","Data":"e96a4c59fbb07f015955ee3e296066db3b68ce084a36f49b54962ab230398ba1"}
Jul 09 15:27:54.799431 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:54.799203    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9" event={"ID":"8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e","Type":"ContainerStarted","Data":"68dd4b256452000e5ce04a67c06086c647b092d27eabcc838b48db50571adb06"}
Jul 09 15:27:54.822806 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:54.822729    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9" podStartSLOduration=1.822686253 podStartE2EDuration="1.822686253s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:27:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:27:54.821791987 +0000 UTC m=+1982.664324921" watchObservedRunningTime="2026-07-09 15:27:54.822686253 +0000 UTC m=+1982.665219185"
Jul 09 15:27:55.105623 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:55.105523    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9"
Jul 09 15:27:55.110923 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:55.110892    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9"
Jul 09 15:27:55.804681 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:55.804648    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9"
Jul 09 15:27:55.805759 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:55.805735    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9"
Jul 09 15:27:56.834703 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:56.834650    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:27:56.922545 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:56.922512    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d783ed-6bf5946744-q88vw"]
Jul 09 15:27:56.922934 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:56.922920    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="342586b3-bcbe-4c62-8cf7-0390fba4d273" containerName="istio-proxy"
Jul 09 15:27:56.922983 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:56.922935    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="342586b3-bcbe-4c62-8cf7-0390fba4d273" containerName="istio-proxy"
Jul 09 15:27:56.923023 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:56.922998    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="342586b3-bcbe-4c62-8cf7-0390fba4d273" containerName="istio-proxy"
Jul 09 15:27:56.925959 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:56.925942    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d783ed-6bf5946744-q88vw"
Jul 09 15:27:56.929768 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:56.929751    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-d783ed-serving-cert\""
Jul 09 15:27:56.945049 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:56.945027    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d783ed-6bf5946744-q88vw"]
Jul 09 15:27:56.956933 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:56.956913    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:27:57.043695 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:57.043660    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-228bz\" (UniqueName: \"kubernetes.io/projected/258cc63e-da48-4b9c-92d8-c78c5c6d51d5-kube-api-access-228bz\") pod \"maas-api-e2e-inf-a-d783ed-6bf5946744-q88vw\" (UID: \"258cc63e-da48-4b9c-92d8-c78c5c6d51d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d783ed-6bf5946744-q88vw"
Jul 09 15:27:57.043918 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:57.043776    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/258cc63e-da48-4b9c-92d8-c78c5c6d51d5-openshift-service-ca\") pod \"maas-api-e2e-inf-a-d783ed-6bf5946744-q88vw\" (UID: \"258cc63e-da48-4b9c-92d8-c78c5c6d51d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d783ed-6bf5946744-q88vw"
Jul 09 15:27:57.043918 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:57.043886    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/258cc63e-da48-4b9c-92d8-c78c5c6d51d5-maas-api-tls\") pod \"maas-api-e2e-inf-a-d783ed-6bf5946744-q88vw\" (UID: \"258cc63e-da48-4b9c-92d8-c78c5c6d51d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d783ed-6bf5946744-q88vw"
Jul 09 15:27:57.144772 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:57.144739    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-228bz\" (UniqueName: \"kubernetes.io/projected/258cc63e-da48-4b9c-92d8-c78c5c6d51d5-kube-api-access-228bz\") pod \"maas-api-e2e-inf-a-d783ed-6bf5946744-q88vw\" (UID: \"258cc63e-da48-4b9c-92d8-c78c5c6d51d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d783ed-6bf5946744-q88vw"
Jul 09 15:27:57.144955 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:57.144795    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/258cc63e-da48-4b9c-92d8-c78c5c6d51d5-openshift-service-ca\") pod \"maas-api-e2e-inf-a-d783ed-6bf5946744-q88vw\" (UID: \"258cc63e-da48-4b9c-92d8-c78c5c6d51d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d783ed-6bf5946744-q88vw"
Jul 09 15:27:57.144955 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:57.144858    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/258cc63e-da48-4b9c-92d8-c78c5c6d51d5-maas-api-tls\") pod \"maas-api-e2e-inf-a-d783ed-6bf5946744-q88vw\" (UID: \"258cc63e-da48-4b9c-92d8-c78c5c6d51d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d783ed-6bf5946744-q88vw"
Jul 09 15:27:57.145577 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:57.145552    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/258cc63e-da48-4b9c-92d8-c78c5c6d51d5-openshift-service-ca\") pod \"maas-api-e2e-inf-a-d783ed-6bf5946744-q88vw\" (UID: \"258cc63e-da48-4b9c-92d8-c78c5c6d51d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d783ed-6bf5946744-q88vw"
Jul 09 15:27:57.147498 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:57.147471    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/258cc63e-da48-4b9c-92d8-c78c5c6d51d5-maas-api-tls\") pod \"maas-api-e2e-inf-a-d783ed-6bf5946744-q88vw\" (UID: \"258cc63e-da48-4b9c-92d8-c78c5c6d51d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d783ed-6bf5946744-q88vw"
Jul 09 15:27:57.156072 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:57.156051    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-228bz\" (UniqueName: \"kubernetes.io/projected/258cc63e-da48-4b9c-92d8-c78c5c6d51d5-kube-api-access-228bz\") pod \"maas-api-e2e-inf-a-d783ed-6bf5946744-q88vw\" (UID: \"258cc63e-da48-4b9c-92d8-c78c5c6d51d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d783ed-6bf5946744-q88vw"
Jul 09 15:27:57.192031 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:57.192004    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:27:57.236636 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:57.236611    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d783ed-6bf5946744-q88vw"
Jul 09 15:27:57.381893 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:57.381868    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d783ed-6bf5946744-q88vw"]
Jul 09 15:27:57.384014 ip-10-0-137-94 kubenswrapper[2575]: W0709 15:27:57.383983    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod258cc63e_da48_4b9c_92d8_c78c5c6d51d5.slice/crio-3a8fe4e943da477aa00b12b97508837796c8901e3328127235bea5870a1f613a WatchSource:0}: Error finding container 3a8fe4e943da477aa00b12b97508837796c8901e3328127235bea5870a1f613a: Status 404 returned error can't find the container with id 3a8fe4e943da477aa00b12b97508837796c8901e3328127235bea5870a1f613a
Jul 09 15:27:57.385761 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:57.385741    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 15:27:57.509277 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:57.509185    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:27:57.611935 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:57.611898    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:27:57.819701 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:57.819607    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d783ed-6bf5946744-q88vw" event={"ID":"258cc63e-da48-4b9c-92d8-c78c5c6d51d5","Type":"ContainerStarted","Data":"3a8fe4e943da477aa00b12b97508837796c8901e3328127235bea5870a1f613a"}
Jul 09 15:27:58.826602 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:58.826560    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d783ed-6bf5946744-q88vw" event={"ID":"258cc63e-da48-4b9c-92d8-c78c5c6d51d5","Type":"ContainerStarted","Data":"4979c63d6999c08bbd54d3b367f346dd67b4efe3c37ce578a531fd0c78365199"}
Jul 09 15:27:58.827018 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:58.826798    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d783ed-6bf5946744-q88vw"
Jul 09 15:27:58.845871 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:27:58.845824    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d783ed-6bf5946744-q88vw" podStartSLOduration=1.594913396 podStartE2EDuration="2.845809172s" totalImagesPullingTime="1.250895776s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:27:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:27:58.844271834 +0000 UTC m=+1986.686804766" watchObservedRunningTime="2026-07-09 15:27:58.845809172 +0000 UTC m=+1986.688342104"
Jul 09 15:28:01.323870 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:01.323832    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:28:01.724155 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:01.724122    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:28:02.085407 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:02.085329    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-2c3892-openshift-default-7df976f949-ftgrs"]
Jul 09 15:28:02.089007 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:02.088981    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-2c3892-openshift-default-7df976f949-ftgrs"
Jul 09 15:28:02.092138 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:02.092120    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-2c3892-openshift-default-dockercfg-vdsvf\""
Jul 09 15:28:02.113913 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:02.113884    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-2c3892-openshift-default-7df976f949-ftgrs"]
Jul 09 15:28:02.121357 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:02.121330    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:28:02.192681 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:02.192648    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60c9ba98-a353-4126-8011-6c6991dfc59d-istio-data\") pod \"e2e-inf-b-2c3892-openshift-default-7df976f949-ftgrs\" (UID: \"60c9ba98-a353-4126-8011-6c6991dfc59d\") " pod="openshift-ingress/e2e-inf-b-2c3892-openshift-default-7df976f949-ftgrs"
Jul 09 15:28:02.192887 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:02.192732    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60c9ba98-a353-4126-8011-6c6991dfc59d-istio-podinfo\") pod \"e2e-inf-b-2c3892-openshift-default-7df976f949-ftgrs\" (UID: \"60c9ba98-a353-4126-8011-6c6991dfc59d\") " pod="openshift-ingress/e2e-inf-b-2c3892-openshift-default-7df976f949-ftgrs"
Jul 09 15:28:02.192887 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:02.192781    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ws8m\" (UniqueName: \"kubernetes.io/projected/60c9ba98-a353-4126-8011-6c6991dfc59d-kube-api-access-8ws8m\") pod \"e2e-inf-b-2c3892-openshift-default-7df976f949-ftgrs\" (UID: \"60c9ba98-a353-4126-8011-6c6991dfc59d\") " pod="openshift-ingress/e2e-inf-b-2c3892-openshift-default-7df976f949-ftgrs"
Jul 09 15:28:02.192887 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:02.192812    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60c9ba98-a353-4126-8011-6c6991dfc59d-workload-socket\") pod \"e2e-inf-b-2c3892-openshift-default-7df976f949-ftgrs\" (UID: \"60c9ba98-a353-4126-8011-6c6991dfc59d\") " pod="openshift-ingress/e2e-inf-b-2c3892-openshift-default-7df976f949-ftgrs"
Jul 09 15:28:02.193012 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:02.192879    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60c9ba98-a353-4126-8011-6c6991dfc59d-credential-socket\") pod \"e2e-inf-b-2c3892-openshift-default-7df976f949-ftgrs\" (UID: \"60c9ba98-a353-4126-8011-6c6991dfc59d\") " pod="openshift-ingress/e2e-inf-b-2c3892-openshift-default-7df976f949-ftgrs"
Jul 09 15:28:02.193012 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:02.192912    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60c9ba98-a353-4126-8011-6c6991dfc59d-istio-token\") pod \"e2e-inf-b-2c3892-openshift-default-7df976f949-ftgrs\" (UID: \"60c9ba98-a353-4126-8011-6c6991dfc59d\") " pod="openshift-ingress/e2e-inf-b-2c3892-openshift-default-7df976f949-ftgrs"
Jul 09 15:28:02.193012 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:02.192956    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60c9ba98-a353-4126-8011-6c6991dfc59d-istio-envoy\") pod \"e2e-inf-b-2c3892-openshift-default-7df976f949-ftgrs\" (UID: \"60c9ba98-a353-4126-8011-6c6991dfc59d\") " pod="openshift-ingress/e2e-inf-b-2c3892-openshift-default-7df976f949-ftgrs"
Jul 09 15:28:02.193012 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:02.192976    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60c9ba98-a353-4126-8011-6c6991dfc59d-workload-certs\") pod \"e2e-inf-b-2c3892-openshift-default-7df976f949-ftgrs\" (UID: \"60c9ba98-a353-4126-8011-6c6991dfc59d\") " pod="openshift-ingress/e2e-inf-b-2c3892-openshift-default-7df976f949-ftgrs"
Jul 09 15:28:02.193012 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:02.192992    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60c9ba98-a353-4126-8011-6c6991dfc59d-istiod-ca-cert\") pod \"e2e-inf-b-2c3892-openshift-default-7df976f949-ftgrs\" (UID: \"60c9ba98-a353-4126-8011-6c6991dfc59d\") " pod="openshift-ingress/e2e-inf-b-2c3892-openshift-default-7df976f949-ftgrs"
Jul 09 15:28:02.293611 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:02.293576    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60c9ba98-a353-4126-8011-6c6991dfc59d-istio-podinfo\") pod \"e2e-inf-b-2c3892-openshift-default-7df976f949-ftgrs\" (UID: \"60c9ba98-a353-4126-8011-6c6991dfc59d\") " pod="openshift-ingress/e2e-inf-b-2c3892-openshift-default-7df976f949-ftgrs"
Jul 09 15:28:02.293813 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:02.293623    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ws8m\" (UniqueName: \"kubernetes.io/projected/60c9ba98-a353-4126-8011-6c6991dfc59d-kube-api-access-8ws8m\") pod \"e2e-inf-b-2c3892-openshift-default-7df976f949-ftgrs\" (UID: \"60c9ba98-a353-4126-8011-6c6991dfc59d\") " pod="openshift-ingress/e2e-inf-b-2c3892-openshift-default-7df976f949-ftgrs"
Jul 09 15:28:02.293813 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:02.293654    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60c9ba98-a353-4126-8011-6c6991dfc59d-workload-socket\") pod \"e2e-inf-b-2c3892-openshift-default-7df976f949-ftgrs\" (UID: \"60c9ba98-a353-4126-8011-6c6991dfc59d\") " pod="openshift-ingress/e2e-inf-b-2c3892-openshift-default-7df976f949-ftgrs"
Jul 09 15:28:02.293813 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:02.293679    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60c9ba98-a353-4126-8011-6c6991dfc59d-credential-socket\") pod \"e2e-inf-b-2c3892-openshift-default-7df976f949-ftgrs\" (UID: \"60c9ba98-a353-4126-8011-6c6991dfc59d\") " pod="openshift-ingress/e2e-inf-b-2c3892-openshift-default-7df976f949-ftgrs"
Jul 09 15:28:02.293813 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:02.293695    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60c9ba98-a353-4126-8011-6c6991dfc59d-istio-token\") pod \"e2e-inf-b-2c3892-openshift-default-7df976f949-ftgrs\" (UID: \"60c9ba98-a353-4126-8011-6c6991dfc59d\") " pod="openshift-ingress/e2e-inf-b-2c3892-openshift-default-7df976f949-ftgrs"
Jul 09 15:28:02.293813 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:02.293752    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60c9ba98-a353-4126-8011-6c6991dfc59d-istio-envoy\") pod \"e2e-inf-b-2c3892-openshift-default-7df976f949-ftgrs\" (UID: \"60c9ba98-a353-4126-8011-6c6991dfc59d\") " pod="openshift-ingress/e2e-inf-b-2c3892-openshift-default-7df976f949-ftgrs"
Jul 09 15:28:02.294118 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:02.293986    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60c9ba98-a353-4126-8011-6c6991dfc59d-workload-certs\") pod \"e2e-inf-b-2c3892-openshift-default-7df976f949-ftgrs\" (UID: \"60c9ba98-a353-4126-8011-6c6991dfc59d\") " pod="openshift-ingress/e2e-inf-b-2c3892-openshift-default-7df976f949-ftgrs"
Jul 09 15:28:02.294118 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:02.294027    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60c9ba98-a353-4126-8011-6c6991dfc59d-istiod-ca-cert\") pod \"e2e-inf-b-2c3892-openshift-default-7df976f949-ftgrs\" (UID: \"60c9ba98-a353-4126-8011-6c6991dfc59d\") " pod="openshift-ingress/e2e-inf-b-2c3892-openshift-default-7df976f949-ftgrs"
Jul 09 15:28:02.294118 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:02.294067    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60c9ba98-a353-4126-8011-6c6991dfc59d-istio-data\") pod \"e2e-inf-b-2c3892-openshift-default-7df976f949-ftgrs\" (UID: \"60c9ba98-a353-4126-8011-6c6991dfc59d\") " pod="openshift-ingress/e2e-inf-b-2c3892-openshift-default-7df976f949-ftgrs"
Jul 09 15:28:02.294280 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:02.294181    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60c9ba98-a353-4126-8011-6c6991dfc59d-workload-socket\") pod \"e2e-inf-b-2c3892-openshift-default-7df976f949-ftgrs\" (UID: \"60c9ba98-a353-4126-8011-6c6991dfc59d\") " pod="openshift-ingress/e2e-inf-b-2c3892-openshift-default-7df976f949-ftgrs"
Jul 09 15:28:02.294280 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:02.294235    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60c9ba98-a353-4126-8011-6c6991dfc59d-credential-socket\") pod \"e2e-inf-b-2c3892-openshift-default-7df976f949-ftgrs\" (UID: \"60c9ba98-a353-4126-8011-6c6991dfc59d\") " pod="openshift-ingress/e2e-inf-b-2c3892-openshift-default-7df976f949-ftgrs"
Jul 09 15:28:02.294389 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:02.294328    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60c9ba98-a353-4126-8011-6c6991dfc59d-workload-certs\") pod \"e2e-inf-b-2c3892-openshift-default-7df976f949-ftgrs\" (UID: \"60c9ba98-a353-4126-8011-6c6991dfc59d\") " pod="openshift-ingress/e2e-inf-b-2c3892-openshift-default-7df976f949-ftgrs"
Jul 09 15:28:02.294448 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:02.294420    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60c9ba98-a353-4126-8011-6c6991dfc59d-istio-data\") pod \"e2e-inf-b-2c3892-openshift-default-7df976f949-ftgrs\" (UID: \"60c9ba98-a353-4126-8011-6c6991dfc59d\") " pod="openshift-ingress/e2e-inf-b-2c3892-openshift-default-7df976f949-ftgrs"
Jul 09 15:28:02.294842 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:02.294824    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60c9ba98-a353-4126-8011-6c6991dfc59d-istiod-ca-cert\") pod \"e2e-inf-b-2c3892-openshift-default-7df976f949-ftgrs\" (UID: \"60c9ba98-a353-4126-8011-6c6991dfc59d\") " pod="openshift-ingress/e2e-inf-b-2c3892-openshift-default-7df976f949-ftgrs"
Jul 09 15:28:02.295988 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:02.295968    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60c9ba98-a353-4126-8011-6c6991dfc59d-istio-envoy\") pod \"e2e-inf-b-2c3892-openshift-default-7df976f949-ftgrs\" (UID: \"60c9ba98-a353-4126-8011-6c6991dfc59d\") " pod="openshift-ingress/e2e-inf-b-2c3892-openshift-default-7df976f949-ftgrs"
Jul 09 15:28:02.296238 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:02.296221    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60c9ba98-a353-4126-8011-6c6991dfc59d-istio-podinfo\") pod \"e2e-inf-b-2c3892-openshift-default-7df976f949-ftgrs\" (UID: \"60c9ba98-a353-4126-8011-6c6991dfc59d\") " pod="openshift-ingress/e2e-inf-b-2c3892-openshift-default-7df976f949-ftgrs"
Jul 09 15:28:02.329761 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:02.329687    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60c9ba98-a353-4126-8011-6c6991dfc59d-istio-token\") pod \"e2e-inf-b-2c3892-openshift-default-7df976f949-ftgrs\" (UID: \"60c9ba98-a353-4126-8011-6c6991dfc59d\") " pod="openshift-ingress/e2e-inf-b-2c3892-openshift-default-7df976f949-ftgrs"
Jul 09 15:28:02.332104 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:02.332084    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ws8m\" (UniqueName: \"kubernetes.io/projected/60c9ba98-a353-4126-8011-6c6991dfc59d-kube-api-access-8ws8m\") pod \"e2e-inf-b-2c3892-openshift-default-7df976f949-ftgrs\" (UID: \"60c9ba98-a353-4126-8011-6c6991dfc59d\") " pod="openshift-ingress/e2e-inf-b-2c3892-openshift-default-7df976f949-ftgrs"
Jul 09 15:28:02.387987 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:02.387950    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:28:02.400034 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:02.400010    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-2c3892-openshift-default-7df976f949-ftgrs"
Jul 09 15:28:02.557566 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:02.557542    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-2c3892-openshift-default-7df976f949-ftgrs"]
Jul 09 15:28:02.559379 ip-10-0-137-94 kubenswrapper[2575]: W0709 15:28:02.559355    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60c9ba98_a353_4126_8011_6c6991dfc59d.slice/crio-739412778a425cc4597519100681b3ea7cbc6e65a66c74dd7bed26723ea77426 WatchSource:0}: Error finding container 739412778a425cc4597519100681b3ea7cbc6e65a66c74dd7bed26723ea77426: Status 404 returned error can't find the container with id 739412778a425cc4597519100681b3ea7cbc6e65a66c74dd7bed26723ea77426
Jul 09 15:28:02.561558 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:02.561529    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 15:28:02.561629 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:02.561591    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 15:28:02.561629 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:02.561621    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 15:28:02.849510 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:02.849412    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2c3892-openshift-default-7df976f949-ftgrs" event={"ID":"60c9ba98-a353-4126-8011-6c6991dfc59d","Type":"ContainerStarted","Data":"89ee950abfbed72cfe62734a1acafdd675ef549b0150195609a80ae0d1ed24fb"}
Jul 09 15:28:02.849510 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:02.849474    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2c3892-openshift-default-7df976f949-ftgrs" event={"ID":"60c9ba98-a353-4126-8011-6c6991dfc59d","Type":"ContainerStarted","Data":"739412778a425cc4597519100681b3ea7cbc6e65a66c74dd7bed26723ea77426"}
Jul 09 15:28:02.881477 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:02.881425    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-2c3892-openshift-default-7df976f949-ftgrs" podStartSLOduration=0.881407359 podStartE2EDuration="881.407359ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:28:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:28:02.879657433 +0000 UTC m=+1990.722190367" watchObservedRunningTime="2026-07-09 15:28:02.881407359 +0000 UTC m=+1990.723940291"
Jul 09 15:28:03.400360 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:03.400309    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-2c3892-openshift-default-7df976f949-ftgrs"
Jul 09 15:28:03.405968 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:03.405941    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-2c3892-openshift-default-7df976f949-ftgrs"
Jul 09 15:28:03.854326 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:03.854233    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-2c3892-openshift-default-7df976f949-ftgrs"
Jul 09 15:28:03.855250 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:03.855226    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-2c3892-openshift-default-7df976f949-ftgrs"
Jul 09 15:28:04.838996 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:04.838964    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d783ed-6bf5946744-q88vw"
Jul 09 15:28:04.911020 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:04.910986    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:28:05.018439 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:05.018409    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:28:05.113263 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:05.113173    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:28:05.479729 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:05.479682    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:28:05.659365 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:05.659330    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:28:05.764270 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:05.764163    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:28:09.436138 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:09.436095    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:28:11.846878 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:11.846838    2575 patch_prober.go:28] interesting pod/e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 09 15:28:11.847275 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:11.846931    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9" podUID="8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 09 15:28:13.467206 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:13.467169    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:28:13.907897 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:13.907860    2575 generic.go:356] "Generic (PLEG): container finished" podID="8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e" containerID="e96a4c59fbb07f015955ee3e296066db3b68ce084a36f49b54962ab230398ba1" exitCode=0
Jul 09 15:28:13.908101 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:13.907934    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9" event={"ID":"8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e","Type":"ContainerDied","Data":"e96a4c59fbb07f015955ee3e296066db3b68ce084a36f49b54962ab230398ba1"}
Jul 09 15:28:13.908465 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:13.908447    2575 scope.go:117] "RemoveContainer" containerID="e96a4c59fbb07f015955ee3e296066db3b68ce084a36f49b54962ab230398ba1"
Jul 09 15:28:13.909622 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:13.909590    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 15:28:13.909769 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:13.909675    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 15:28:13.909769 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:13.909739    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 15:28:14.918905 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:14.918866    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9" event={"ID":"8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e","Type":"ContainerStarted","Data":"d605c2be159b41d36542496c071978b60d283095040fdfb19960d9232732377d"}
Jul 09 15:28:15.105503 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:15.105457    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9"
Jul 09 15:28:15.105746 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:15.105602    2575 patch_prober.go:28] interesting pod/e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Jul 09 15:28:15.105746 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:15.105663    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9" podUID="8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Jul 09 15:28:16.105102 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:16.105058    2575 patch_prober.go:28] interesting pod/e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Jul 09 15:28:16.105591 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:16.105125    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9" podUID="8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Jul 09 15:28:17.106037 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:17.106000    2575 patch_prober.go:28] interesting pod/e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Jul 09 15:28:17.106648 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:17.106615    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9" podUID="8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Jul 09 15:28:18.104834 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:18.104788    2575 patch_prober.go:28] interesting pod/e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Jul 09 15:28:18.105049 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:18.104858    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9" podUID="8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Jul 09 15:28:18.647004 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:18.646172    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:28:18.782050 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:18.781998    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:28:19.105736 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:19.105666    2575 patch_prober.go:28] interesting pod/e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Jul 09 15:28:19.105931 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:19.105763    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9" podUID="8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Jul 09 15:28:20.109263 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:20.109216    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9"
Jul 09 15:28:20.109695 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:20.109652    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9"
Jul 09 15:28:20.110551 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:20.110530    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9"
Jul 09 15:28:21.968989 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:21.968958    2575 generic.go:356] "Generic (PLEG): container finished" podID="60c9ba98-a353-4126-8011-6c6991dfc59d" containerID="89ee950abfbed72cfe62734a1acafdd675ef549b0150195609a80ae0d1ed24fb" exitCode=0
Jul 09 15:28:21.969557 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:21.969032    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2c3892-openshift-default-7df976f949-ftgrs" event={"ID":"60c9ba98-a353-4126-8011-6c6991dfc59d","Type":"ContainerDied","Data":"89ee950abfbed72cfe62734a1acafdd675ef549b0150195609a80ae0d1ed24fb"}
Jul 09 15:28:21.969557 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:21.969488    2575 scope.go:117] "RemoveContainer" containerID="89ee950abfbed72cfe62734a1acafdd675ef549b0150195609a80ae0d1ed24fb"
Jul 09 15:28:21.970487 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:21.970456    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 15:28:21.970587 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:21.970532    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 15:28:21.970630 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:21.970597    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 15:28:22.975955 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:22.975919    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2c3892-openshift-default-7df976f949-ftgrs" event={"ID":"60c9ba98-a353-4126-8011-6c6991dfc59d","Type":"ContainerStarted","Data":"092cc7c57d00e5e4c26dbb9ad8bd7a96745a31957d6000822a115682cf1b2334"}
Jul 09 15:28:23.401207 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:23.401173    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-2c3892-openshift-default-7df976f949-ftgrs"
Jul 09 15:28:23.401407 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:23.401380    2575 patch_prober.go:28] interesting pod/e2e-inf-b-2c3892-openshift-default-7df976f949-ftgrs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Jul 09 15:28:23.401477 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:23.401446    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-2c3892-openshift-default-7df976f949-ftgrs" podUID="60c9ba98-a353-4126-8011-6c6991dfc59d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Jul 09 15:28:24.401194 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:24.401158    2575 patch_prober.go:28] interesting pod/e2e-inf-b-2c3892-openshift-default-7df976f949-ftgrs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Jul 09 15:28:24.401587 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:24.401216    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-2c3892-openshift-default-7df976f949-ftgrs" podUID="60c9ba98-a353-4126-8011-6c6991dfc59d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Jul 09 15:28:25.400867 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:25.400826    2575 patch_prober.go:28] interesting pod/e2e-inf-b-2c3892-openshift-default-7df976f949-ftgrs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Jul 09 15:28:25.401180 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:25.400889    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-2c3892-openshift-default-7df976f949-ftgrs" podUID="60c9ba98-a353-4126-8011-6c6991dfc59d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Jul 09 15:28:26.400969 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:26.400927    2575 patch_prober.go:28] interesting pod/e2e-inf-b-2c3892-openshift-default-7df976f949-ftgrs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Jul 09 15:28:26.401434 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:26.400989    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-2c3892-openshift-default-7df976f949-ftgrs" podUID="60c9ba98-a353-4126-8011-6c6991dfc59d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Jul 09 15:28:27.404172 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:27.404139    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-2c3892-openshift-default-7df976f949-ftgrs"
Jul 09 15:28:27.404578 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:27.404437    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-2c3892-openshift-default-7df976f949-ftgrs"
Jul 09 15:28:27.405294 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:27.405274    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-2c3892-openshift-default-7df976f949-ftgrs"
Jul 09 15:28:27.613950 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:27.613908    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:28:27.713109 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:27.713016    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:28:32.514901 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:32.514872    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:28:54.452851 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:54.452811    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d783ed-6bf5946744-q88vw"]
Jul 09 15:28:54.453254 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:54.453069    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d783ed-6bf5946744-q88vw" podUID="258cc63e-da48-4b9c-92d8-c78c5c6d51d5" containerName="maas-api" containerID="cri-o://4979c63d6999c08bbd54d3b367f346dd67b4efe3c37ce578a531fd0c78365199" gracePeriod=30
Jul 09 15:28:54.652499 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:54.652471    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:28:54.703610 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:54.703553    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d783ed-6bf5946744-q88vw"
Jul 09 15:28:54.745923 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:54.745865    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:28:54.807609 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:54.807577    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/258cc63e-da48-4b9c-92d8-c78c5c6d51d5-openshift-service-ca\") pod \"258cc63e-da48-4b9c-92d8-c78c5c6d51d5\" (UID: \"258cc63e-da48-4b9c-92d8-c78c5c6d51d5\") "
Jul 09 15:28:54.807823 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:54.807734    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-228bz\" (UniqueName: \"kubernetes.io/projected/258cc63e-da48-4b9c-92d8-c78c5c6d51d5-kube-api-access-228bz\") pod \"258cc63e-da48-4b9c-92d8-c78c5c6d51d5\" (UID: \"258cc63e-da48-4b9c-92d8-c78c5c6d51d5\") "
Jul 09 15:28:54.807823 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:54.807781    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/258cc63e-da48-4b9c-92d8-c78c5c6d51d5-maas-api-tls\") pod \"258cc63e-da48-4b9c-92d8-c78c5c6d51d5\" (UID: \"258cc63e-da48-4b9c-92d8-c78c5c6d51d5\") "
Jul 09 15:28:54.808078 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:54.808049    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/258cc63e-da48-4b9c-92d8-c78c5c6d51d5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "258cc63e-da48-4b9c-92d8-c78c5c6d51d5" (UID: "258cc63e-da48-4b9c-92d8-c78c5c6d51d5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 15:28:54.809926 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:54.809898    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/258cc63e-da48-4b9c-92d8-c78c5c6d51d5-kube-api-access-228bz" (OuterVolumeSpecName: "kube-api-access-228bz") pod "258cc63e-da48-4b9c-92d8-c78c5c6d51d5" (UID: "258cc63e-da48-4b9c-92d8-c78c5c6d51d5"). InnerVolumeSpecName "kube-api-access-228bz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:28:54.810361 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:54.810326    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/258cc63e-da48-4b9c-92d8-c78c5c6d51d5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "258cc63e-da48-4b9c-92d8-c78c5c6d51d5" (UID: "258cc63e-da48-4b9c-92d8-c78c5c6d51d5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 15:28:54.909201 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:54.909166    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-228bz\" (UniqueName: \"kubernetes.io/projected/258cc63e-da48-4b9c-92d8-c78c5c6d51d5-kube-api-access-228bz\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:28:54.909201 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:54.909197    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/258cc63e-da48-4b9c-92d8-c78c5c6d51d5-maas-api-tls\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:28:54.909201 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:54.909207    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/258cc63e-da48-4b9c-92d8-c78c5c6d51d5-openshift-service-ca\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:28:55.149008 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:55.148977    2575 generic.go:356] "Generic (PLEG): container finished" podID="258cc63e-da48-4b9c-92d8-c78c5c6d51d5" containerID="4979c63d6999c08bbd54d3b367f346dd67b4efe3c37ce578a531fd0c78365199" exitCode=0
Jul 09 15:28:55.149203 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:55.149059    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d783ed-6bf5946744-q88vw"
Jul 09 15:28:55.149203 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:55.149070    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d783ed-6bf5946744-q88vw" event={"ID":"258cc63e-da48-4b9c-92d8-c78c5c6d51d5","Type":"ContainerDied","Data":"4979c63d6999c08bbd54d3b367f346dd67b4efe3c37ce578a531fd0c78365199"}
Jul 09 15:28:55.149203 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:55.149158    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d783ed-6bf5946744-q88vw" event={"ID":"258cc63e-da48-4b9c-92d8-c78c5c6d51d5","Type":"ContainerDied","Data":"3a8fe4e943da477aa00b12b97508837796c8901e3328127235bea5870a1f613a"}
Jul 09 15:28:55.149203 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:55.149181    2575 scope.go:117] "RemoveContainer" containerID="4979c63d6999c08bbd54d3b367f346dd67b4efe3c37ce578a531fd0c78365199"
Jul 09 15:28:55.158809 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:55.158795    2575 scope.go:117] "RemoveContainer" containerID="4979c63d6999c08bbd54d3b367f346dd67b4efe3c37ce578a531fd0c78365199"
Jul 09 15:28:55.159091 ip-10-0-137-94 kubenswrapper[2575]: E0709 15:28:55.159072    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4979c63d6999c08bbd54d3b367f346dd67b4efe3c37ce578a531fd0c78365199\": container with ID starting with 4979c63d6999c08bbd54d3b367f346dd67b4efe3c37ce578a531fd0c78365199 not found: ID does not exist" containerID="4979c63d6999c08bbd54d3b367f346dd67b4efe3c37ce578a531fd0c78365199"
Jul 09 15:28:55.159139 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:55.159100    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4979c63d6999c08bbd54d3b367f346dd67b4efe3c37ce578a531fd0c78365199"} err="failed to get container status \"4979c63d6999c08bbd54d3b367f346dd67b4efe3c37ce578a531fd0c78365199\": rpc error: code = NotFound desc = could not find container \"4979c63d6999c08bbd54d3b367f346dd67b4efe3c37ce578a531fd0c78365199\": container with ID starting with 4979c63d6999c08bbd54d3b367f346dd67b4efe3c37ce578a531fd0c78365199 not found: ID does not exist"
Jul 09 15:28:55.172155 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:55.172130    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d783ed-6bf5946744-q88vw"]
Jul 09 15:28:55.174295 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:55.174277    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d783ed-6bf5946744-q88vw"]
Jul 09 15:28:55.317380 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:55.317348    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="258cc63e-da48-4b9c-92d8-c78c5c6d51d5" path="/var/lib/kubelet/pods/258cc63e-da48-4b9c-92d8-c78c5c6d51d5/volumes"
Jul 09 15:28:59.256845 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:28:59.256807    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:29:02.960118 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:02.960077    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:29:37.293376 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:37.293339    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:29:37.537055 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:37.537023    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9"]
Jul 09 15:29:37.537263 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:37.537218    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9" podUID="8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e" containerName="istio-proxy" containerID="cri-o://d605c2be159b41d36542496c071978b60d283095040fdfb19960d9232732377d" gracePeriod=30
Jul 09 15:29:37.582093 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:37.581983    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:29:37.818900 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:37.818850    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:29:38.092855 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:38.092824    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:29:38.590572 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:38.590538    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:29:38.764541 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:38.764486    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:29:39.061766 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:39.061733    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:29:42.797955 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:42.797929    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9"
Jul 09 15:29:42.864373 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:42.864290    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e-workload-socket\") pod \"8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e\" (UID: \"8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e\") "
Jul 09 15:29:42.864373 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:42.864332    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e-workload-certs\") pod \"8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e\" (UID: \"8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e\") "
Jul 09 15:29:42.864610 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:42.864392    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e-istiod-ca-cert\") pod \"8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e\" (UID: \"8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e\") "
Jul 09 15:29:42.864610 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:42.864432    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q9tnp\" (UniqueName: \"kubernetes.io/projected/8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e-kube-api-access-q9tnp\") pod \"8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e\" (UID: \"8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e\") "
Jul 09 15:29:42.864610 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:42.864462    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e-istio-data\") pod \"8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e\" (UID: \"8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e\") "
Jul 09 15:29:42.864610 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:42.864530    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e-istio-podinfo\") pod \"8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e\" (UID: \"8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e\") "
Jul 09 15:29:42.864610 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:42.864554    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e-istio-token\") pod \"8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e\" (UID: \"8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e\") "
Jul 09 15:29:42.864610 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:42.864562    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e" (UID: "8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:29:42.864610 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:42.864580    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e-istio-envoy\") pod \"8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e\" (UID: \"8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e\") "
Jul 09 15:29:42.864610 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:42.864612    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e-credential-socket\") pod \"8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e\" (UID: \"8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e\") "
Jul 09 15:29:42.865065 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:42.864751    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e" (UID: "8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:29:42.865065 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:42.864843    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e" (UID: "8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 15:29:42.865065 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:42.864953    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e-workload-socket\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:29:42.865065 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:42.864973    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e-workload-certs\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:29:42.865065 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:42.864973    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e" (UID: "8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:29:42.865065 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:42.864986    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e-istiod-ca-cert\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:29:42.865498 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:42.865465    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e-istio-data" (OuterVolumeSpecName: "istio-data") pod "8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e" (UID: "8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:29:42.866781 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:42.866757    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e-istio-token" (OuterVolumeSpecName: "istio-token") pod "8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e" (UID: "8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:29:42.866908 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:42.866880    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e-kube-api-access-q9tnp" (OuterVolumeSpecName: "kube-api-access-q9tnp") pod "8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e" (UID: "8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e"). InnerVolumeSpecName "kube-api-access-q9tnp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:29:42.867234 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:42.867203    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e" (UID: "8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:29:42.867234 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:42.867215    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e" (UID: "8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 15:29:42.966153 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:42.966112    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q9tnp\" (UniqueName: \"kubernetes.io/projected/8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e-kube-api-access-q9tnp\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:29:42.966153 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:42.966145    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e-istio-data\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:29:42.966153 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:42.966155    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e-istio-podinfo\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:29:42.966153 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:42.966163    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e-istio-token\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:29:42.966430 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:42.966170    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e-istio-envoy\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:29:42.966430 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:42.966178    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e-credential-socket\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:29:43.397531 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:43.397496    2575 generic.go:356] "Generic (PLEG): container finished" podID="8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e" containerID="d605c2be159b41d36542496c071978b60d283095040fdfb19960d9232732377d" exitCode=0
Jul 09 15:29:43.397744 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:43.397548    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9"
Jul 09 15:29:43.397744 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:43.397585    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9" event={"ID":"8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e","Type":"ContainerDied","Data":"d605c2be159b41d36542496c071978b60d283095040fdfb19960d9232732377d"}
Jul 09 15:29:43.397744 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:43.397641    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9" event={"ID":"8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e","Type":"ContainerDied","Data":"68dd4b256452000e5ce04a67c06086c647b092d27eabcc838b48db50571adb06"}
Jul 09 15:29:43.397744 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:43.397666    2575 scope.go:117] "RemoveContainer" containerID="d605c2be159b41d36542496c071978b60d283095040fdfb19960d9232732377d"
Jul 09 15:29:43.408003 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:43.407973    2575 scope.go:117] "RemoveContainer" containerID="e96a4c59fbb07f015955ee3e296066db3b68ce084a36f49b54962ab230398ba1"
Jul 09 15:29:43.416149 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:43.416127    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9"]
Jul 09 15:29:43.416546 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:43.416522    2575 scope.go:117] "RemoveContainer" containerID="d605c2be159b41d36542496c071978b60d283095040fdfb19960d9232732377d"
Jul 09 15:29:43.416843 ip-10-0-137-94 kubenswrapper[2575]: E0709 15:29:43.416818    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d605c2be159b41d36542496c071978b60d283095040fdfb19960d9232732377d\": container with ID starting with d605c2be159b41d36542496c071978b60d283095040fdfb19960d9232732377d not found: ID does not exist" containerID="d605c2be159b41d36542496c071978b60d283095040fdfb19960d9232732377d"
Jul 09 15:29:43.416924 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:43.416853    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d605c2be159b41d36542496c071978b60d283095040fdfb19960d9232732377d"} err="failed to get container status \"d605c2be159b41d36542496c071978b60d283095040fdfb19960d9232732377d\": rpc error: code = NotFound desc = could not find container \"d605c2be159b41d36542496c071978b60d283095040fdfb19960d9232732377d\": container with ID starting with d605c2be159b41d36542496c071978b60d283095040fdfb19960d9232732377d not found: ID does not exist"
Jul 09 15:29:43.416924 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:43.416871    2575 scope.go:117] "RemoveContainer" containerID="e96a4c59fbb07f015955ee3e296066db3b68ce084a36f49b54962ab230398ba1"
Jul 09 15:29:43.417158 ip-10-0-137-94 kubenswrapper[2575]: E0709 15:29:43.417132    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e96a4c59fbb07f015955ee3e296066db3b68ce084a36f49b54962ab230398ba1\": container with ID starting with e96a4c59fbb07f015955ee3e296066db3b68ce084a36f49b54962ab230398ba1 not found: ID does not exist" containerID="e96a4c59fbb07f015955ee3e296066db3b68ce084a36f49b54962ab230398ba1"
Jul 09 15:29:43.417245 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:43.417166    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e96a4c59fbb07f015955ee3e296066db3b68ce084a36f49b54962ab230398ba1"} err="failed to get container status \"e96a4c59fbb07f015955ee3e296066db3b68ce084a36f49b54962ab230398ba1\": rpc error: code = NotFound desc = could not find container \"e96a4c59fbb07f015955ee3e296066db3b68ce084a36f49b54962ab230398ba1\": container with ID starting with e96a4c59fbb07f015955ee3e296066db3b68ce084a36f49b54962ab230398ba1 not found: ID does not exist"
Jul 09 15:29:43.419474 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:43.419455    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-d783ed-openshift-default-54d6f4f54c-gvbp9"]
Jul 09 15:29:45.004785 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:45.004752    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:29:45.104559 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:45.104527    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:29:45.324259 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:45.319891    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e" path="/var/lib/kubelet/pods/8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e/volumes"
Jul 09 15:29:45.364259 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:45.364230    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-2c3892-openshift-default-7df976f949-ftgrs"]
Jul 09 15:29:45.364492 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:45.364467    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-2c3892-openshift-default-7df976f949-ftgrs" podUID="60c9ba98-a353-4126-8011-6c6991dfc59d" containerName="istio-proxy" containerID="cri-o://092cc7c57d00e5e4c26dbb9ad8bd7a96745a31957d6000822a115682cf1b2334" gracePeriod=30
Jul 09 15:29:45.378398 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:45.378365    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:29:45.583914 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:45.583828    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:29:45.939730 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:45.939682    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:29:46.316758 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:46.316669    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:29:46.553751 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:46.553698    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:29:50.636717 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:50.636678    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-2c3892-openshift-default-7df976f949-ftgrs"
Jul 09 15:29:50.739514 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:50.739477    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60c9ba98-a353-4126-8011-6c6991dfc59d-credential-socket\") pod \"60c9ba98-a353-4126-8011-6c6991dfc59d\" (UID: \"60c9ba98-a353-4126-8011-6c6991dfc59d\") "
Jul 09 15:29:50.739693 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:50.739536    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60c9ba98-a353-4126-8011-6c6991dfc59d-istio-podinfo\") pod \"60c9ba98-a353-4126-8011-6c6991dfc59d\" (UID: \"60c9ba98-a353-4126-8011-6c6991dfc59d\") "
Jul 09 15:29:50.739693 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:50.739581    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60c9ba98-a353-4126-8011-6c6991dfc59d-istio-token\") pod \"60c9ba98-a353-4126-8011-6c6991dfc59d\" (UID: \"60c9ba98-a353-4126-8011-6c6991dfc59d\") "
Jul 09 15:29:50.739693 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:50.739610    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60c9ba98-a353-4126-8011-6c6991dfc59d-istio-envoy\") pod \"60c9ba98-a353-4126-8011-6c6991dfc59d\" (UID: \"60c9ba98-a353-4126-8011-6c6991dfc59d\") "
Jul 09 15:29:50.739693 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:50.739631    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60c9ba98-a353-4126-8011-6c6991dfc59d-workload-certs\") pod \"60c9ba98-a353-4126-8011-6c6991dfc59d\" (UID: \"60c9ba98-a353-4126-8011-6c6991dfc59d\") "
Jul 09 15:29:50.739693 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:50.739661    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8ws8m\" (UniqueName: \"kubernetes.io/projected/60c9ba98-a353-4126-8011-6c6991dfc59d-kube-api-access-8ws8m\") pod \"60c9ba98-a353-4126-8011-6c6991dfc59d\" (UID: \"60c9ba98-a353-4126-8011-6c6991dfc59d\") "
Jul 09 15:29:50.740000 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:50.739733    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60c9ba98-a353-4126-8011-6c6991dfc59d-istio-data\") pod \"60c9ba98-a353-4126-8011-6c6991dfc59d\" (UID: \"60c9ba98-a353-4126-8011-6c6991dfc59d\") "
Jul 09 15:29:50.740000 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:50.739779    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60c9ba98-a353-4126-8011-6c6991dfc59d-workload-socket\") pod \"60c9ba98-a353-4126-8011-6c6991dfc59d\" (UID: \"60c9ba98-a353-4126-8011-6c6991dfc59d\") "
Jul 09 15:29:50.740000 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:50.739800    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60c9ba98-a353-4126-8011-6c6991dfc59d-istiod-ca-cert\") pod \"60c9ba98-a353-4126-8011-6c6991dfc59d\" (UID: \"60c9ba98-a353-4126-8011-6c6991dfc59d\") "
Jul 09 15:29:50.740000 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:50.739809    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60c9ba98-a353-4126-8011-6c6991dfc59d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "60c9ba98-a353-4126-8011-6c6991dfc59d" (UID: "60c9ba98-a353-4126-8011-6c6991dfc59d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:29:50.740218 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:50.739994    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60c9ba98-a353-4126-8011-6c6991dfc59d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "60c9ba98-a353-4126-8011-6c6991dfc59d" (UID: "60c9ba98-a353-4126-8011-6c6991dfc59d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:29:50.740218 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:50.740115    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60c9ba98-a353-4126-8011-6c6991dfc59d-credential-socket\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:29:50.740218 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:50.740136    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60c9ba98-a353-4126-8011-6c6991dfc59d-workload-certs\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:29:50.740218 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:50.740187    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60c9ba98-a353-4126-8011-6c6991dfc59d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "60c9ba98-a353-4126-8011-6c6991dfc59d" (UID: "60c9ba98-a353-4126-8011-6c6991dfc59d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:29:50.740444 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:50.740425    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60c9ba98-a353-4126-8011-6c6991dfc59d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "60c9ba98-a353-4126-8011-6c6991dfc59d" (UID: "60c9ba98-a353-4126-8011-6c6991dfc59d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 15:29:50.740625 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:50.740602    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60c9ba98-a353-4126-8011-6c6991dfc59d-istio-data" (OuterVolumeSpecName: "istio-data") pod "60c9ba98-a353-4126-8011-6c6991dfc59d" (UID: "60c9ba98-a353-4126-8011-6c6991dfc59d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:29:50.741880 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:50.741860    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/60c9ba98-a353-4126-8011-6c6991dfc59d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "60c9ba98-a353-4126-8011-6c6991dfc59d" (UID: "60c9ba98-a353-4126-8011-6c6991dfc59d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 15:29:50.741976 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:50.741888    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60c9ba98-a353-4126-8011-6c6991dfc59d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "60c9ba98-a353-4126-8011-6c6991dfc59d" (UID: "60c9ba98-a353-4126-8011-6c6991dfc59d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:29:50.742266 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:50.742247    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60c9ba98-a353-4126-8011-6c6991dfc59d-kube-api-access-8ws8m" (OuterVolumeSpecName: "kube-api-access-8ws8m") pod "60c9ba98-a353-4126-8011-6c6991dfc59d" (UID: "60c9ba98-a353-4126-8011-6c6991dfc59d"). InnerVolumeSpecName "kube-api-access-8ws8m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:29:50.742336 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:50.742254    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60c9ba98-a353-4126-8011-6c6991dfc59d-istio-token" (OuterVolumeSpecName: "istio-token") pod "60c9ba98-a353-4126-8011-6c6991dfc59d" (UID: "60c9ba98-a353-4126-8011-6c6991dfc59d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:29:50.840668 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:50.840632    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60c9ba98-a353-4126-8011-6c6991dfc59d-workload-socket\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:29:50.840668 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:50.840667    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60c9ba98-a353-4126-8011-6c6991dfc59d-istiod-ca-cert\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:29:50.840668 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:50.840676    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60c9ba98-a353-4126-8011-6c6991dfc59d-istio-podinfo\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:29:50.840911 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:50.840686    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60c9ba98-a353-4126-8011-6c6991dfc59d-istio-token\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:29:50.840911 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:50.840694    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60c9ba98-a353-4126-8011-6c6991dfc59d-istio-envoy\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:29:50.840911 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:50.840702    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8ws8m\" (UniqueName: \"kubernetes.io/projected/60c9ba98-a353-4126-8011-6c6991dfc59d-kube-api-access-8ws8m\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:29:50.840911 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:50.840731    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60c9ba98-a353-4126-8011-6c6991dfc59d-istio-data\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:29:51.441328 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:51.441297    2575 generic.go:356] "Generic (PLEG): container finished" podID="60c9ba98-a353-4126-8011-6c6991dfc59d" containerID="092cc7c57d00e5e4c26dbb9ad8bd7a96745a31957d6000822a115682cf1b2334" exitCode=0
Jul 09 15:29:51.441503 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:51.441357    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-2c3892-openshift-default-7df976f949-ftgrs"
Jul 09 15:29:51.441503 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:51.441382    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2c3892-openshift-default-7df976f949-ftgrs" event={"ID":"60c9ba98-a353-4126-8011-6c6991dfc59d","Type":"ContainerDied","Data":"092cc7c57d00e5e4c26dbb9ad8bd7a96745a31957d6000822a115682cf1b2334"}
Jul 09 15:29:51.441503 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:51.441442    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2c3892-openshift-default-7df976f949-ftgrs" event={"ID":"60c9ba98-a353-4126-8011-6c6991dfc59d","Type":"ContainerDied","Data":"739412778a425cc4597519100681b3ea7cbc6e65a66c74dd7bed26723ea77426"}
Jul 09 15:29:51.441503 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:51.441465    2575 scope.go:117] "RemoveContainer" containerID="092cc7c57d00e5e4c26dbb9ad8bd7a96745a31957d6000822a115682cf1b2334"
Jul 09 15:29:51.450661 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:51.450644    2575 scope.go:117] "RemoveContainer" containerID="89ee950abfbed72cfe62734a1acafdd675ef549b0150195609a80ae0d1ed24fb"
Jul 09 15:29:51.458297 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:51.458277    2575 scope.go:117] "RemoveContainer" containerID="092cc7c57d00e5e4c26dbb9ad8bd7a96745a31957d6000822a115682cf1b2334"
Jul 09 15:29:51.458533 ip-10-0-137-94 kubenswrapper[2575]: E0709 15:29:51.458517    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"092cc7c57d00e5e4c26dbb9ad8bd7a96745a31957d6000822a115682cf1b2334\": container with ID starting with 092cc7c57d00e5e4c26dbb9ad8bd7a96745a31957d6000822a115682cf1b2334 not found: ID does not exist" containerID="092cc7c57d00e5e4c26dbb9ad8bd7a96745a31957d6000822a115682cf1b2334"
Jul 09 15:29:51.458581 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:51.458542    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"092cc7c57d00e5e4c26dbb9ad8bd7a96745a31957d6000822a115682cf1b2334"} err="failed to get container status \"092cc7c57d00e5e4c26dbb9ad8bd7a96745a31957d6000822a115682cf1b2334\": rpc error: code = NotFound desc = could not find container \"092cc7c57d00e5e4c26dbb9ad8bd7a96745a31957d6000822a115682cf1b2334\": container with ID starting with 092cc7c57d00e5e4c26dbb9ad8bd7a96745a31957d6000822a115682cf1b2334 not found: ID does not exist"
Jul 09 15:29:51.458581 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:51.458556    2575 scope.go:117] "RemoveContainer" containerID="89ee950abfbed72cfe62734a1acafdd675ef549b0150195609a80ae0d1ed24fb"
Jul 09 15:29:51.458821 ip-10-0-137-94 kubenswrapper[2575]: E0709 15:29:51.458803    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89ee950abfbed72cfe62734a1acafdd675ef549b0150195609a80ae0d1ed24fb\": container with ID starting with 89ee950abfbed72cfe62734a1acafdd675ef549b0150195609a80ae0d1ed24fb not found: ID does not exist" containerID="89ee950abfbed72cfe62734a1acafdd675ef549b0150195609a80ae0d1ed24fb"
Jul 09 15:29:51.458875 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:51.458825    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89ee950abfbed72cfe62734a1acafdd675ef549b0150195609a80ae0d1ed24fb"} err="failed to get container status \"89ee950abfbed72cfe62734a1acafdd675ef549b0150195609a80ae0d1ed24fb\": rpc error: code = NotFound desc = could not find container \"89ee950abfbed72cfe62734a1acafdd675ef549b0150195609a80ae0d1ed24fb\": container with ID starting with 89ee950abfbed72cfe62734a1acafdd675ef549b0150195609a80ae0d1ed24fb not found: ID does not exist"
Jul 09 15:29:51.462503 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:51.462477    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-2c3892-openshift-default-7df976f949-ftgrs"]
Jul 09 15:29:51.465155 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:51.465135    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-2c3892-openshift-default-7df976f949-ftgrs"]
Jul 09 15:29:51.817320 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:51.817286    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:29:51.911963 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:51.911930    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:29:52.013540 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:52.013508    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:29:52.117987 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:52.117906    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:29:52.494483 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:52.494456    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:29:52.596017 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:52.595968    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:29:53.318142 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:53.318068    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60c9ba98-a353-4126-8011-6c6991dfc59d" path="/var/lib/kubelet/pods/60c9ba98-a353-4126-8011-6c6991dfc59d/volumes"
Jul 09 15:29:56.405357 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:56.405320    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:29:56.891627 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:56.891593    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:29:57.224223 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:57.224128    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q"]
Jul 09 15:29:57.224664 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:57.224646    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e" containerName="istio-proxy"
Jul 09 15:29:57.224664 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:57.224665    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e" containerName="istio-proxy"
Jul 09 15:29:57.224850 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:57.224679    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60c9ba98-a353-4126-8011-6c6991dfc59d" containerName="istio-proxy"
Jul 09 15:29:57.224850 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:57.224688    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="60c9ba98-a353-4126-8011-6c6991dfc59d" containerName="istio-proxy"
Jul 09 15:29:57.224850 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:57.224728    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e" containerName="istio-proxy"
Jul 09 15:29:57.224850 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:57.224739    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e" containerName="istio-proxy"
Jul 09 15:29:57.224850 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:57.224770    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="258cc63e-da48-4b9c-92d8-c78c5c6d51d5" containerName="maas-api"
Jul 09 15:29:57.224850 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:57.224778    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="258cc63e-da48-4b9c-92d8-c78c5c6d51d5" containerName="maas-api"
Jul 09 15:29:57.225161 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:57.224862    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="60c9ba98-a353-4126-8011-6c6991dfc59d" containerName="istio-proxy"
Jul 09 15:29:57.225161 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:57.224874    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e" containerName="istio-proxy"
Jul 09 15:29:57.225161 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:57.224885    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="8cdfac9a-fae5-49fa-8ffb-7039e6d4e93e" containerName="istio-proxy"
Jul 09 15:29:57.225161 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:57.224893    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="60c9ba98-a353-4126-8011-6c6991dfc59d" containerName="istio-proxy"
Jul 09 15:29:57.225161 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:57.224905    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="258cc63e-da48-4b9c-92d8-c78c5c6d51d5" containerName="maas-api"
Jul 09 15:29:57.229945 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:57.229921    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q"
Jul 09 15:29:57.232628 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:57.232606    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-cf8dad-openshift-default-dockercfg-59wq4\""
Jul 09 15:29:57.239324 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:57.239301    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q"]
Jul 09 15:29:57.269581 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:57.269557    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:29:57.397675 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:57.397621    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/877e586b-4a6c-4bf2-947c-4f9269a73de8-workload-socket\") pod \"e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q\" (UID: \"877e586b-4a6c-4bf2-947c-4f9269a73de8\") " pod="openshift-ingress/e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q"
Jul 09 15:29:57.397912 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:57.397687    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/877e586b-4a6c-4bf2-947c-4f9269a73de8-credential-socket\") pod \"e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q\" (UID: \"877e586b-4a6c-4bf2-947c-4f9269a73de8\") " pod="openshift-ingress/e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q"
Jul 09 15:29:57.397912 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:57.397743    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/877e586b-4a6c-4bf2-947c-4f9269a73de8-istiod-ca-cert\") pod \"e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q\" (UID: \"877e586b-4a6c-4bf2-947c-4f9269a73de8\") " pod="openshift-ingress/e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q"
Jul 09 15:29:57.397912 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:57.397778    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/877e586b-4a6c-4bf2-947c-4f9269a73de8-istio-podinfo\") pod \"e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q\" (UID: \"877e586b-4a6c-4bf2-947c-4f9269a73de8\") " pod="openshift-ingress/e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q"
Jul 09 15:29:57.397912 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:57.397814    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/877e586b-4a6c-4bf2-947c-4f9269a73de8-workload-certs\") pod \"e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q\" (UID: \"877e586b-4a6c-4bf2-947c-4f9269a73de8\") " pod="openshift-ingress/e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q"
Jul 09 15:29:57.397912 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:57.397836    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/877e586b-4a6c-4bf2-947c-4f9269a73de8-istio-token\") pod \"e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q\" (UID: \"877e586b-4a6c-4bf2-947c-4f9269a73de8\") " pod="openshift-ingress/e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q"
Jul 09 15:29:57.397912 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:57.397870    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/877e586b-4a6c-4bf2-947c-4f9269a73de8-istio-envoy\") pod \"e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q\" (UID: \"877e586b-4a6c-4bf2-947c-4f9269a73de8\") " pod="openshift-ingress/e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q"
Jul 09 15:29:57.398254 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:57.397993    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/877e586b-4a6c-4bf2-947c-4f9269a73de8-istio-data\") pod \"e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q\" (UID: \"877e586b-4a6c-4bf2-947c-4f9269a73de8\") " pod="openshift-ingress/e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q"
Jul 09 15:29:57.398254 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:57.398076    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9sppf\" (UniqueName: \"kubernetes.io/projected/877e586b-4a6c-4bf2-947c-4f9269a73de8-kube-api-access-9sppf\") pod \"e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q\" (UID: \"877e586b-4a6c-4bf2-947c-4f9269a73de8\") " pod="openshift-ingress/e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q"
Jul 09 15:29:57.499121 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:57.499036    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/877e586b-4a6c-4bf2-947c-4f9269a73de8-istio-data\") pod \"e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q\" (UID: \"877e586b-4a6c-4bf2-947c-4f9269a73de8\") " pod="openshift-ingress/e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q"
Jul 09 15:29:57.499121 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:57.499109    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9sppf\" (UniqueName: \"kubernetes.io/projected/877e586b-4a6c-4bf2-947c-4f9269a73de8-kube-api-access-9sppf\") pod \"e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q\" (UID: \"877e586b-4a6c-4bf2-947c-4f9269a73de8\") " pod="openshift-ingress/e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q"
Jul 09 15:29:57.499635 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:57.499147    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/877e586b-4a6c-4bf2-947c-4f9269a73de8-workload-socket\") pod \"e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q\" (UID: \"877e586b-4a6c-4bf2-947c-4f9269a73de8\") " pod="openshift-ingress/e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q"
Jul 09 15:29:57.499635 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:57.499170    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/877e586b-4a6c-4bf2-947c-4f9269a73de8-credential-socket\") pod \"e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q\" (UID: \"877e586b-4a6c-4bf2-947c-4f9269a73de8\") " pod="openshift-ingress/e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q"
Jul 09 15:29:57.499635 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:57.499301    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/877e586b-4a6c-4bf2-947c-4f9269a73de8-istiod-ca-cert\") pod \"e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q\" (UID: \"877e586b-4a6c-4bf2-947c-4f9269a73de8\") " pod="openshift-ingress/e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q"
Jul 09 15:29:57.499635 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:57.499356    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/877e586b-4a6c-4bf2-947c-4f9269a73de8-istio-podinfo\") pod \"e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q\" (UID: \"877e586b-4a6c-4bf2-947c-4f9269a73de8\") " pod="openshift-ingress/e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q"
Jul 09 15:29:57.499635 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:57.499391    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/877e586b-4a6c-4bf2-947c-4f9269a73de8-workload-certs\") pod \"e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q\" (UID: \"877e586b-4a6c-4bf2-947c-4f9269a73de8\") " pod="openshift-ingress/e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q"
Jul 09 15:29:57.499635 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:57.499417    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/877e586b-4a6c-4bf2-947c-4f9269a73de8-istio-token\") pod \"e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q\" (UID: \"877e586b-4a6c-4bf2-947c-4f9269a73de8\") " pod="openshift-ingress/e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q"
Jul 09 15:29:57.499635 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:57.499456    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/877e586b-4a6c-4bf2-947c-4f9269a73de8-istio-envoy\") pod \"e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q\" (UID: \"877e586b-4a6c-4bf2-947c-4f9269a73de8\") " pod="openshift-ingress/e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q"
Jul 09 15:29:57.499635 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:57.499504    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/877e586b-4a6c-4bf2-947c-4f9269a73de8-istio-data\") pod \"e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q\" (UID: \"877e586b-4a6c-4bf2-947c-4f9269a73de8\") " pod="openshift-ingress/e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q"
Jul 09 15:29:57.499635 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:57.499545    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/877e586b-4a6c-4bf2-947c-4f9269a73de8-workload-socket\") pod \"e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q\" (UID: \"877e586b-4a6c-4bf2-947c-4f9269a73de8\") " pod="openshift-ingress/e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q"
Jul 09 15:29:57.500042 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:57.499776    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/877e586b-4a6c-4bf2-947c-4f9269a73de8-workload-certs\") pod \"e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q\" (UID: \"877e586b-4a6c-4bf2-947c-4f9269a73de8\") " pod="openshift-ingress/e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q"
Jul 09 15:29:57.500042 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:57.499804    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/877e586b-4a6c-4bf2-947c-4f9269a73de8-credential-socket\") pod \"e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q\" (UID: \"877e586b-4a6c-4bf2-947c-4f9269a73de8\") " pod="openshift-ingress/e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q"
Jul 09 15:29:57.500116 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:57.500074    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/877e586b-4a6c-4bf2-947c-4f9269a73de8-istiod-ca-cert\") pod \"e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q\" (UID: \"877e586b-4a6c-4bf2-947c-4f9269a73de8\") " pod="openshift-ingress/e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q"
Jul 09 15:29:57.501659 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:57.501638    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/877e586b-4a6c-4bf2-947c-4f9269a73de8-istio-envoy\") pod \"e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q\" (UID: \"877e586b-4a6c-4bf2-947c-4f9269a73de8\") " pod="openshift-ingress/e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q"
Jul 09 15:29:57.501831 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:57.501811    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/877e586b-4a6c-4bf2-947c-4f9269a73de8-istio-podinfo\") pod \"e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q\" (UID: \"877e586b-4a6c-4bf2-947c-4f9269a73de8\") " pod="openshift-ingress/e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q"
Jul 09 15:29:57.508893 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:57.508869    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/877e586b-4a6c-4bf2-947c-4f9269a73de8-istio-token\") pod \"e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q\" (UID: \"877e586b-4a6c-4bf2-947c-4f9269a73de8\") " pod="openshift-ingress/e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q"
Jul 09 15:29:57.509130 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:57.509101    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9sppf\" (UniqueName: \"kubernetes.io/projected/877e586b-4a6c-4bf2-947c-4f9269a73de8-kube-api-access-9sppf\") pod \"e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q\" (UID: \"877e586b-4a6c-4bf2-947c-4f9269a73de8\") " pod="openshift-ingress/e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q"
Jul 09 15:29:57.540659 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:57.540629    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q"
Jul 09 15:29:57.668266 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:57.668234    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:29:57.681457 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:57.681396    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q"]
Jul 09 15:29:57.683978 ip-10-0-137-94 kubenswrapper[2575]: W0709 15:29:57.683955    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod877e586b_4a6c_4bf2_947c_4f9269a73de8.slice/crio-2991aebec118dcf69fca9e86282e7df44079402f1feb9634a8a1dd4c5f5e2803 WatchSource:0}: Error finding container 2991aebec118dcf69fca9e86282e7df44079402f1feb9634a8a1dd4c5f5e2803: Status 404 returned error can't find the container with id 2991aebec118dcf69fca9e86282e7df44079402f1feb9634a8a1dd4c5f5e2803
Jul 09 15:29:57.686535 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:57.686506    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 15:29:57.686600 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:57.686572    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 15:29:57.686640 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:57.686601    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 15:29:58.479514 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:58.479479    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q" event={"ID":"877e586b-4a6c-4bf2-947c-4f9269a73de8","Type":"ContainerStarted","Data":"7d04cbe245c4f832fcbc37986794dc1bb666645d78d2da284880243e89506995"}
Jul 09 15:29:58.479669 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:58.479533    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q" event={"ID":"877e586b-4a6c-4bf2-947c-4f9269a73de8","Type":"ContainerStarted","Data":"2991aebec118dcf69fca9e86282e7df44079402f1feb9634a8a1dd4c5f5e2803"}
Jul 09 15:29:58.504018 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:58.503962    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q" podStartSLOduration=1.5039493830000001 podStartE2EDuration="1.503949383s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:29:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:29:58.502224476 +0000 UTC m=+2106.344757435" watchObservedRunningTime="2026-07-09 15:29:58.503949383 +0000 UTC m=+2106.346482316"
Jul 09 15:29:58.541808 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:58.541778    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q"
Jul 09 15:29:58.546814 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:58.546792    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q"
Jul 09 15:29:59.485058 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:59.485013    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q"
Jul 09 15:29:59.485851 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:29:59.485829    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q"
Jul 09 15:30:00.586824 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:00.586787    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:30:00.686764 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:00.686702    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:30:00.824942 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:00.824896    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:30:01.239836 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:01.239800    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:30:01.377438 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:01.377403    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:30:01.477347 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:01.477313    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:30:05.067848 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:05.067813    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:30:13.472915 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:13.472832    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:30:15.237414 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:15.237383    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:30:15.526955 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:15.526873    2575 patch_prober.go:28] interesting pod/e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 09 15:30:15.526955 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:15.526944    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q" podUID="877e586b-4a6c-4bf2-947c-4f9269a73de8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 09 15:30:16.574410 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:16.574376    2575 generic.go:356] "Generic (PLEG): container finished" podID="877e586b-4a6c-4bf2-947c-4f9269a73de8" containerID="7d04cbe245c4f832fcbc37986794dc1bb666645d78d2da284880243e89506995" exitCode=0
Jul 09 15:30:16.574856 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:16.574440    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q" event={"ID":"877e586b-4a6c-4bf2-947c-4f9269a73de8","Type":"ContainerDied","Data":"7d04cbe245c4f832fcbc37986794dc1bb666645d78d2da284880243e89506995"}
Jul 09 15:30:16.574908 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:16.574875    2575 scope.go:117] "RemoveContainer" containerID="7d04cbe245c4f832fcbc37986794dc1bb666645d78d2da284880243e89506995"
Jul 09 15:30:16.575872 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:16.575845    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 15:30:16.575929 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:16.575911    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 15:30:16.575969 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:16.575945    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 15:30:17.581891 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:17.581855    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q" event={"ID":"877e586b-4a6c-4bf2-947c-4f9269a73de8","Type":"ContainerStarted","Data":"43dc34b81bd206097f91882ca0c545aecea03d4dacea0bb67b0bdb53e3c74657"}
Jul 09 15:30:18.541300 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:18.541266    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q"
Jul 09 15:30:18.541482 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:18.541450    2575 patch_prober.go:28] interesting pod/e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Jul 09 15:30:18.541527 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:18.541494    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q" podUID="877e586b-4a6c-4bf2-947c-4f9269a73de8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Jul 09 15:30:19.541851 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:19.541804    2575 patch_prober.go:28] interesting pod/e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Jul 09 15:30:19.542271 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:19.541868    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q" podUID="877e586b-4a6c-4bf2-947c-4f9269a73de8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Jul 09 15:30:20.541243 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:20.541198    2575 patch_prober.go:28] interesting pod/e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Jul 09 15:30:20.541461 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:20.541272    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q" podUID="877e586b-4a6c-4bf2-947c-4f9269a73de8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Jul 09 15:30:20.888290 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:20.888236    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:30:20.990484 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:20.990447    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:30:21.277882 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:21.277799    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:30:21.541787 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:21.541689    2575 patch_prober.go:28] interesting pod/e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Jul 09 15:30:21.541787 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:21.541757    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q" podUID="877e586b-4a6c-4bf2-947c-4f9269a73de8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Jul 09 15:30:21.678131 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:21.678088    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:30:21.837563 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:21.837474    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:30:22.094822 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:22.094742    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:30:22.237116 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:22.237086    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:30:22.344395 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:22.344358    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:30:22.516526 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:22.516490    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:30:22.545368 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:22.545341    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q"
Jul 09 15:30:22.545629 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:22.545611    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q"
Jul 09 15:30:22.546299 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:22.546280    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q"
Jul 09 15:30:28.723324 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:28.723288    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:30:28.849781 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:28.849738    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:30:28.981037 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:28.980947    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q"]
Jul 09 15:30:28.981206 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:28.981179    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q" podUID="877e586b-4a6c-4bf2-947c-4f9269a73de8" containerName="istio-proxy" containerID="cri-o://43dc34b81bd206097f91882ca0c545aecea03d4dacea0bb67b0bdb53e3c74657" gracePeriod=30
Jul 09 15:30:29.030539 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:29.030488    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:30:29.291864 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:29.291774    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:30:31.997227 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:31.997193    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:30:32.128887 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:32.128855    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:30:33.111618 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:33.111582    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:30:33.241903 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:33.241871    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:30:33.505065 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:33.505028    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:30:33.831037 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:33.830918    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:30:33.971415 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:33.971373    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:30:34.235827 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:34.235796    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q"
Jul 09 15:30:34.377799 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:34.377691    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/877e586b-4a6c-4bf2-947c-4f9269a73de8-istiod-ca-cert\") pod \"877e586b-4a6c-4bf2-947c-4f9269a73de8\" (UID: \"877e586b-4a6c-4bf2-947c-4f9269a73de8\") "
Jul 09 15:30:34.377799 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:34.377744    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9sppf\" (UniqueName: \"kubernetes.io/projected/877e586b-4a6c-4bf2-947c-4f9269a73de8-kube-api-access-9sppf\") pod \"877e586b-4a6c-4bf2-947c-4f9269a73de8\" (UID: \"877e586b-4a6c-4bf2-947c-4f9269a73de8\") "
Jul 09 15:30:34.378029 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:34.377801    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/877e586b-4a6c-4bf2-947c-4f9269a73de8-workload-socket\") pod \"877e586b-4a6c-4bf2-947c-4f9269a73de8\" (UID: \"877e586b-4a6c-4bf2-947c-4f9269a73de8\") "
Jul 09 15:30:34.378029 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:34.377828    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/877e586b-4a6c-4bf2-947c-4f9269a73de8-istio-envoy\") pod \"877e586b-4a6c-4bf2-947c-4f9269a73de8\" (UID: \"877e586b-4a6c-4bf2-947c-4f9269a73de8\") "
Jul 09 15:30:34.378029 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:34.377873    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/877e586b-4a6c-4bf2-947c-4f9269a73de8-workload-certs\") pod \"877e586b-4a6c-4bf2-947c-4f9269a73de8\" (UID: \"877e586b-4a6c-4bf2-947c-4f9269a73de8\") "
Jul 09 15:30:34.378029 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:34.377900    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/877e586b-4a6c-4bf2-947c-4f9269a73de8-istio-token\") pod \"877e586b-4a6c-4bf2-947c-4f9269a73de8\" (UID: \"877e586b-4a6c-4bf2-947c-4f9269a73de8\") "
Jul 09 15:30:34.378029 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:34.377982    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/877e586b-4a6c-4bf2-947c-4f9269a73de8-credential-socket\") pod \"877e586b-4a6c-4bf2-947c-4f9269a73de8\" (UID: \"877e586b-4a6c-4bf2-947c-4f9269a73de8\") "
Jul 09 15:30:34.378029 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:34.378011    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/877e586b-4a6c-4bf2-947c-4f9269a73de8-istio-podinfo\") pod \"877e586b-4a6c-4bf2-947c-4f9269a73de8\" (UID: \"877e586b-4a6c-4bf2-947c-4f9269a73de8\") "
Jul 09 15:30:34.378325 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:34.378057    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/877e586b-4a6c-4bf2-947c-4f9269a73de8-istio-data\") pod \"877e586b-4a6c-4bf2-947c-4f9269a73de8\" (UID: \"877e586b-4a6c-4bf2-947c-4f9269a73de8\") "
Jul 09 15:30:34.378325 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:34.378075    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/877e586b-4a6c-4bf2-947c-4f9269a73de8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "877e586b-4a6c-4bf2-947c-4f9269a73de8" (UID: "877e586b-4a6c-4bf2-947c-4f9269a73de8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 15:30:34.378325 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:34.378088    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/877e586b-4a6c-4bf2-947c-4f9269a73de8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "877e586b-4a6c-4bf2-947c-4f9269a73de8" (UID: "877e586b-4a6c-4bf2-947c-4f9269a73de8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:30:34.378325 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:34.378185    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/877e586b-4a6c-4bf2-947c-4f9269a73de8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "877e586b-4a6c-4bf2-947c-4f9269a73de8" (UID: "877e586b-4a6c-4bf2-947c-4f9269a73de8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:30:34.378596 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:34.378346    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/877e586b-4a6c-4bf2-947c-4f9269a73de8-istiod-ca-cert\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:30:34.378596 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:34.378364    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/877e586b-4a6c-4bf2-947c-4f9269a73de8-workload-socket\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:30:34.378596 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:34.378368    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/877e586b-4a6c-4bf2-947c-4f9269a73de8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "877e586b-4a6c-4bf2-947c-4f9269a73de8" (UID: "877e586b-4a6c-4bf2-947c-4f9269a73de8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:30:34.378596 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:34.378379    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/877e586b-4a6c-4bf2-947c-4f9269a73de8-workload-certs\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:30:34.379024 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:34.379002    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/877e586b-4a6c-4bf2-947c-4f9269a73de8-istio-data" (OuterVolumeSpecName: "istio-data") pod "877e586b-4a6c-4bf2-947c-4f9269a73de8" (UID: "877e586b-4a6c-4bf2-947c-4f9269a73de8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:30:34.380223 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:34.380194    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/877e586b-4a6c-4bf2-947c-4f9269a73de8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "877e586b-4a6c-4bf2-947c-4f9269a73de8" (UID: "877e586b-4a6c-4bf2-947c-4f9269a73de8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:30:34.380323 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:34.380221    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/877e586b-4a6c-4bf2-947c-4f9269a73de8-istio-token" (OuterVolumeSpecName: "istio-token") pod "877e586b-4a6c-4bf2-947c-4f9269a73de8" (UID: "877e586b-4a6c-4bf2-947c-4f9269a73de8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:30:34.380420 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:34.380398    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/877e586b-4a6c-4bf2-947c-4f9269a73de8-kube-api-access-9sppf" (OuterVolumeSpecName: "kube-api-access-9sppf") pod "877e586b-4a6c-4bf2-947c-4f9269a73de8" (UID: "877e586b-4a6c-4bf2-947c-4f9269a73de8"). InnerVolumeSpecName "kube-api-access-9sppf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:30:34.380474 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:34.380431    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/877e586b-4a6c-4bf2-947c-4f9269a73de8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "877e586b-4a6c-4bf2-947c-4f9269a73de8" (UID: "877e586b-4a6c-4bf2-947c-4f9269a73de8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 15:30:34.479258 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:34.479223    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9sppf\" (UniqueName: \"kubernetes.io/projected/877e586b-4a6c-4bf2-947c-4f9269a73de8-kube-api-access-9sppf\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:30:34.479258 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:34.479251    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/877e586b-4a6c-4bf2-947c-4f9269a73de8-istio-envoy\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:30:34.479258 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:34.479261    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/877e586b-4a6c-4bf2-947c-4f9269a73de8-istio-token\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:30:34.479497 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:34.479269    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/877e586b-4a6c-4bf2-947c-4f9269a73de8-credential-socket\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:30:34.479497 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:34.479278    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/877e586b-4a6c-4bf2-947c-4f9269a73de8-istio-podinfo\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:30:34.479497 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:34.479288    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/877e586b-4a6c-4bf2-947c-4f9269a73de8-istio-data\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:30:34.676290 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:34.676259    2575 generic.go:356] "Generic (PLEG): container finished" podID="877e586b-4a6c-4bf2-947c-4f9269a73de8" containerID="43dc34b81bd206097f91882ca0c545aecea03d4dacea0bb67b0bdb53e3c74657" exitCode=0
Jul 09 15:30:34.676466 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:34.676307    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q"
Jul 09 15:30:34.676466 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:34.676347    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q" event={"ID":"877e586b-4a6c-4bf2-947c-4f9269a73de8","Type":"ContainerDied","Data":"43dc34b81bd206097f91882ca0c545aecea03d4dacea0bb67b0bdb53e3c74657"}
Jul 09 15:30:34.676466 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:34.676406    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q" event={"ID":"877e586b-4a6c-4bf2-947c-4f9269a73de8","Type":"ContainerDied","Data":"2991aebec118dcf69fca9e86282e7df44079402f1feb9634a8a1dd4c5f5e2803"}
Jul 09 15:30:34.676466 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:34.676440    2575 scope.go:117] "RemoveContainer" containerID="43dc34b81bd206097f91882ca0c545aecea03d4dacea0bb67b0bdb53e3c74657"
Jul 09 15:30:34.687362 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:34.687343    2575 scope.go:117] "RemoveContainer" containerID="7d04cbe245c4f832fcbc37986794dc1bb666645d78d2da284880243e89506995"
Jul 09 15:30:34.697590 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:34.697572    2575 scope.go:117] "RemoveContainer" containerID="43dc34b81bd206097f91882ca0c545aecea03d4dacea0bb67b0bdb53e3c74657"
Jul 09 15:30:34.697869 ip-10-0-137-94 kubenswrapper[2575]: E0709 15:30:34.697848    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43dc34b81bd206097f91882ca0c545aecea03d4dacea0bb67b0bdb53e3c74657\": container with ID starting with 43dc34b81bd206097f91882ca0c545aecea03d4dacea0bb67b0bdb53e3c74657 not found: ID does not exist" containerID="43dc34b81bd206097f91882ca0c545aecea03d4dacea0bb67b0bdb53e3c74657"
Jul 09 15:30:34.697919 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:34.697877    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43dc34b81bd206097f91882ca0c545aecea03d4dacea0bb67b0bdb53e3c74657"} err="failed to get container status \"43dc34b81bd206097f91882ca0c545aecea03d4dacea0bb67b0bdb53e3c74657\": rpc error: code = NotFound desc = could not find container \"43dc34b81bd206097f91882ca0c545aecea03d4dacea0bb67b0bdb53e3c74657\": container with ID starting with 43dc34b81bd206097f91882ca0c545aecea03d4dacea0bb67b0bdb53e3c74657 not found: ID does not exist"
Jul 09 15:30:34.697919 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:34.697896    2575 scope.go:117] "RemoveContainer" containerID="7d04cbe245c4f832fcbc37986794dc1bb666645d78d2da284880243e89506995"
Jul 09 15:30:34.698115 ip-10-0-137-94 kubenswrapper[2575]: E0709 15:30:34.698098    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d04cbe245c4f832fcbc37986794dc1bb666645d78d2da284880243e89506995\": container with ID starting with 7d04cbe245c4f832fcbc37986794dc1bb666645d78d2da284880243e89506995 not found: ID does not exist" containerID="7d04cbe245c4f832fcbc37986794dc1bb666645d78d2da284880243e89506995"
Jul 09 15:30:34.698160 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:34.698120    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d04cbe245c4f832fcbc37986794dc1bb666645d78d2da284880243e89506995"} err="failed to get container status \"7d04cbe245c4f832fcbc37986794dc1bb666645d78d2da284880243e89506995\": rpc error: code = NotFound desc = could not find container \"7d04cbe245c4f832fcbc37986794dc1bb666645d78d2da284880243e89506995\": container with ID starting with 7d04cbe245c4f832fcbc37986794dc1bb666645d78d2da284880243e89506995 not found: ID does not exist"
Jul 09 15:30:34.707178 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:34.707149    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q"]
Jul 09 15:30:34.710358 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:34.710334    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-cf8dad-openshift-default-5cbf54d657-phc9q"]
Jul 09 15:30:35.317284 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:35.317247    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="877e586b-4a6c-4bf2-947c-4f9269a73de8" path="/var/lib/kubelet/pods/877e586b-4a6c-4bf2-947c-4f9269a73de8/volumes"
Jul 09 15:30:36.570334 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:36.570301    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:30:36.703006 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:36.702975    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:30:38.279348 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:38.279313    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-497419-openshift-default-5767bc5ccf-7thxc"]
Jul 09 15:30:38.279743 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:38.279663    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="877e586b-4a6c-4bf2-947c-4f9269a73de8" containerName="istio-proxy"
Jul 09 15:30:38.279743 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:38.279676    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="877e586b-4a6c-4bf2-947c-4f9269a73de8" containerName="istio-proxy"
Jul 09 15:30:38.279743 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:38.279688    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60c9ba98-a353-4126-8011-6c6991dfc59d" containerName="istio-proxy"
Jul 09 15:30:38.279743 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:38.279694    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="60c9ba98-a353-4126-8011-6c6991dfc59d" containerName="istio-proxy"
Jul 09 15:30:38.279879 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:38.279799    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="877e586b-4a6c-4bf2-947c-4f9269a73de8" containerName="istio-proxy"
Jul 09 15:30:38.279879 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:38.279810    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="877e586b-4a6c-4bf2-947c-4f9269a73de8" containerName="istio-proxy"
Jul 09 15:30:38.284253 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:38.284231    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-497419-openshift-default-5767bc5ccf-7thxc"
Jul 09 15:30:38.286793 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:38.286773    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-497419-openshift-default-dockercfg-9q9b4\""
Jul 09 15:30:38.302555 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:38.302531    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-497419-openshift-default-5767bc5ccf-7thxc"]
Jul 09 15:30:38.418850 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:38.418816    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d5be055-9521-41a0-a474-572ef799ac7a-istio-data\") pod \"e2e-shared-b-497419-openshift-default-5767bc5ccf-7thxc\" (UID: \"7d5be055-9521-41a0-a474-572ef799ac7a\") " pod="openshift-ingress/e2e-shared-b-497419-openshift-default-5767bc5ccf-7thxc"
Jul 09 15:30:38.419066 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:38.418882    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d5be055-9521-41a0-a474-572ef799ac7a-istio-envoy\") pod \"e2e-shared-b-497419-openshift-default-5767bc5ccf-7thxc\" (UID: \"7d5be055-9521-41a0-a474-572ef799ac7a\") " pod="openshift-ingress/e2e-shared-b-497419-openshift-default-5767bc5ccf-7thxc"
Jul 09 15:30:38.419066 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:38.418943    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d5be055-9521-41a0-a474-572ef799ac7a-istiod-ca-cert\") pod \"e2e-shared-b-497419-openshift-default-5767bc5ccf-7thxc\" (UID: \"7d5be055-9521-41a0-a474-572ef799ac7a\") " pod="openshift-ingress/e2e-shared-b-497419-openshift-default-5767bc5ccf-7thxc"
Jul 09 15:30:38.419066 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:38.418985    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d5be055-9521-41a0-a474-572ef799ac7a-workload-socket\") pod \"e2e-shared-b-497419-openshift-default-5767bc5ccf-7thxc\" (UID: \"7d5be055-9521-41a0-a474-572ef799ac7a\") " pod="openshift-ingress/e2e-shared-b-497419-openshift-default-5767bc5ccf-7thxc"
Jul 09 15:30:38.419066 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:38.419008    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d5be055-9521-41a0-a474-572ef799ac7a-credential-socket\") pod \"e2e-shared-b-497419-openshift-default-5767bc5ccf-7thxc\" (UID: \"7d5be055-9521-41a0-a474-572ef799ac7a\") " pod="openshift-ingress/e2e-shared-b-497419-openshift-default-5767bc5ccf-7thxc"
Jul 09 15:30:38.419066 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:38.419033    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d5be055-9521-41a0-a474-572ef799ac7a-istio-podinfo\") pod \"e2e-shared-b-497419-openshift-default-5767bc5ccf-7thxc\" (UID: \"7d5be055-9521-41a0-a474-572ef799ac7a\") " pod="openshift-ingress/e2e-shared-b-497419-openshift-default-5767bc5ccf-7thxc"
Jul 09 15:30:38.419066 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:38.419055    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wr2xx\" (UniqueName: \"kubernetes.io/projected/7d5be055-9521-41a0-a474-572ef799ac7a-kube-api-access-wr2xx\") pod \"e2e-shared-b-497419-openshift-default-5767bc5ccf-7thxc\" (UID: \"7d5be055-9521-41a0-a474-572ef799ac7a\") " pod="openshift-ingress/e2e-shared-b-497419-openshift-default-5767bc5ccf-7thxc"
Jul 09 15:30:38.419367 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:38.419089    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d5be055-9521-41a0-a474-572ef799ac7a-istio-token\") pod \"e2e-shared-b-497419-openshift-default-5767bc5ccf-7thxc\" (UID: \"7d5be055-9521-41a0-a474-572ef799ac7a\") " pod="openshift-ingress/e2e-shared-b-497419-openshift-default-5767bc5ccf-7thxc"
Jul 09 15:30:38.419367 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:38.419244    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d5be055-9521-41a0-a474-572ef799ac7a-workload-certs\") pod \"e2e-shared-b-497419-openshift-default-5767bc5ccf-7thxc\" (UID: \"7d5be055-9521-41a0-a474-572ef799ac7a\") " pod="openshift-ingress/e2e-shared-b-497419-openshift-default-5767bc5ccf-7thxc"
Jul 09 15:30:38.520012 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:38.519976    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d5be055-9521-41a0-a474-572ef799ac7a-workload-certs\") pod \"e2e-shared-b-497419-openshift-default-5767bc5ccf-7thxc\" (UID: \"7d5be055-9521-41a0-a474-572ef799ac7a\") " pod="openshift-ingress/e2e-shared-b-497419-openshift-default-5767bc5ccf-7thxc"
Jul 09 15:30:38.520195 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:38.520019    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d5be055-9521-41a0-a474-572ef799ac7a-istio-data\") pod \"e2e-shared-b-497419-openshift-default-5767bc5ccf-7thxc\" (UID: \"7d5be055-9521-41a0-a474-572ef799ac7a\") " pod="openshift-ingress/e2e-shared-b-497419-openshift-default-5767bc5ccf-7thxc"
Jul 09 15:30:38.520195 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:38.520045    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d5be055-9521-41a0-a474-572ef799ac7a-istio-envoy\") pod \"e2e-shared-b-497419-openshift-default-5767bc5ccf-7thxc\" (UID: \"7d5be055-9521-41a0-a474-572ef799ac7a\") " pod="openshift-ingress/e2e-shared-b-497419-openshift-default-5767bc5ccf-7thxc"
Jul 09 15:30:38.520195 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:38.520066    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d5be055-9521-41a0-a474-572ef799ac7a-istiod-ca-cert\") pod \"e2e-shared-b-497419-openshift-default-5767bc5ccf-7thxc\" (UID: \"7d5be055-9521-41a0-a474-572ef799ac7a\") " pod="openshift-ingress/e2e-shared-b-497419-openshift-default-5767bc5ccf-7thxc"
Jul 09 15:30:38.520195 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:38.520090    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d5be055-9521-41a0-a474-572ef799ac7a-workload-socket\") pod \"e2e-shared-b-497419-openshift-default-5767bc5ccf-7thxc\" (UID: \"7d5be055-9521-41a0-a474-572ef799ac7a\") " pod="openshift-ingress/e2e-shared-b-497419-openshift-default-5767bc5ccf-7thxc"
Jul 09 15:30:38.520195 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:38.520106    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d5be055-9521-41a0-a474-572ef799ac7a-credential-socket\") pod \"e2e-shared-b-497419-openshift-default-5767bc5ccf-7thxc\" (UID: \"7d5be055-9521-41a0-a474-572ef799ac7a\") " pod="openshift-ingress/e2e-shared-b-497419-openshift-default-5767bc5ccf-7thxc"
Jul 09 15:30:38.520195 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:38.520121    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d5be055-9521-41a0-a474-572ef799ac7a-istio-podinfo\") pod \"e2e-shared-b-497419-openshift-default-5767bc5ccf-7thxc\" (UID: \"7d5be055-9521-41a0-a474-572ef799ac7a\") " pod="openshift-ingress/e2e-shared-b-497419-openshift-default-5767bc5ccf-7thxc"
Jul 09 15:30:38.520195 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:38.520145    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wr2xx\" (UniqueName: \"kubernetes.io/projected/7d5be055-9521-41a0-a474-572ef799ac7a-kube-api-access-wr2xx\") pod \"e2e-shared-b-497419-openshift-default-5767bc5ccf-7thxc\" (UID: \"7d5be055-9521-41a0-a474-572ef799ac7a\") " pod="openshift-ingress/e2e-shared-b-497419-openshift-default-5767bc5ccf-7thxc"
Jul 09 15:30:38.520195 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:38.520170    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d5be055-9521-41a0-a474-572ef799ac7a-istio-token\") pod \"e2e-shared-b-497419-openshift-default-5767bc5ccf-7thxc\" (UID: \"7d5be055-9521-41a0-a474-572ef799ac7a\") " pod="openshift-ingress/e2e-shared-b-497419-openshift-default-5767bc5ccf-7thxc"
Jul 09 15:30:38.520633 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:38.520505    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d5be055-9521-41a0-a474-572ef799ac7a-istio-data\") pod \"e2e-shared-b-497419-openshift-default-5767bc5ccf-7thxc\" (UID: \"7d5be055-9521-41a0-a474-572ef799ac7a\") " pod="openshift-ingress/e2e-shared-b-497419-openshift-default-5767bc5ccf-7thxc"
Jul 09 15:30:38.520887 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:38.520841    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d5be055-9521-41a0-a474-572ef799ac7a-workload-certs\") pod \"e2e-shared-b-497419-openshift-default-5767bc5ccf-7thxc\" (UID: \"7d5be055-9521-41a0-a474-572ef799ac7a\") " pod="openshift-ingress/e2e-shared-b-497419-openshift-default-5767bc5ccf-7thxc"
Jul 09 15:30:38.521006 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:38.520919    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d5be055-9521-41a0-a474-572ef799ac7a-workload-socket\") pod \"e2e-shared-b-497419-openshift-default-5767bc5ccf-7thxc\" (UID: \"7d5be055-9521-41a0-a474-572ef799ac7a\") " pod="openshift-ingress/e2e-shared-b-497419-openshift-default-5767bc5ccf-7thxc"
Jul 09 15:30:38.521006 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:38.520954    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d5be055-9521-41a0-a474-572ef799ac7a-credential-socket\") pod \"e2e-shared-b-497419-openshift-default-5767bc5ccf-7thxc\" (UID: \"7d5be055-9521-41a0-a474-572ef799ac7a\") " pod="openshift-ingress/e2e-shared-b-497419-openshift-default-5767bc5ccf-7thxc"
Jul 09 15:30:38.521181 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:38.521164    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d5be055-9521-41a0-a474-572ef799ac7a-istiod-ca-cert\") pod \"e2e-shared-b-497419-openshift-default-5767bc5ccf-7thxc\" (UID: \"7d5be055-9521-41a0-a474-572ef799ac7a\") " pod="openshift-ingress/e2e-shared-b-497419-openshift-default-5767bc5ccf-7thxc"
Jul 09 15:30:38.523045 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:38.523020    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d5be055-9521-41a0-a474-572ef799ac7a-istio-envoy\") pod \"e2e-shared-b-497419-openshift-default-5767bc5ccf-7thxc\" (UID: \"7d5be055-9521-41a0-a474-572ef799ac7a\") " pod="openshift-ingress/e2e-shared-b-497419-openshift-default-5767bc5ccf-7thxc"
Jul 09 15:30:38.523144 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:38.523076    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d5be055-9521-41a0-a474-572ef799ac7a-istio-podinfo\") pod \"e2e-shared-b-497419-openshift-default-5767bc5ccf-7thxc\" (UID: \"7d5be055-9521-41a0-a474-572ef799ac7a\") " pod="openshift-ingress/e2e-shared-b-497419-openshift-default-5767bc5ccf-7thxc"
Jul 09 15:30:38.532587 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:38.532519    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d5be055-9521-41a0-a474-572ef799ac7a-istio-token\") pod \"e2e-shared-b-497419-openshift-default-5767bc5ccf-7thxc\" (UID: \"7d5be055-9521-41a0-a474-572ef799ac7a\") " pod="openshift-ingress/e2e-shared-b-497419-openshift-default-5767bc5ccf-7thxc"
Jul 09 15:30:38.534588 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:38.534560    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wr2xx\" (UniqueName: \"kubernetes.io/projected/7d5be055-9521-41a0-a474-572ef799ac7a-kube-api-access-wr2xx\") pod \"e2e-shared-b-497419-openshift-default-5767bc5ccf-7thxc\" (UID: \"7d5be055-9521-41a0-a474-572ef799ac7a\") " pod="openshift-ingress/e2e-shared-b-497419-openshift-default-5767bc5ccf-7thxc"
Jul 09 15:30:38.594453 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:38.594424    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-497419-openshift-default-5767bc5ccf-7thxc"
Jul 09 15:30:38.737838 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:38.737810    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-497419-openshift-default-5767bc5ccf-7thxc"]
Jul 09 15:30:38.739505 ip-10-0-137-94 kubenswrapper[2575]: W0709 15:30:38.739483    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d5be055_9521_41a0_a474_572ef799ac7a.slice/crio-e386d0fcc9dd86f60faf424ded37f288568c0048c64fd4822257e19b17d58262 WatchSource:0}: Error finding container e386d0fcc9dd86f60faf424ded37f288568c0048c64fd4822257e19b17d58262: Status 404 returned error can't find the container with id e386d0fcc9dd86f60faf424ded37f288568c0048c64fd4822257e19b17d58262
Jul 09 15:30:38.741435 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:38.741403    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 15:30:38.741491 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:38.741468    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 15:30:38.741528 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:38.741495    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 15:30:39.705875 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:39.705839    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-497419-openshift-default-5767bc5ccf-7thxc" event={"ID":"7d5be055-9521-41a0-a474-572ef799ac7a","Type":"ContainerStarted","Data":"e23486e0de7769f1da00367a84ebaa933a748fe69cc21482806c6ce3067b2d4b"}
Jul 09 15:30:39.706253 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:39.705902    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-497419-openshift-default-5767bc5ccf-7thxc" event={"ID":"7d5be055-9521-41a0-a474-572ef799ac7a","Type":"ContainerStarted","Data":"e386d0fcc9dd86f60faf424ded37f288568c0048c64fd4822257e19b17d58262"}
Jul 09 15:30:39.731182 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:39.731136    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-497419-openshift-default-5767bc5ccf-7thxc" podStartSLOduration=1.731121027 podStartE2EDuration="1.731121027s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:30:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:30:39.729363905 +0000 UTC m=+2147.571896860" watchObservedRunningTime="2026-07-09 15:30:39.731121027 +0000 UTC m=+2147.573653958"
Jul 09 15:30:39.829937 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:39.829906    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:30:39.948202 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:39.948167    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:30:40.595375 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:40.595341    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-497419-openshift-default-5767bc5ccf-7thxc"
Jul 09 15:30:40.600233 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:40.600206    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-497419-openshift-default-5767bc5ccf-7thxc"
Jul 09 15:30:40.711256 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:40.711215    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-497419-openshift-default-5767bc5ccf-7thxc"
Jul 09 15:30:40.712223 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:40.712202    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-497419-openshift-default-5767bc5ccf-7thxc"
Jul 09 15:30:41.921233 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:41.921196    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:30:42.044956 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:42.044918    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:30:42.321031 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:42.320944    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:30:42.699922 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:42.699889    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:30:42.800343 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:42.800311    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:30:46.272517 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:46.272429    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:30:54.787097 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:54.787060    2575 generic.go:356] "Generic (PLEG): container finished" podID="7d5be055-9521-41a0-a474-572ef799ac7a" containerID="e23486e0de7769f1da00367a84ebaa933a748fe69cc21482806c6ce3067b2d4b" exitCode=0
Jul 09 15:30:54.787523 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:54.787136    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-497419-openshift-default-5767bc5ccf-7thxc" event={"ID":"7d5be055-9521-41a0-a474-572ef799ac7a","Type":"ContainerDied","Data":"e23486e0de7769f1da00367a84ebaa933a748fe69cc21482806c6ce3067b2d4b"}
Jul 09 15:30:54.787523 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:54.787517    2575 scope.go:117] "RemoveContainer" containerID="e23486e0de7769f1da00367a84ebaa933a748fe69cc21482806c6ce3067b2d4b"
Jul 09 15:30:54.788459 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:54.788436    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 15:30:54.788530 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:54.788518    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 15:30:54.788569 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:54.788552    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 15:30:55.711739 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:55.711626    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-497419-openshift-default-5767bc5ccf-7thxc"
Jul 09 15:30:55.759155 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:55.759122    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:30:55.800270 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:55.800237    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-497419-openshift-default-5767bc5ccf-7thxc" event={"ID":"7d5be055-9521-41a0-a474-572ef799ac7a","Type":"ContainerStarted","Data":"a0958b70dd8762caf96082d23a645dd77ec62ced68940f95a9e96d2dbeaf102b"}
Jul 09 15:30:56.000947 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:56.000863    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:30:56.595569 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:56.595532    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-497419-openshift-default-5767bc5ccf-7thxc"
Jul 09 15:30:56.596677 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:56.596651    2575 patch_prober.go:28] interesting pod/e2e-shared-b-497419-openshift-default-5767bc5ccf-7thxc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Jul 09 15:30:56.596820 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:56.596702    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-497419-openshift-default-5767bc5ccf-7thxc" podUID="7d5be055-9521-41a0-a474-572ef799ac7a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Jul 09 15:30:57.595725 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:57.595668    2575 patch_prober.go:28] interesting pod/e2e-shared-b-497419-openshift-default-5767bc5ccf-7thxc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Jul 09 15:30:57.596177 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:57.595768    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-497419-openshift-default-5767bc5ccf-7thxc" podUID="7d5be055-9521-41a0-a474-572ef799ac7a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Jul 09 15:30:58.595541 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:58.595499    2575 patch_prober.go:28] interesting pod/e2e-shared-b-497419-openshift-default-5767bc5ccf-7thxc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Jul 09 15:30:58.595774 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:58.595555    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-497419-openshift-default-5767bc5ccf-7thxc" podUID="7d5be055-9521-41a0-a474-572ef799ac7a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Jul 09 15:30:59.605516 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:59.605483    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-497419-openshift-default-5767bc5ccf-7thxc"
Jul 09 15:30:59.605935 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:59.605746    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-497419-openshift-default-5767bc5ccf-7thxc"
Jul 09 15:30:59.606524 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:30:59.606509    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-497419-openshift-default-5767bc5ccf-7thxc"
Jul 09 15:31:01.009029 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:31:01.009000    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:31:04.305573 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:31:04.305528    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:31:04.409574 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:31:04.409537    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:31:32.237807 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:31:32.237747    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:31:35.128116 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:31:35.128083    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:32:55.334015 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:32:55.333977    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:33:20.545457 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:33:20.545400    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:33:20.856660 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:33:20.856576    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:33:38.785242 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:33:38.785204    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:33:39.740549 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:33:39.740515    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:33:52.169628 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:33:52.169587    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-bf561e/sub-test-model-bf561e-kserve-776b6f67b9-4bkgb"]
Jul 09 15:33:52.170026 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:33:52.170011    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="877e586b-4a6c-4bf2-947c-4f9269a73de8" containerName="istio-proxy"
Jul 09 15:33:52.170075 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:33:52.170029    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="877e586b-4a6c-4bf2-947c-4f9269a73de8" containerName="istio-proxy"
Jul 09 15:33:52.173267 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:33:52.173245    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bf561e/sub-test-model-bf561e-kserve-776b6f67b9-4bkgb"
Jul 09 15:33:52.176385 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:33:52.176363    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-bf561e\"/\"openshift-service-ca.crt\""
Jul 09 15:33:52.177103 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:33:52.177083    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-bf561e\"/\"default-dockercfg-9xd5k\""
Jul 09 15:33:52.177384 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:33:52.177367    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-bf561e\"/\"sub-test-model-bf561e-kserve-self-signed-certs\""
Jul 09 15:33:52.177472 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:33:52.177407    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-bf561e\"/\"kube-root-ca.crt\""
Jul 09 15:33:52.183146 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:33:52.183123    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-bf561e/sub-test-model-bf561e-kserve-776b6f67b9-4bkgb"]
Jul 09 15:33:52.207131 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:33:52.207097    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:33:52.317246 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:33:52.317158    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/08d54dfc-3157-4087-93d3-c040e5c3ca0d-home\") pod \"sub-test-model-bf561e-kserve-776b6f67b9-4bkgb\" (UID: \"08d54dfc-3157-4087-93d3-c040e5c3ca0d\") " pod="ai-tenant-e2e-shared-a-bf561e/sub-test-model-bf561e-kserve-776b6f67b9-4bkgb"
Jul 09 15:33:52.317444 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:33:52.317288    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08d54dfc-3157-4087-93d3-c040e5c3ca0d-tls-certs\") pod \"sub-test-model-bf561e-kserve-776b6f67b9-4bkgb\" (UID: \"08d54dfc-3157-4087-93d3-c040e5c3ca0d\") " pod="ai-tenant-e2e-shared-a-bf561e/sub-test-model-bf561e-kserve-776b6f67b9-4bkgb"
Jul 09 15:33:52.317444 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:33:52.317325    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08d54dfc-3157-4087-93d3-c040e5c3ca0d-tmp-dir\") pod \"sub-test-model-bf561e-kserve-776b6f67b9-4bkgb\" (UID: \"08d54dfc-3157-4087-93d3-c040e5c3ca0d\") " pod="ai-tenant-e2e-shared-a-bf561e/sub-test-model-bf561e-kserve-776b6f67b9-4bkgb"
Jul 09 15:33:52.317580 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:33:52.317481    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/08d54dfc-3157-4087-93d3-c040e5c3ca0d-dshm\") pod \"sub-test-model-bf561e-kserve-776b6f67b9-4bkgb\" (UID: \"08d54dfc-3157-4087-93d3-c040e5c3ca0d\") " pod="ai-tenant-e2e-shared-a-bf561e/sub-test-model-bf561e-kserve-776b6f67b9-4bkgb"
Jul 09 15:33:52.317580 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:33:52.317527    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bp9h\" (UniqueName: \"kubernetes.io/projected/08d54dfc-3157-4087-93d3-c040e5c3ca0d-kube-api-access-2bp9h\") pod \"sub-test-model-bf561e-kserve-776b6f67b9-4bkgb\" (UID: \"08d54dfc-3157-4087-93d3-c040e5c3ca0d\") " pod="ai-tenant-e2e-shared-a-bf561e/sub-test-model-bf561e-kserve-776b6f67b9-4bkgb"
Jul 09 15:33:52.317580 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:33:52.317567    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/08d54dfc-3157-4087-93d3-c040e5c3ca0d-model-cache\") pod \"sub-test-model-bf561e-kserve-776b6f67b9-4bkgb\" (UID: \"08d54dfc-3157-4087-93d3-c040e5c3ca0d\") " pod="ai-tenant-e2e-shared-a-bf561e/sub-test-model-bf561e-kserve-776b6f67b9-4bkgb"
Jul 09 15:33:52.418190 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:33:52.418151    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08d54dfc-3157-4087-93d3-c040e5c3ca0d-tls-certs\") pod \"sub-test-model-bf561e-kserve-776b6f67b9-4bkgb\" (UID: \"08d54dfc-3157-4087-93d3-c040e5c3ca0d\") " pod="ai-tenant-e2e-shared-a-bf561e/sub-test-model-bf561e-kserve-776b6f67b9-4bkgb"
Jul 09 15:33:52.418190 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:33:52.418193    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08d54dfc-3157-4087-93d3-c040e5c3ca0d-tmp-dir\") pod \"sub-test-model-bf561e-kserve-776b6f67b9-4bkgb\" (UID: \"08d54dfc-3157-4087-93d3-c040e5c3ca0d\") " pod="ai-tenant-e2e-shared-a-bf561e/sub-test-model-bf561e-kserve-776b6f67b9-4bkgb"
Jul 09 15:33:52.418434 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:33:52.418269    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/08d54dfc-3157-4087-93d3-c040e5c3ca0d-dshm\") pod \"sub-test-model-bf561e-kserve-776b6f67b9-4bkgb\" (UID: \"08d54dfc-3157-4087-93d3-c040e5c3ca0d\") " pod="ai-tenant-e2e-shared-a-bf561e/sub-test-model-bf561e-kserve-776b6f67b9-4bkgb"
Jul 09 15:33:52.418434 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:33:52.418323    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bp9h\" (UniqueName: \"kubernetes.io/projected/08d54dfc-3157-4087-93d3-c040e5c3ca0d-kube-api-access-2bp9h\") pod \"sub-test-model-bf561e-kserve-776b6f67b9-4bkgb\" (UID: \"08d54dfc-3157-4087-93d3-c040e5c3ca0d\") " pod="ai-tenant-e2e-shared-a-bf561e/sub-test-model-bf561e-kserve-776b6f67b9-4bkgb"
Jul 09 15:33:52.418434 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:33:52.418347    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/08d54dfc-3157-4087-93d3-c040e5c3ca0d-model-cache\") pod \"sub-test-model-bf561e-kserve-776b6f67b9-4bkgb\" (UID: \"08d54dfc-3157-4087-93d3-c040e5c3ca0d\") " pod="ai-tenant-e2e-shared-a-bf561e/sub-test-model-bf561e-kserve-776b6f67b9-4bkgb"
Jul 09 15:33:52.418434 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:33:52.418385    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/08d54dfc-3157-4087-93d3-c040e5c3ca0d-home\") pod \"sub-test-model-bf561e-kserve-776b6f67b9-4bkgb\" (UID: \"08d54dfc-3157-4087-93d3-c040e5c3ca0d\") " pod="ai-tenant-e2e-shared-a-bf561e/sub-test-model-bf561e-kserve-776b6f67b9-4bkgb"
Jul 09 15:33:52.418653 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:33:52.418616    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08d54dfc-3157-4087-93d3-c040e5c3ca0d-tmp-dir\") pod \"sub-test-model-bf561e-kserve-776b6f67b9-4bkgb\" (UID: \"08d54dfc-3157-4087-93d3-c040e5c3ca0d\") " pod="ai-tenant-e2e-shared-a-bf561e/sub-test-model-bf561e-kserve-776b6f67b9-4bkgb"
Jul 09 15:33:52.418799 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:33:52.418778    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/08d54dfc-3157-4087-93d3-c040e5c3ca0d-home\") pod \"sub-test-model-bf561e-kserve-776b6f67b9-4bkgb\" (UID: \"08d54dfc-3157-4087-93d3-c040e5c3ca0d\") " pod="ai-tenant-e2e-shared-a-bf561e/sub-test-model-bf561e-kserve-776b6f67b9-4bkgb"
Jul 09 15:33:52.418862 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:33:52.418829    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/08d54dfc-3157-4087-93d3-c040e5c3ca0d-model-cache\") pod \"sub-test-model-bf561e-kserve-776b6f67b9-4bkgb\" (UID: \"08d54dfc-3157-4087-93d3-c040e5c3ca0d\") " pod="ai-tenant-e2e-shared-a-bf561e/sub-test-model-bf561e-kserve-776b6f67b9-4bkgb"
Jul 09 15:33:52.420647 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:33:52.420585    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/08d54dfc-3157-4087-93d3-c040e5c3ca0d-dshm\") pod \"sub-test-model-bf561e-kserve-776b6f67b9-4bkgb\" (UID: \"08d54dfc-3157-4087-93d3-c040e5c3ca0d\") " pod="ai-tenant-e2e-shared-a-bf561e/sub-test-model-bf561e-kserve-776b6f67b9-4bkgb"
Jul 09 15:33:52.421095 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:33:52.421072    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08d54dfc-3157-4087-93d3-c040e5c3ca0d-tls-certs\") pod \"sub-test-model-bf561e-kserve-776b6f67b9-4bkgb\" (UID: \"08d54dfc-3157-4087-93d3-c040e5c3ca0d\") " pod="ai-tenant-e2e-shared-a-bf561e/sub-test-model-bf561e-kserve-776b6f67b9-4bkgb"
Jul 09 15:33:52.427282 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:33:52.427256    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bp9h\" (UniqueName: \"kubernetes.io/projected/08d54dfc-3157-4087-93d3-c040e5c3ca0d-kube-api-access-2bp9h\") pod \"sub-test-model-bf561e-kserve-776b6f67b9-4bkgb\" (UID: \"08d54dfc-3157-4087-93d3-c040e5c3ca0d\") " pod="ai-tenant-e2e-shared-a-bf561e/sub-test-model-bf561e-kserve-776b6f67b9-4bkgb"
Jul 09 15:33:52.483464 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:33:52.483438    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bf561e/sub-test-model-bf561e-kserve-776b6f67b9-4bkgb"
Jul 09 15:33:52.618868 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:33:52.618843    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-bf561e/sub-test-model-bf561e-kserve-776b6f67b9-4bkgb"]
Jul 09 15:33:52.621831 ip-10-0-137-94 kubenswrapper[2575]: W0709 15:33:52.621800    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod08d54dfc_3157_4087_93d3_c040e5c3ca0d.slice/crio-683337e41c93583fb463ad702e5e7864f199bbd03f0ab61961230d99e82ec2e8 WatchSource:0}: Error finding container 683337e41c93583fb463ad702e5e7864f199bbd03f0ab61961230d99e82ec2e8: Status 404 returned error can't find the container with id 683337e41c93583fb463ad702e5e7864f199bbd03f0ab61961230d99e82ec2e8
Jul 09 15:33:52.735106 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:33:52.735069    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bf561e/sub-test-model-bf561e-kserve-776b6f67b9-4bkgb" event={"ID":"08d54dfc-3157-4087-93d3-c040e5c3ca0d","Type":"ContainerStarted","Data":"474b9dea93c1c4c65706bdb92b6a29ca9d8b192b4956bc87601a63119fccef1d"}
Jul 09 15:33:52.735266 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:33:52.735114    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bf561e/sub-test-model-bf561e-kserve-776b6f67b9-4bkgb" event={"ID":"08d54dfc-3157-4087-93d3-c040e5c3ca0d","Type":"ContainerStarted","Data":"683337e41c93583fb463ad702e5e7864f199bbd03f0ab61961230d99e82ec2e8"}
Jul 09 15:33:52.761252 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:33:52.761197    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-bf561e/sub-test-model-bf561e-kserve-776b6f67b9-4bkgb" podStartSLOduration=0.761177874 podStartE2EDuration="761.177874ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:33:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:33:52.759171101 +0000 UTC m=+2340.601704038" watchObservedRunningTime="2026-07-09 15:33:52.761177874 +0000 UTC m=+2340.603710806"
Jul 09 15:34:02.483845 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:34:02.483811    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-bf561e/sub-test-model-bf561e-kserve-776b6f67b9-4bkgb"
Jul 09 15:34:02.484253 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:34:02.483863    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-bf561e/sub-test-model-bf561e-kserve-776b6f67b9-4bkgb"
Jul 09 15:34:02.495922 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:34:02.495900    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-bf561e/sub-test-model-bf561e-kserve-776b6f67b9-4bkgb"
Jul 09 15:34:02.800847 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:34:02.800753    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-bf561e/sub-test-model-bf561e-kserve-776b6f67b9-4bkgb"
Jul 09 15:34:44.503202 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:34:44.503149    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:34:52.003176 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:34:52.003140    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:35:13.141916 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:35:13.141873    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-bf561e/sub-test-model-bf561e-kserve-776b6f67b9-4bkgb"]
Jul 09 15:35:13.178445 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:35:13.178411    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:35:14.103780 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:35:14.103736    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:35:21.106166 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:35:21.106062    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:35:28.162652 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:35:28.162591    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-bf561e/sub-test-model-bf561e-kserve-776b6f67b9-4bkgb" podUID="08d54dfc-3157-4087-93d3-c040e5c3ca0d" containerName="main" containerID="cri-o://474b9dea93c1c4c65706bdb92b6a29ca9d8b192b4956bc87601a63119fccef1d" gracePeriod=45
Jul 09 15:35:28.404407 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:35:28.404370    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bf561e/sub-test-model-bf561e-kserve-776b6f67b9-4bkgb"
Jul 09 15:35:28.508231 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:35:28.508120    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2bp9h\" (UniqueName: \"kubernetes.io/projected/08d54dfc-3157-4087-93d3-c040e5c3ca0d-kube-api-access-2bp9h\") pod \"08d54dfc-3157-4087-93d3-c040e5c3ca0d\" (UID: \"08d54dfc-3157-4087-93d3-c040e5c3ca0d\") "
Jul 09 15:35:28.508231 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:35:28.508222    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/08d54dfc-3157-4087-93d3-c040e5c3ca0d-home\") pod \"08d54dfc-3157-4087-93d3-c040e5c3ca0d\" (UID: \"08d54dfc-3157-4087-93d3-c040e5c3ca0d\") "
Jul 09 15:35:28.508473 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:35:28.508249    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08d54dfc-3157-4087-93d3-c040e5c3ca0d-tmp-dir\") pod \"08d54dfc-3157-4087-93d3-c040e5c3ca0d\" (UID: \"08d54dfc-3157-4087-93d3-c040e5c3ca0d\") "
Jul 09 15:35:28.508473 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:35:28.508278    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/08d54dfc-3157-4087-93d3-c040e5c3ca0d-model-cache\") pod \"08d54dfc-3157-4087-93d3-c040e5c3ca0d\" (UID: \"08d54dfc-3157-4087-93d3-c040e5c3ca0d\") "
Jul 09 15:35:28.508473 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:35:28.508339    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08d54dfc-3157-4087-93d3-c040e5c3ca0d-tls-certs\") pod \"08d54dfc-3157-4087-93d3-c040e5c3ca0d\" (UID: \"08d54dfc-3157-4087-93d3-c040e5c3ca0d\") "
Jul 09 15:35:28.508473 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:35:28.508384    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/08d54dfc-3157-4087-93d3-c040e5c3ca0d-dshm\") pod \"08d54dfc-3157-4087-93d3-c040e5c3ca0d\" (UID: \"08d54dfc-3157-4087-93d3-c040e5c3ca0d\") "
Jul 09 15:35:28.508696 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:35:28.508529    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08d54dfc-3157-4087-93d3-c040e5c3ca0d-home" (OuterVolumeSpecName: "home") pod "08d54dfc-3157-4087-93d3-c040e5c3ca0d" (UID: "08d54dfc-3157-4087-93d3-c040e5c3ca0d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:35:28.508696 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:35:28.508537    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08d54dfc-3157-4087-93d3-c040e5c3ca0d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "08d54dfc-3157-4087-93d3-c040e5c3ca0d" (UID: "08d54dfc-3157-4087-93d3-c040e5c3ca0d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:35:28.508696 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:35:28.508628    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08d54dfc-3157-4087-93d3-c040e5c3ca0d-model-cache" (OuterVolumeSpecName: "model-cache") pod "08d54dfc-3157-4087-93d3-c040e5c3ca0d" (UID: "08d54dfc-3157-4087-93d3-c040e5c3ca0d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:35:28.508696 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:35:28.508645    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/08d54dfc-3157-4087-93d3-c040e5c3ca0d-home\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:35:28.510847 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:35:28.510810    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08d54dfc-3157-4087-93d3-c040e5c3ca0d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "08d54dfc-3157-4087-93d3-c040e5c3ca0d" (UID: "08d54dfc-3157-4087-93d3-c040e5c3ca0d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 15:35:28.511090 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:35:28.511064    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08d54dfc-3157-4087-93d3-c040e5c3ca0d-kube-api-access-2bp9h" (OuterVolumeSpecName: "kube-api-access-2bp9h") pod "08d54dfc-3157-4087-93d3-c040e5c3ca0d" (UID: "08d54dfc-3157-4087-93d3-c040e5c3ca0d"). InnerVolumeSpecName "kube-api-access-2bp9h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:35:28.511187 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:35:28.511091    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08d54dfc-3157-4087-93d3-c040e5c3ca0d-dshm" (OuterVolumeSpecName: "dshm") pod "08d54dfc-3157-4087-93d3-c040e5c3ca0d" (UID: "08d54dfc-3157-4087-93d3-c040e5c3ca0d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:35:28.609921 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:35:28.609882    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2bp9h\" (UniqueName: \"kubernetes.io/projected/08d54dfc-3157-4087-93d3-c040e5c3ca0d-kube-api-access-2bp9h\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:35:28.609921 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:35:28.609920    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08d54dfc-3157-4087-93d3-c040e5c3ca0d-tmp-dir\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:35:28.610115 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:35:28.609936    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/08d54dfc-3157-4087-93d3-c040e5c3ca0d-model-cache\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:35:28.610115 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:35:28.609949    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08d54dfc-3157-4087-93d3-c040e5c3ca0d-tls-certs\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:35:28.610115 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:35:28.609961    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/08d54dfc-3157-4087-93d3-c040e5c3ca0d-dshm\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:35:29.237107 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:35:29.237065    2575 generic.go:356] "Generic (PLEG): container finished" podID="08d54dfc-3157-4087-93d3-c040e5c3ca0d" containerID="474b9dea93c1c4c65706bdb92b6a29ca9d8b192b4956bc87601a63119fccef1d" exitCode=0
Jul 09 15:35:29.237107 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:35:29.237103    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bf561e/sub-test-model-bf561e-kserve-776b6f67b9-4bkgb"
Jul 09 15:35:29.237670 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:35:29.237159    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bf561e/sub-test-model-bf561e-kserve-776b6f67b9-4bkgb" event={"ID":"08d54dfc-3157-4087-93d3-c040e5c3ca0d","Type":"ContainerDied","Data":"474b9dea93c1c4c65706bdb92b6a29ca9d8b192b4956bc87601a63119fccef1d"}
Jul 09 15:35:29.237670 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:35:29.237210    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bf561e/sub-test-model-bf561e-kserve-776b6f67b9-4bkgb" event={"ID":"08d54dfc-3157-4087-93d3-c040e5c3ca0d","Type":"ContainerDied","Data":"683337e41c93583fb463ad702e5e7864f199bbd03f0ab61961230d99e82ec2e8"}
Jul 09 15:35:29.237670 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:35:29.237235    2575 scope.go:117] "RemoveContainer" containerID="474b9dea93c1c4c65706bdb92b6a29ca9d8b192b4956bc87601a63119fccef1d"
Jul 09 15:35:29.246844 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:35:29.246826    2575 scope.go:117] "RemoveContainer" containerID="474b9dea93c1c4c65706bdb92b6a29ca9d8b192b4956bc87601a63119fccef1d"
Jul 09 15:35:29.247107 ip-10-0-137-94 kubenswrapper[2575]: E0709 15:35:29.247088    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"474b9dea93c1c4c65706bdb92b6a29ca9d8b192b4956bc87601a63119fccef1d\": container with ID starting with 474b9dea93c1c4c65706bdb92b6a29ca9d8b192b4956bc87601a63119fccef1d not found: ID does not exist" containerID="474b9dea93c1c4c65706bdb92b6a29ca9d8b192b4956bc87601a63119fccef1d"
Jul 09 15:35:29.247151 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:35:29.247116    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"474b9dea93c1c4c65706bdb92b6a29ca9d8b192b4956bc87601a63119fccef1d"} err="failed to get container status \"474b9dea93c1c4c65706bdb92b6a29ca9d8b192b4956bc87601a63119fccef1d\": rpc error: code = NotFound desc = could not find container \"474b9dea93c1c4c65706bdb92b6a29ca9d8b192b4956bc87601a63119fccef1d\": container with ID starting with 474b9dea93c1c4c65706bdb92b6a29ca9d8b192b4956bc87601a63119fccef1d not found: ID does not exist"
Jul 09 15:35:29.259928 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:35:29.259905    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-bf561e/sub-test-model-bf561e-kserve-776b6f67b9-4bkgb"]
Jul 09 15:35:29.265175 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:35:29.265156    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-bf561e/sub-test-model-bf561e-kserve-776b6f67b9-4bkgb"]
Jul 09 15:35:29.317747 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:35:29.317691    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08d54dfc-3157-4087-93d3-c040e5c3ca0d" path="/var/lib/kubelet/pods/08d54dfc-3157-4087-93d3-c040e5c3ca0d/volumes"
Jul 09 15:35:38.939886 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:35:38.939846    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:35:39.042665 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:35:39.042632    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:35:41.734219 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:35:41.734189    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:35:56.656633 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:35:56.656577    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:35:56.757795 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:35:56.757758    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:36:05.212099 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:05.212063    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:36:05.313255 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:05.313216    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:36:07.943228 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:07.943184    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:36:27.438726 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:27.438677    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:36:28.341146 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:28.341113    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:36:29.690928 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:29.690894    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:36:32.795039 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:32.795004    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7266-140504079284784"]
Jul 09 15:36:32.795421 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:32.795399    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08d54dfc-3157-4087-93d3-c040e5c3ca0d" containerName="main"
Jul 09 15:36:32.795421 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:32.795411    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="08d54dfc-3157-4087-93d3-c040e5c3ca0d" containerName="main"
Jul 09 15:36:32.795497 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:32.795475    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="08d54dfc-3157-4087-93d3-c040e5c3ca0d" containerName="main"
Jul 09 15:36:32.798399 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:32.798382    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7266-140504079284784"
Jul 09 15:36:32.800981 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:32.800963    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-nnw6g\""
Jul 09 15:36:32.806683 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:32.806658    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7266-140504079284784"]
Jul 09 15:36:32.886805 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:32.886657    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqplt\" (UniqueName: \"kubernetes.io/projected/99b7ec59-813f-47aa-b8f3-9c4fbffa5dc1-kube-api-access-tqplt\") pod \"test-curl-7266-140504079284784\" (UID: \"99b7ec59-813f-47aa-b8f3-9c4fbffa5dc1\") " pod="openshift-ingress/test-curl-7266-140504079284784"
Jul 09 15:36:32.988098 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:32.988052    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqplt\" (UniqueName: \"kubernetes.io/projected/99b7ec59-813f-47aa-b8f3-9c4fbffa5dc1-kube-api-access-tqplt\") pod \"test-curl-7266-140504079284784\" (UID: \"99b7ec59-813f-47aa-b8f3-9c4fbffa5dc1\") " pod="openshift-ingress/test-curl-7266-140504079284784"
Jul 09 15:36:32.998254 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:32.998223    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqplt\" (UniqueName: \"kubernetes.io/projected/99b7ec59-813f-47aa-b8f3-9c4fbffa5dc1-kube-api-access-tqplt\") pod \"test-curl-7266-140504079284784\" (UID: \"99b7ec59-813f-47aa-b8f3-9c4fbffa5dc1\") " pod="openshift-ingress/test-curl-7266-140504079284784"
Jul 09 15:36:33.109055 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:33.108948    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7266-140504079284784"
Jul 09 15:36:33.240702 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:33.240678    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7266-140504079284784"]
Jul 09 15:36:33.242606 ip-10-0-137-94 kubenswrapper[2575]: W0709 15:36:33.242578    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod99b7ec59_813f_47aa_b8f3_9c4fbffa5dc1.slice/crio-fee22f7b548bff69a21ad4134bcdedb9c9118df70c47eba55bd2a00ecccc4a9a WatchSource:0}: Error finding container fee22f7b548bff69a21ad4134bcdedb9c9118df70c47eba55bd2a00ecccc4a9a: Status 404 returned error can't find the container with id fee22f7b548bff69a21ad4134bcdedb9c9118df70c47eba55bd2a00ecccc4a9a
Jul 09 15:36:33.243889 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:33.243871    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 15:36:33.574296 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:33.574249    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7266-140504079284784" event={"ID":"99b7ec59-813f-47aa-b8f3-9c4fbffa5dc1","Type":"ContainerStarted","Data":"fee22f7b548bff69a21ad4134bcdedb9c9118df70c47eba55bd2a00ecccc4a9a"}
Jul 09 15:36:34.581196 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:34.581156    2575 generic.go:356] "Generic (PLEG): container finished" podID="99b7ec59-813f-47aa-b8f3-9c4fbffa5dc1" containerID="527ea4b35ee8bf409f55470a670b1927492873df24483662b15bde6a611720e1" exitCode=0
Jul 09 15:36:34.581602 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:34.581240    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7266-140504079284784" event={"ID":"99b7ec59-813f-47aa-b8f3-9c4fbffa5dc1","Type":"ContainerDied","Data":"527ea4b35ee8bf409f55470a670b1927492873df24483662b15bde6a611720e1"}
Jul 09 15:36:35.730630 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:35.730599    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7266-140504079284784"
Jul 09 15:36:35.749738 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:35.749696    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7266-140504079284784_99b7ec59-813f-47aa-b8f3-9c4fbffa5dc1/test-curl-7266-140504079284784/0.log"
Jul 09 15:36:35.773735 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:35.773689    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7266-140504079284784"]
Jul 09 15:36:35.777975 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:35.777952    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7266-140504079284784"]
Jul 09 15:36:35.810988 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:35.810967    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tqplt\" (UniqueName: \"kubernetes.io/projected/99b7ec59-813f-47aa-b8f3-9c4fbffa5dc1-kube-api-access-tqplt\") pod \"99b7ec59-813f-47aa-b8f3-9c4fbffa5dc1\" (UID: \"99b7ec59-813f-47aa-b8f3-9c4fbffa5dc1\") "
Jul 09 15:36:35.813101 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:35.813074    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99b7ec59-813f-47aa-b8f3-9c4fbffa5dc1-kube-api-access-tqplt" (OuterVolumeSpecName: "kube-api-access-tqplt") pod "99b7ec59-813f-47aa-b8f3-9c4fbffa5dc1" (UID: "99b7ec59-813f-47aa-b8f3-9c4fbffa5dc1"). InnerVolumeSpecName "kube-api-access-tqplt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:36:35.912307 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:35.912277    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tqplt\" (UniqueName: \"kubernetes.io/projected/99b7ec59-813f-47aa-b8f3-9c4fbffa5dc1-kube-api-access-tqplt\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:36:35.942343 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:35.942307    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7266-140504081376576"]
Jul 09 15:36:35.942690 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:35.942678    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99b7ec59-813f-47aa-b8f3-9c4fbffa5dc1" containerName="test-curl-7266-140504079284784"
Jul 09 15:36:35.942783 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:35.942692    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="99b7ec59-813f-47aa-b8f3-9c4fbffa5dc1" containerName="test-curl-7266-140504079284784"
Jul 09 15:36:35.942783 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:35.942771    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="99b7ec59-813f-47aa-b8f3-9c4fbffa5dc1" containerName="test-curl-7266-140504079284784"
Jul 09 15:36:35.945678 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:35.945660    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7266-140504081376576"
Jul 09 15:36:35.951443 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:35.951420    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7266-140504081376576"]
Jul 09 15:36:36.013366 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:36.013335    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzscc\" (UniqueName: \"kubernetes.io/projected/da1dde30-654e-47f8-a47d-ab6931e406c5-kube-api-access-wzscc\") pod \"test-curl-7266-140504081376576\" (UID: \"da1dde30-654e-47f8-a47d-ab6931e406c5\") " pod="openshift-ingress/test-curl-7266-140504081376576"
Jul 09 15:36:36.114809 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:36.114770    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzscc\" (UniqueName: \"kubernetes.io/projected/da1dde30-654e-47f8-a47d-ab6931e406c5-kube-api-access-wzscc\") pod \"test-curl-7266-140504081376576\" (UID: \"da1dde30-654e-47f8-a47d-ab6931e406c5\") " pod="openshift-ingress/test-curl-7266-140504081376576"
Jul 09 15:36:36.124227 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:36.124200    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzscc\" (UniqueName: \"kubernetes.io/projected/da1dde30-654e-47f8-a47d-ab6931e406c5-kube-api-access-wzscc\") pod \"test-curl-7266-140504081376576\" (UID: \"da1dde30-654e-47f8-a47d-ab6931e406c5\") " pod="openshift-ingress/test-curl-7266-140504081376576"
Jul 09 15:36:36.255630 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:36.255535    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7266-140504081376576"
Jul 09 15:36:36.385587 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:36.385558    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7266-140504081376576"]
Jul 09 15:36:36.387132 ip-10-0-137-94 kubenswrapper[2575]: W0709 15:36:36.387105    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podda1dde30_654e_47f8_a47d_ab6931e406c5.slice/crio-2c6d755e42aeaf9b4fc067e49888be2a7527b43031b3b29fa377b1cec431a638 WatchSource:0}: Error finding container 2c6d755e42aeaf9b4fc067e49888be2a7527b43031b3b29fa377b1cec431a638: Status 404 returned error can't find the container with id 2c6d755e42aeaf9b4fc067e49888be2a7527b43031b3b29fa377b1cec431a638
Jul 09 15:36:36.592974 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:36.592888    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7266-140504079284784"
Jul 09 15:36:36.592974 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:36.592937    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fee22f7b548bff69a21ad4134bcdedb9c9118df70c47eba55bd2a00ecccc4a9a"
Jul 09 15:36:36.594092 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:36.594071    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7266-140504081376576" event={"ID":"da1dde30-654e-47f8-a47d-ab6931e406c5","Type":"ContainerStarted","Data":"2c6d755e42aeaf9b4fc067e49888be2a7527b43031b3b29fa377b1cec431a638"}
Jul 09 15:36:36.603318 ip-10-0-137-94 kubenswrapper[2575]: E0709 15:36:36.603291    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7266-140504079284784\" is forbidden: User \"system:node:ip-10-0-137-94.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-137-94.ec2.internal' and this object" podUID="99b7ec59-813f-47aa-b8f3-9c4fbffa5dc1" pod="openshift-ingress/test-curl-7266-140504079284784"
Jul 09 15:36:37.317051 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:37.317019    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99b7ec59-813f-47aa-b8f3-9c4fbffa5dc1" path="/var/lib/kubelet/pods/99b7ec59-813f-47aa-b8f3-9c4fbffa5dc1/volumes"
Jul 09 15:36:37.600142 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:37.600050    2575 generic.go:356] "Generic (PLEG): container finished" podID="da1dde30-654e-47f8-a47d-ab6931e406c5" containerID="03e45453da98b9db39aa9b03d209d809133fb2ce7bc8d4b48e8600b36c26a218" exitCode=0
Jul 09 15:36:37.600327 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:37.600141    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7266-140504081376576" event={"ID":"da1dde30-654e-47f8-a47d-ab6931e406c5","Type":"ContainerDied","Data":"03e45453da98b9db39aa9b03d209d809133fb2ce7bc8d4b48e8600b36c26a218"}
Jul 09 15:36:38.751742 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:38.751699    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7266-140504081376576"
Jul 09 15:36:38.776271 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:38.776237    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7266-140504081376576_da1dde30-654e-47f8-a47d-ab6931e406c5/test-curl-7266-140504081376576/0.log"
Jul 09 15:36:38.802466 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:38.802434    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7266-140504081376576"]
Jul 09 15:36:38.806426 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:38.806396    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7266-140504081376576"]
Jul 09 15:36:38.841417 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:38.841388    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wzscc\" (UniqueName: \"kubernetes.io/projected/da1dde30-654e-47f8-a47d-ab6931e406c5-kube-api-access-wzscc\") pod \"da1dde30-654e-47f8-a47d-ab6931e406c5\" (UID: \"da1dde30-654e-47f8-a47d-ab6931e406c5\") "
Jul 09 15:36:38.843509 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:38.843468    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da1dde30-654e-47f8-a47d-ab6931e406c5-kube-api-access-wzscc" (OuterVolumeSpecName: "kube-api-access-wzscc") pod "da1dde30-654e-47f8-a47d-ab6931e406c5" (UID: "da1dde30-654e-47f8-a47d-ab6931e406c5"). InnerVolumeSpecName "kube-api-access-wzscc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:36:38.933895 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:38.933862    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7266-140504081376576"]
Jul 09 15:36:38.934312 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:38.934294    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da1dde30-654e-47f8-a47d-ab6931e406c5" containerName="test-curl-7266-140504081376576"
Jul 09 15:36:38.934400 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:38.934315    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="da1dde30-654e-47f8-a47d-ab6931e406c5" containerName="test-curl-7266-140504081376576"
Jul 09 15:36:38.934461 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:38.934407    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="da1dde30-654e-47f8-a47d-ab6931e406c5" containerName="test-curl-7266-140504081376576"
Jul 09 15:36:38.938871 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:38.938850    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7266-140504081376576"
Jul 09 15:36:38.942694 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:38.942664    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7266-140504081376576"]
Jul 09 15:36:38.942847 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:38.942826    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wzscc\" (UniqueName: \"kubernetes.io/projected/da1dde30-654e-47f8-a47d-ab6931e406c5-kube-api-access-wzscc\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:36:39.043458 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:39.043419    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f77kf\" (UniqueName: \"kubernetes.io/projected/0330e426-4703-4cc9-a7a9-613983f9dfdd-kube-api-access-f77kf\") pod \"test-curl-7266-140504081376576\" (UID: \"0330e426-4703-4cc9-a7a9-613983f9dfdd\") " pod="openshift-ingress/test-curl-7266-140504081376576"
Jul 09 15:36:39.144837 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:39.144801    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f77kf\" (UniqueName: \"kubernetes.io/projected/0330e426-4703-4cc9-a7a9-613983f9dfdd-kube-api-access-f77kf\") pod \"test-curl-7266-140504081376576\" (UID: \"0330e426-4703-4cc9-a7a9-613983f9dfdd\") " pod="openshift-ingress/test-curl-7266-140504081376576"
Jul 09 15:36:39.154270 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:39.154237    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f77kf\" (UniqueName: \"kubernetes.io/projected/0330e426-4703-4cc9-a7a9-613983f9dfdd-kube-api-access-f77kf\") pod \"test-curl-7266-140504081376576\" (UID: \"0330e426-4703-4cc9-a7a9-613983f9dfdd\") " pod="openshift-ingress/test-curl-7266-140504081376576"
Jul 09 15:36:39.250054 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:39.249981    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7266-140504081376576"
Jul 09 15:36:39.318417 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:39.318381    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da1dde30-654e-47f8-a47d-ab6931e406c5" path="/var/lib/kubelet/pods/da1dde30-654e-47f8-a47d-ab6931e406c5/volumes"
Jul 09 15:36:39.381913 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:39.381888    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7266-140504081376576"]
Jul 09 15:36:39.383392 ip-10-0-137-94 kubenswrapper[2575]: W0709 15:36:39.383361    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0330e426_4703_4cc9_a7a9_613983f9dfdd.slice/crio-21d6a4896bf5917e74abe98bd0f3d2bec2346c4a04b0fa5eff3b0674203d23fc WatchSource:0}: Error finding container 21d6a4896bf5917e74abe98bd0f3d2bec2346c4a04b0fa5eff3b0674203d23fc: Status 404 returned error can't find the container with id 21d6a4896bf5917e74abe98bd0f3d2bec2346c4a04b0fa5eff3b0674203d23fc
Jul 09 15:36:39.614599 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:39.614502    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7266-140504081376576"
Jul 09 15:36:39.614599 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:39.614548    2575 scope.go:117] "RemoveContainer" containerID="03e45453da98b9db39aa9b03d209d809133fb2ce7bc8d4b48e8600b36c26a218"
Jul 09 15:36:39.615922 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:39.615844    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7266-140504081376576" event={"ID":"0330e426-4703-4cc9-a7a9-613983f9dfdd","Type":"ContainerStarted","Data":"21d6a4896bf5917e74abe98bd0f3d2bec2346c4a04b0fa5eff3b0674203d23fc"}
Jul 09 15:36:40.623978 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:40.623941    2575 generic.go:356] "Generic (PLEG): container finished" podID="0330e426-4703-4cc9-a7a9-613983f9dfdd" containerID="8906737f9e0ca591526999a009c7a1f19fd0c5b4de2d4245ca38bb2d275a5f60" exitCode=0
Jul 09 15:36:40.624440 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:40.623998    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7266-140504081376576" event={"ID":"0330e426-4703-4cc9-a7a9-613983f9dfdd","Type":"ContainerDied","Data":"8906737f9e0ca591526999a009c7a1f19fd0c5b4de2d4245ca38bb2d275a5f60"}
Jul 09 15:36:41.771331 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:41.771298    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7266-140504081376576"
Jul 09 15:36:41.794457 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:41.794429    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7266-140504081376576_0330e426-4703-4cc9-a7a9-613983f9dfdd/test-curl-7266-140504081376576/0.log"
Jul 09 15:36:41.821434 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:41.821398    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7266-140504081376576"]
Jul 09 15:36:41.823779 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:41.823753    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7266-140504081376576"]
Jul 09 15:36:41.868647 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:41.868618    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f77kf\" (UniqueName: \"kubernetes.io/projected/0330e426-4703-4cc9-a7a9-613983f9dfdd-kube-api-access-f77kf\") pod \"0330e426-4703-4cc9-a7a9-613983f9dfdd\" (UID: \"0330e426-4703-4cc9-a7a9-613983f9dfdd\") "
Jul 09 15:36:41.870679 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:41.870653    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0330e426-4703-4cc9-a7a9-613983f9dfdd-kube-api-access-f77kf" (OuterVolumeSpecName: "kube-api-access-f77kf") pod "0330e426-4703-4cc9-a7a9-613983f9dfdd" (UID: "0330e426-4703-4cc9-a7a9-613983f9dfdd"). InnerVolumeSpecName "kube-api-access-f77kf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:36:41.946594 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:41.946565    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7266-140504081378448"]
Jul 09 15:36:41.946985 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:41.946970    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0330e426-4703-4cc9-a7a9-613983f9dfdd" containerName="test-curl-7266-140504081376576"
Jul 09 15:36:41.947034 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:41.946988    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0330e426-4703-4cc9-a7a9-613983f9dfdd" containerName="test-curl-7266-140504081376576"
Jul 09 15:36:41.947071 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:41.947057    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="0330e426-4703-4cc9-a7a9-613983f9dfdd" containerName="test-curl-7266-140504081376576"
Jul 09 15:36:41.950077 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:41.950055    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7266-140504081378448"
Jul 09 15:36:41.957848 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:41.957827    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7266-140504081378448"]
Jul 09 15:36:41.970208 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:41.970175    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfgfx\" (UniqueName: \"kubernetes.io/projected/75e9568c-d6a3-4a02-97ad-4860b7fbe65f-kube-api-access-xfgfx\") pod \"test-curl-7266-140504081378448\" (UID: \"75e9568c-d6a3-4a02-97ad-4860b7fbe65f\") " pod="openshift-ingress/test-curl-7266-140504081378448"
Jul 09 15:36:41.970325 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:41.970244    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f77kf\" (UniqueName: \"kubernetes.io/projected/0330e426-4703-4cc9-a7a9-613983f9dfdd-kube-api-access-f77kf\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:36:42.071727 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:42.071671    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfgfx\" (UniqueName: \"kubernetes.io/projected/75e9568c-d6a3-4a02-97ad-4860b7fbe65f-kube-api-access-xfgfx\") pod \"test-curl-7266-140504081378448\" (UID: \"75e9568c-d6a3-4a02-97ad-4860b7fbe65f\") " pod="openshift-ingress/test-curl-7266-140504081378448"
Jul 09 15:36:42.080467 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:42.080435    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfgfx\" (UniqueName: \"kubernetes.io/projected/75e9568c-d6a3-4a02-97ad-4860b7fbe65f-kube-api-access-xfgfx\") pod \"test-curl-7266-140504081378448\" (UID: \"75e9568c-d6a3-4a02-97ad-4860b7fbe65f\") " pod="openshift-ingress/test-curl-7266-140504081378448"
Jul 09 15:36:42.259898 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:42.259802    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7266-140504081378448"
Jul 09 15:36:42.394949 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:42.394928    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7266-140504081378448"]
Jul 09 15:36:42.396369 ip-10-0-137-94 kubenswrapper[2575]: W0709 15:36:42.396344    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod75e9568c_d6a3_4a02_97ad_4860b7fbe65f.slice/crio-646105f6830d4dd4235ac8f0e9cbcb4cfc44345322daae52849d673ccc281358 WatchSource:0}: Error finding container 646105f6830d4dd4235ac8f0e9cbcb4cfc44345322daae52849d673ccc281358: Status 404 returned error can't find the container with id 646105f6830d4dd4235ac8f0e9cbcb4cfc44345322daae52849d673ccc281358
Jul 09 15:36:42.636245 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:42.636221    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7266-140504081376576"
Jul 09 15:36:42.636401 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:42.636266    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="21d6a4896bf5917e74abe98bd0f3d2bec2346c4a04b0fa5eff3b0674203d23fc"
Jul 09 15:36:42.637482 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:42.637459    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7266-140504081378448" event={"ID":"75e9568c-d6a3-4a02-97ad-4860b7fbe65f","Type":"ContainerStarted","Data":"646105f6830d4dd4235ac8f0e9cbcb4cfc44345322daae52849d673ccc281358"}
Jul 09 15:36:42.646668 ip-10-0-137-94 kubenswrapper[2575]: E0709 15:36:42.646644    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7266-140504081376576\" is forbidden: User \"system:node:ip-10-0-137-94.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-137-94.ec2.internal' and this object" podUID="0330e426-4703-4cc9-a7a9-613983f9dfdd" pod="openshift-ingress/test-curl-7266-140504081376576"
Jul 09 15:36:43.316151 ip-10-0-137-94 kubenswrapper[2575]: E0709 15:36:43.316107    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7266-140504081376576\" is forbidden: User \"system:node:ip-10-0-137-94.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-137-94.ec2.internal' and this object" podUID="0330e426-4703-4cc9-a7a9-613983f9dfdd" pod="openshift-ingress/test-curl-7266-140504081376576"
Jul 09 15:36:43.318770 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:43.318732    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0330e426-4703-4cc9-a7a9-613983f9dfdd" path="/var/lib/kubelet/pods/0330e426-4703-4cc9-a7a9-613983f9dfdd/volumes"
Jul 09 15:36:43.643504 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:43.643468    2575 generic.go:356] "Generic (PLEG): container finished" podID="75e9568c-d6a3-4a02-97ad-4860b7fbe65f" containerID="c250ab21b20f9d985859ca564661300798cf9af8caf334ce5aef8d28d3bf5571" exitCode=0
Jul 09 15:36:43.643671 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:43.643557    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7266-140504081378448" event={"ID":"75e9568c-d6a3-4a02-97ad-4860b7fbe65f","Type":"ContainerDied","Data":"c250ab21b20f9d985859ca564661300798cf9af8caf334ce5aef8d28d3bf5571"}
Jul 09 15:36:44.792136 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:44.792111    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7266-140504081378448"
Jul 09 15:36:44.842397 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:44.842360    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7266-140504081378448_75e9568c-d6a3-4a02-97ad-4860b7fbe65f/test-curl-7266-140504081378448/0.log"
Jul 09 15:36:44.881865 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:44.881828    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7266-140504081378448"]
Jul 09 15:36:44.885141 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:44.885086    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7266-140504081378448"]
Jul 09 15:36:44.898953 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:44.898930    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xfgfx\" (UniqueName: \"kubernetes.io/projected/75e9568c-d6a3-4a02-97ad-4860b7fbe65f-kube-api-access-xfgfx\") pod \"75e9568c-d6a3-4a02-97ad-4860b7fbe65f\" (UID: \"75e9568c-d6a3-4a02-97ad-4860b7fbe65f\") "
Jul 09 15:36:44.900958 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:44.900899    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75e9568c-d6a3-4a02-97ad-4860b7fbe65f-kube-api-access-xfgfx" (OuterVolumeSpecName: "kube-api-access-xfgfx") pod "75e9568c-d6a3-4a02-97ad-4860b7fbe65f" (UID: "75e9568c-d6a3-4a02-97ad-4860b7fbe65f"). InnerVolumeSpecName "kube-api-access-xfgfx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:36:45.000341 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:45.000302    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xfgfx\" (UniqueName: \"kubernetes.io/projected/75e9568c-d6a3-4a02-97ad-4860b7fbe65f-kube-api-access-xfgfx\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:36:45.319937 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:45.319855    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75e9568c-d6a3-4a02-97ad-4860b7fbe65f" path="/var/lib/kubelet/pods/75e9568c-d6a3-4a02-97ad-4860b7fbe65f/volumes"
Jul 09 15:36:45.656054 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:45.656026    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7266-140504081378448"
Jul 09 15:36:45.656054 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:45.656053    2575 scope.go:117] "RemoveContainer" containerID="c250ab21b20f9d985859ca564661300798cf9af8caf334ce5aef8d28d3bf5571"
Jul 09 15:36:48.017252 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:48.017211    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:36:48.405881 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:48.405841    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:36:48.505857 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:48.505817    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:36:48.607636 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:48.607602    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:36:48.769174 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:48.769085    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:36:54.769587 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:54.769549    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:36:54.845303 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:54.845271    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:36:58.275329 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:58.275296    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:36:58.344377 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:36:58.344344    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:37:02.876643 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:02.876608    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:37:03.199189 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:03.199156    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-497419-openshift-default-5767bc5ccf-7thxc"]
Jul 09 15:37:03.199401 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:03.199361    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-497419-openshift-default-5767bc5ccf-7thxc" podUID="7d5be055-9521-41a0-a474-572ef799ac7a" containerName="istio-proxy" containerID="cri-o://a0958b70dd8762caf96082d23a645dd77ec62ced68940f95a9e96d2dbeaf102b" gracePeriod=30
Jul 09 15:37:05.968897 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:05.968860    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:37:06.068818 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:06.068787    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:37:08.485198 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:08.485172    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-497419-openshift-default-5767bc5ccf-7thxc"
Jul 09 15:37:08.620894 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:08.620859    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wr2xx\" (UniqueName: \"kubernetes.io/projected/7d5be055-9521-41a0-a474-572ef799ac7a-kube-api-access-wr2xx\") pod \"7d5be055-9521-41a0-a474-572ef799ac7a\" (UID: \"7d5be055-9521-41a0-a474-572ef799ac7a\") "
Jul 09 15:37:08.621090 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:08.620906    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d5be055-9521-41a0-a474-572ef799ac7a-workload-certs\") pod \"7d5be055-9521-41a0-a474-572ef799ac7a\" (UID: \"7d5be055-9521-41a0-a474-572ef799ac7a\") "
Jul 09 15:37:08.621090 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:08.620957    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d5be055-9521-41a0-a474-572ef799ac7a-istiod-ca-cert\") pod \"7d5be055-9521-41a0-a474-572ef799ac7a\" (UID: \"7d5be055-9521-41a0-a474-572ef799ac7a\") "
Jul 09 15:37:08.621090 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:08.620981    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d5be055-9521-41a0-a474-572ef799ac7a-istio-podinfo\") pod \"7d5be055-9521-41a0-a474-572ef799ac7a\" (UID: \"7d5be055-9521-41a0-a474-572ef799ac7a\") "
Jul 09 15:37:08.621090 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:08.621029    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d5be055-9521-41a0-a474-572ef799ac7a-istio-data\") pod \"7d5be055-9521-41a0-a474-572ef799ac7a\" (UID: \"7d5be055-9521-41a0-a474-572ef799ac7a\") "
Jul 09 15:37:08.621314 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:08.621153    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d5be055-9521-41a0-a474-572ef799ac7a-workload-socket\") pod \"7d5be055-9521-41a0-a474-572ef799ac7a\" (UID: \"7d5be055-9521-41a0-a474-572ef799ac7a\") "
Jul 09 15:37:08.621486 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:08.621320    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d5be055-9521-41a0-a474-572ef799ac7a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7d5be055-9521-41a0-a474-572ef799ac7a" (UID: "7d5be055-9521-41a0-a474-572ef799ac7a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:37:08.621571 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:08.621394    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d5be055-9521-41a0-a474-572ef799ac7a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7d5be055-9521-41a0-a474-572ef799ac7a" (UID: "7d5be055-9521-41a0-a474-572ef799ac7a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 15:37:08.621571 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:08.621527    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d5be055-9521-41a0-a474-572ef799ac7a-istio-envoy\") pod \"7d5be055-9521-41a0-a474-572ef799ac7a\" (UID: \"7d5be055-9521-41a0-a474-572ef799ac7a\") "
Jul 09 15:37:08.621674 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:08.621570    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d5be055-9521-41a0-a474-572ef799ac7a-credential-socket\") pod \"7d5be055-9521-41a0-a474-572ef799ac7a\" (UID: \"7d5be055-9521-41a0-a474-572ef799ac7a\") "
Jul 09 15:37:08.621674 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:08.621613    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d5be055-9521-41a0-a474-572ef799ac7a-istio-token\") pod \"7d5be055-9521-41a0-a474-572ef799ac7a\" (UID: \"7d5be055-9521-41a0-a474-572ef799ac7a\") "
Jul 09 15:37:08.621833 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:08.621801    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d5be055-9521-41a0-a474-572ef799ac7a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7d5be055-9521-41a0-a474-572ef799ac7a" (UID: "7d5be055-9521-41a0-a474-572ef799ac7a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:37:08.622009 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:08.621963    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d5be055-9521-41a0-a474-572ef799ac7a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7d5be055-9521-41a0-a474-572ef799ac7a" (UID: "7d5be055-9521-41a0-a474-572ef799ac7a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:37:08.622136 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:08.622048    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d5be055-9521-41a0-a474-572ef799ac7a-workload-certs\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:37:08.622136 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:08.622068    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d5be055-9521-41a0-a474-572ef799ac7a-istiod-ca-cert\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:37:08.622136 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:08.622077    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d5be055-9521-41a0-a474-572ef799ac7a-istio-data" (OuterVolumeSpecName: "istio-data") pod "7d5be055-9521-41a0-a474-572ef799ac7a" (UID: "7d5be055-9521-41a0-a474-572ef799ac7a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:37:08.622136 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:08.622083    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d5be055-9521-41a0-a474-572ef799ac7a-workload-socket\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:37:08.623366 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:08.623339    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7d5be055-9521-41a0-a474-572ef799ac7a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7d5be055-9521-41a0-a474-572ef799ac7a" (UID: "7d5be055-9521-41a0-a474-572ef799ac7a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 15:37:08.623471 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:08.623419    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d5be055-9521-41a0-a474-572ef799ac7a-kube-api-access-wr2xx" (OuterVolumeSpecName: "kube-api-access-wr2xx") pod "7d5be055-9521-41a0-a474-572ef799ac7a" (UID: "7d5be055-9521-41a0-a474-572ef799ac7a"). InnerVolumeSpecName "kube-api-access-wr2xx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:37:08.623535 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:08.623516    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d5be055-9521-41a0-a474-572ef799ac7a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7d5be055-9521-41a0-a474-572ef799ac7a" (UID: "7d5be055-9521-41a0-a474-572ef799ac7a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:37:08.623654 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:08.623640    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d5be055-9521-41a0-a474-572ef799ac7a-istio-token" (OuterVolumeSpecName: "istio-token") pod "7d5be055-9521-41a0-a474-572ef799ac7a" (UID: "7d5be055-9521-41a0-a474-572ef799ac7a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:37:08.722656 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:08.722570    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d5be055-9521-41a0-a474-572ef799ac7a-istio-envoy\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:37:08.722656 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:08.722600    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d5be055-9521-41a0-a474-572ef799ac7a-credential-socket\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:37:08.722656 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:08.722610    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d5be055-9521-41a0-a474-572ef799ac7a-istio-token\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:37:08.722656 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:08.722620    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wr2xx\" (UniqueName: \"kubernetes.io/projected/7d5be055-9521-41a0-a474-572ef799ac7a-kube-api-access-wr2xx\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:37:08.722656 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:08.722628    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d5be055-9521-41a0-a474-572ef799ac7a-istio-podinfo\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:37:08.722656 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:08.722637    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d5be055-9521-41a0-a474-572ef799ac7a-istio-data\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\""
Jul 09 15:37:08.778298 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:08.778256    2575 generic.go:356] "Generic (PLEG): container finished" podID="7d5be055-9521-41a0-a474-572ef799ac7a" containerID="a0958b70dd8762caf96082d23a645dd77ec62ced68940f95a9e96d2dbeaf102b" exitCode=0
Jul 09 15:37:08.778458 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:08.778302    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-497419-openshift-default-5767bc5ccf-7thxc"
Jul 09 15:37:08.778458 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:08.778321    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-497419-openshift-default-5767bc5ccf-7thxc" event={"ID":"7d5be055-9521-41a0-a474-572ef799ac7a","Type":"ContainerDied","Data":"a0958b70dd8762caf96082d23a645dd77ec62ced68940f95a9e96d2dbeaf102b"}
Jul 09 15:37:08.778458 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:08.778372    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-497419-openshift-default-5767bc5ccf-7thxc" event={"ID":"7d5be055-9521-41a0-a474-572ef799ac7a","Type":"ContainerDied","Data":"e386d0fcc9dd86f60faf424ded37f288568c0048c64fd4822257e19b17d58262"}
Jul 09 15:37:08.778458 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:08.778399    2575 scope.go:117] "RemoveContainer" containerID="a0958b70dd8762caf96082d23a645dd77ec62ced68940f95a9e96d2dbeaf102b"
Jul 09 15:37:08.788016 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:08.787997    2575 scope.go:117] "RemoveContainer" containerID="e23486e0de7769f1da00367a84ebaa933a748fe69cc21482806c6ce3067b2d4b"
Jul 09 15:37:08.795827 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:08.795805    2575 scope.go:117] "RemoveContainer" containerID="a0958b70dd8762caf96082d23a645dd77ec62ced68940f95a9e96d2dbeaf102b"
Jul 09 15:37:08.796064 ip-10-0-137-94 kubenswrapper[2575]: E0709 15:37:08.796046    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0958b70dd8762caf96082d23a645dd77ec62ced68940f95a9e96d2dbeaf102b\": container with ID starting with a0958b70dd8762caf96082d23a645dd77ec62ced68940f95a9e96d2dbeaf102b not found: ID does not exist" containerID="a0958b70dd8762caf96082d23a645dd77ec62ced68940f95a9e96d2dbeaf102b"
Jul 09 15:37:08.796108 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:08.796073    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0958b70dd8762caf96082d23a645dd77ec62ced68940f95a9e96d2dbeaf102b"} err="failed to get container status \"a0958b70dd8762caf96082d23a645dd77ec62ced68940f95a9e96d2dbeaf102b\": rpc error: code = NotFound desc = could not find container \"a0958b70dd8762caf96082d23a645dd77ec62ced68940f95a9e96d2dbeaf102b\": container with ID starting with a0958b70dd8762caf96082d23a645dd77ec62ced68940f95a9e96d2dbeaf102b not found: ID does not exist"
Jul 09 15:37:08.796108 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:08.796091    2575 scope.go:117] "RemoveContainer" containerID="e23486e0de7769f1da00367a84ebaa933a748fe69cc21482806c6ce3067b2d4b"
Jul 09 15:37:08.796304 ip-10-0-137-94 kubenswrapper[2575]: E0709 15:37:08.796289    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e23486e0de7769f1da00367a84ebaa933a748fe69cc21482806c6ce3067b2d4b\": container with ID starting with e23486e0de7769f1da00367a84ebaa933a748fe69cc21482806c6ce3067b2d4b not found: ID does not exist" containerID="e23486e0de7769f1da00367a84ebaa933a748fe69cc21482806c6ce3067b2d4b"
Jul 09 15:37:08.796345 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:08.796308    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e23486e0de7769f1da00367a84ebaa933a748fe69cc21482806c6ce3067b2d4b"} err="failed to get container status \"e23486e0de7769f1da00367a84ebaa933a748fe69cc21482806c6ce3067b2d4b\": rpc error: code = NotFound desc = could not find container \"e23486e0de7769f1da00367a84ebaa933a748fe69cc21482806c6ce3067b2d4b\": container with ID starting with e23486e0de7769f1da00367a84ebaa933a748fe69cc21482806c6ce3067b2d4b not found: ID does not exist"
Jul 09 15:37:08.802249 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:08.802225    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-497419-openshift-default-5767bc5ccf-7thxc"]
Jul 09 15:37:08.814083 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:08.814057    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-497419-openshift-default-5767bc5ccf-7thxc"]
Jul 09 15:37:08.955023 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:08.954998    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-ktspl_bb5cf238-a44c-4502-b95f-6316351b7d19/manager/0.log"
Jul 09 15:37:09.081439 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:09.081366    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-fq2gh_851c3baa-0ea1-4651-b761-912e0f48701f/manager/0.log"
Jul 09 15:37:09.209416 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:09.209382    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-79d77fd896-bjg7z_81a9da88-5e62-452f-ba09-b8cfcbfa7e45/manager/0.log"
Jul 09 15:37:09.317369 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:09.317336    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d5be055-9521-41a0-a474-572ef799ac7a" path="/var/lib/kubelet/pods/7d5be055-9521-41a0-a474-572ef799ac7a/volumes"
Jul 09 15:37:09.325376 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:09.325351    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-jbt8f_c3a4351a-85e6-4fe2-aa97-6ff251a1f928/server/0.log"
Jul 09 15:37:09.448031 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:09.448003    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-wlr8v_135669fd-b0a8-4f26-933a-55c836e8b908/manager/0.log"
Jul 09 15:37:09.872680 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:09.872600    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69d458487d-75frk_3a9dc5e2-12a0-4235-ac1d-e425d48fd107/copy-manifests/0.log"
Jul 09 15:37:09.879656 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:09.879635    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69d458487d-75frk_3a9dc5e2-12a0-4235-ac1d-e425d48fd107/manager/0.log"
Jul 09 15:37:10.229752 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:10.229725    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-79fc58f8b5-p6md8_20adf977-ca07-4da2-9e7f-e9a7203eda39/maas-api/0.log"
Jul 09 15:37:10.347367 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:10.347335    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-k4pfk_255f66f0-5b8a-4ab5-ba7e-9b8c20afaa6a/postgres/0.log"
Jul 09 15:37:11.158946 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:11.158912    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7b2l_4f0471e1-7ff7-4795-b974-0072dfb7739b/util/0.log"
Jul 09 15:37:11.166018 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:11.165995    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7b2l_4f0471e1-7ff7-4795-b974-0072dfb7739b/pull/0.log"
Jul 09 15:37:11.172807 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:11.172785    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7b2l_4f0471e1-7ff7-4795-b974-0072dfb7739b/extract/0.log"
Jul 09 15:37:11.292884 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:11.292856    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q58vh_a0d02497-a76a-43b2-9af2-7e87a75ee1ee/extract/0.log"
Jul 09 15:37:11.299391 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:11.299364    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q58vh_a0d02497-a76a-43b2-9af2-7e87a75ee1ee/util/0.log"
Jul 09 15:37:11.306345 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:11.306323    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q58vh_a0d02497-a76a-43b2-9af2-7e87a75ee1ee/pull/0.log"
Jul 09 15:37:11.428008 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:11.427937    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h2q26_746a4a31-0b68-47e3-bc87-e16dd3edea5a/util/0.log"
Jul 09 15:37:11.434321 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:11.434302    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h2q26_746a4a31-0b68-47e3-bc87-e16dd3edea5a/pull/0.log"
Jul 09 15:37:11.440803 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:11.440781    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h2q26_746a4a31-0b68-47e3-bc87-e16dd3edea5a/extract/0.log"
Jul 09 15:37:11.559298 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:11.559266    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18q6l5_48dc0bae-8282-44ea-922b-c6787596276f/pull/0.log"
Jul 09 15:37:11.566162 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:11.566140    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18q6l5_48dc0bae-8282-44ea-922b-c6787596276f/extract/0.log"
Jul 09 15:37:11.572276 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:11.572256    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18q6l5_48dc0bae-8282-44ea-922b-c6787596276f/util/0.log"
Jul 09 15:37:11.943307 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:11.943268    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-85lw4_4705b447-31df-4df7-b987-d56f20319c34/manager/0.log"
Jul 09 15:37:12.061313 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:12.061285    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-st6mr_7c3ebb71-a0f0-4b32-8e8c-54104d13623e/kuadrant-console-plugin/0.log"
Jul 09 15:37:12.178776 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:12.178735    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-7qq6f_a1842963-9cb6-4418-9c2a-5b90a9fdb703/registry-server/0.log"
Jul 09 15:37:12.305442 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:12.305364    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-bgzf9_d084521d-52bd-41dd-8a95-c2f9a09f6604/manager/0.log"
Jul 09 15:37:12.543882 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:12.543849    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-2qr6n_f321cc35-8da4-40aa-b983-58ca540983bf/manager/0.log"
Jul 09 15:37:12.900469 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:12.900436    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4rt9wg_522dc3ee-01e2-4682-96bc-76c238b9baf2/istio-proxy/0.log"
Jul 09 15:37:13.271466 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:13.271386    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8d68d4884-swz9s_904241fe-9e22-47b8-beca-a9df45ab3f25/kube-auth-proxy/0.log"
Jul 09 15:37:13.393293 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:13.393256    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-mjlqx_85ae6aa9-f89f-4a61-9630-9f6b2b82910d/istio-proxy/1.log"
Jul 09 15:37:13.513324 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:13.513294    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-qx6fv_122b7856-6300-4e91-92e9-9fc7555df6ce/payload-pre-processing/0.log"
Jul 09 15:37:14.104526 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:14.104492    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-g5xmh_0222c564-bc4e-40af-bb50-dff0ac92e796/main/0.log"
Jul 09 15:37:14.469094 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:14.469068    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkmrqx_f804b172-2790-4ebf-aacb-ecc231bb8033/main/0.log"
Jul 09 15:37:14.719979 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:14.719899    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-222rh_e385da63-dd63-432c-8c54-f790278eb0c2/main/0.log"
Jul 09 15:37:19.356117 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:19.356078    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:37:19.475607 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:19.475567    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log" limit=1024
Jul 09 15:37:22.675607 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:22.675572    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-f6rbl_bf25b5cc-fd7d-4383-ae3f-6a2fc1df007e/global-pull-secret-syncer/0.log"
Jul 09 15:37:22.901791 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:22.901757    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-2pbcc_6e3ee08b-fbd7-4ff0-b953-fd749858497c/konnectivity-agent/0.log"
Jul 09 15:37:23.119817 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:23.119734    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-94.ec2.internal_842163ee6bc7db204a9ad24049bf1028/haproxy/0.log"
Jul 09 15:37:27.496846 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:27.496812    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7b2l_4f0471e1-7ff7-4795-b974-0072dfb7739b/extract/0.log"
Jul 09 15:37:27.557396 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:27.557368    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7b2l_4f0471e1-7ff7-4795-b974-0072dfb7739b/util/0.log"
Jul 09 15:37:27.602348 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:27.602315    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7b2l_4f0471e1-7ff7-4795-b974-0072dfb7739b/pull/0.log"
Jul 09 15:37:27.637539 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:27.637512    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q58vh_a0d02497-a76a-43b2-9af2-7e87a75ee1ee/extract/0.log"
Jul 09 15:37:27.674289 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:27.674263    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q58vh_a0d02497-a76a-43b2-9af2-7e87a75ee1ee/util/0.log"
Jul 09 15:37:27.709137 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:27.709112    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q58vh_a0d02497-a76a-43b2-9af2-7e87a75ee1ee/pull/0.log"
Jul 09 15:37:27.758678 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:27.758606    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h2q26_746a4a31-0b68-47e3-bc87-e16dd3edea5a/extract/0.log"
Jul 09 15:37:27.797114 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:27.797089    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h2q26_746a4a31-0b68-47e3-bc87-e16dd3edea5a/util/0.log"
Jul 09 15:37:27.848043 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:27.848012    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h2q26_746a4a31-0b68-47e3-bc87-e16dd3edea5a/pull/0.log"
Jul 09 15:37:27.912619 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:27.912592    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18q6l5_48dc0bae-8282-44ea-922b-c6787596276f/extract/0.log"
Jul 09 15:37:27.977588 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:27.977565    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18q6l5_48dc0bae-8282-44ea-922b-c6787596276f/util/0.log"
Jul 09 15:37:28.029989 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:28.029920    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18q6l5_48dc0bae-8282-44ea-922b-c6787596276f/pull/0.log"
Jul 09 15:37:28.530859 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:28.530831    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-85lw4_4705b447-31df-4df7-b987-d56f20319c34/manager/0.log"
Jul 09 15:37:28.564198 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:28.564171    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-st6mr_7c3ebb71-a0f0-4b32-8e8c-54104d13623e/kuadrant-console-plugin/0.log"
Jul 09 15:37:28.612270 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:28.612239    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-7qq6f_a1842963-9cb6-4418-9c2a-5b90a9fdb703/registry-server/0.log"
Jul 09 15:37:28.752344 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:28.752311    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-bgzf9_d084521d-52bd-41dd-8a95-c2f9a09f6604/manager/0.log"
Jul 09 15:37:28.890099 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:28.890071    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-2qr6n_f321cc35-8da4-40aa-b983-58ca540983bf/manager/0.log"
Jul 09 15:37:31.043183 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:31.043152    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6mt7n_b6696c4f-26a8-4c56-a9aa-7818569be962/node-exporter/0.log"
Jul 09 15:37:31.072374 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:31.072352    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6mt7n_b6696c4f-26a8-4c56-a9aa-7818569be962/kube-rbac-proxy/0.log"
Jul 09 15:37:31.103055 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:31.103032    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6mt7n_b6696c4f-26a8-4c56-a9aa-7818569be962/init-textfile/0.log"
Jul 09 15:37:32.028540 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:32.028503    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wn7sj/perf-node-gather-daemonset-l797w"]
Jul 09 15:37:32.029009 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:32.028985    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d5be055-9521-41a0-a474-572ef799ac7a" containerName="istio-proxy"
Jul 09 15:37:32.029009 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:32.029006    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d5be055-9521-41a0-a474-572ef799ac7a" containerName="istio-proxy"
Jul 09 15:37:32.029156 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:32.029024    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75e9568c-d6a3-4a02-97ad-4860b7fbe65f" containerName="test-curl-7266-140504081378448"
Jul 09 15:37:32.029156 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:32.029031    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="75e9568c-d6a3-4a02-97ad-4860b7fbe65f" containerName="test-curl-7266-140504081378448"
Jul 09 15:37:32.029156 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:32.029090    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d5be055-9521-41a0-a474-572ef799ac7a" containerName="istio-proxy"
Jul 09 15:37:32.029156 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:32.029100    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="75e9568c-d6a3-4a02-97ad-4860b7fbe65f" containerName="test-curl-7266-140504081378448"
Jul 09 15:37:32.032137 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:32.032119    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wn7sj/perf-node-gather-daemonset-l797w"
Jul 09 15:37:32.034681 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:32.034663    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wn7sj\"/\"default-dockercfg-6vsgb\""
Jul 09 15:37:32.035684 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:32.035668    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wn7sj\"/\"openshift-service-ca.crt\""
Jul 09 15:37:32.035770 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:32.035682    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wn7sj\"/\"kube-root-ca.crt\""
Jul 09 15:37:32.044484 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:32.044462    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wn7sj/perf-node-gather-daemonset-l797w"]
Jul 09 15:37:32.130687 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:32.130655    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/06a03c48-533e-4f8b-85b3-65059c3d60a0-proc\") pod \"perf-node-gather-daemonset-l797w\" (UID: \"06a03c48-533e-4f8b-85b3-65059c3d60a0\") " pod="openshift-must-gather-wn7sj/perf-node-gather-daemonset-l797w"
Jul 09 15:37:32.130687 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:32.130690    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgqk6\" (UniqueName: \"kubernetes.io/projected/06a03c48-533e-4f8b-85b3-65059c3d60a0-kube-api-access-hgqk6\") pod \"perf-node-gather-daemonset-l797w\" (UID: \"06a03c48-533e-4f8b-85b3-65059c3d60a0\") " pod="openshift-must-gather-wn7sj/perf-node-gather-daemonset-l797w"
Jul 09 15:37:32.130932 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:32.130784    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/06a03c48-533e-4f8b-85b3-65059c3d60a0-sys\") pod \"perf-node-gather-daemonset-l797w\" (UID: \"06a03c48-533e-4f8b-85b3-65059c3d60a0\") " pod="openshift-must-gather-wn7sj/perf-node-gather-daemonset-l797w"
Jul 09 15:37:32.130932 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:32.130825    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/06a03c48-533e-4f8b-85b3-65059c3d60a0-podres\") pod \"perf-node-gather-daemonset-l797w\" (UID: \"06a03c48-533e-4f8b-85b3-65059c3d60a0\") " pod="openshift-must-gather-wn7sj/perf-node-gather-daemonset-l797w"
Jul 09 15:37:32.130932 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:32.130885    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/06a03c48-533e-4f8b-85b3-65059c3d60a0-lib-modules\") pod \"perf-node-gather-daemonset-l797w\" (UID: \"06a03c48-533e-4f8b-85b3-65059c3d60a0\") " pod="openshift-must-gather-wn7sj/perf-node-gather-daemonset-l797w"
Jul 09 15:37:32.231405 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:32.231368    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/06a03c48-533e-4f8b-85b3-65059c3d60a0-sys\") pod \"perf-node-gather-daemonset-l797w\" (UID: \"06a03c48-533e-4f8b-85b3-65059c3d60a0\") " pod="openshift-must-gather-wn7sj/perf-node-gather-daemonset-l797w"
Jul 09 15:37:32.231603 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:32.231415    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/06a03c48-533e-4f8b-85b3-65059c3d60a0-podres\") pod \"perf-node-gather-daemonset-l797w\" (UID: \"06a03c48-533e-4f8b-85b3-65059c3d60a0\") " pod="openshift-must-gather-wn7sj/perf-node-gather-daemonset-l797w"
Jul 09 15:37:32.231603 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:32.231469    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/06a03c48-533e-4f8b-85b3-65059c3d60a0-lib-modules\") pod \"perf-node-gather-daemonset-l797w\" (UID: \"06a03c48-533e-4f8b-85b3-65059c3d60a0\") " pod="openshift-must-gather-wn7sj/perf-node-gather-daemonset-l797w"
Jul 09 15:37:32.231603 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:32.231493    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/06a03c48-533e-4f8b-85b3-65059c3d60a0-proc\") pod \"perf-node-gather-daemonset-l797w\" (UID: \"06a03c48-533e-4f8b-85b3-65059c3d60a0\") " pod="openshift-must-gather-wn7sj/perf-node-gather-daemonset-l797w"
Jul 09 15:37:32.231603 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:32.231509    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgqk6\" (UniqueName: \"kubernetes.io/projected/06a03c48-533e-4f8b-85b3-65059c3d60a0-kube-api-access-hgqk6\") pod \"perf-node-gather-daemonset-l797w\" (UID: \"06a03c48-533e-4f8b-85b3-65059c3d60a0\") " pod="openshift-must-gather-wn7sj/perf-node-gather-daemonset-l797w"
Jul 09 15:37:32.231603 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:32.231509    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/06a03c48-533e-4f8b-85b3-65059c3d60a0-sys\") pod \"perf-node-gather-daemonset-l797w\" (UID: \"06a03c48-533e-4f8b-85b3-65059c3d60a0\") " pod="openshift-must-gather-wn7sj/perf-node-gather-daemonset-l797w"
Jul 09 15:37:32.231861 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:32.231599    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/06a03c48-533e-4f8b-85b3-65059c3d60a0-proc\") pod \"perf-node-gather-daemonset-l797w\" (UID: \"06a03c48-533e-4f8b-85b3-65059c3d60a0\") " pod="openshift-must-gather-wn7sj/perf-node-gather-daemonset-l797w"
Jul 09 15:37:32.231861 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:32.231616    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/06a03c48-533e-4f8b-85b3-65059c3d60a0-podres\") pod \"perf-node-gather-daemonset-l797w\" (UID: \"06a03c48-533e-4f8b-85b3-65059c3d60a0\") " pod="openshift-must-gather-wn7sj/perf-node-gather-daemonset-l797w"
Jul 09 15:37:32.231861 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:32.231641    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/06a03c48-533e-4f8b-85b3-65059c3d60a0-lib-modules\") pod \"perf-node-gather-daemonset-l797w\" (UID: \"06a03c48-533e-4f8b-85b3-65059c3d60a0\") " pod="openshift-must-gather-wn7sj/perf-node-gather-daemonset-l797w"
Jul 09 15:37:32.241016 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:32.240990    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgqk6\" (UniqueName: \"kubernetes.io/projected/06a03c48-533e-4f8b-85b3-65059c3d60a0-kube-api-access-hgqk6\") pod \"perf-node-gather-daemonset-l797w\" (UID: \"06a03c48-533e-4f8b-85b3-65059c3d60a0\") " pod="openshift-must-gather-wn7sj/perf-node-gather-daemonset-l797w"
Jul 09 15:37:32.341390 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:32.341313    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wn7sj/perf-node-gather-daemonset-l797w"
Jul 09 15:37:32.493568 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:32.493542    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wn7sj/perf-node-gather-daemonset-l797w"]
Jul 09 15:37:32.495503 ip-10-0-137-94 kubenswrapper[2575]: W0709 15:37:32.495481    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod06a03c48_533e_4f8b_85b3_65059c3d60a0.slice/crio-e3cfe1af2b0f1d41ad35b54d5354201ae2b9362c5a716babfe5c5b800d04d287 WatchSource:0}: Error finding container e3cfe1af2b0f1d41ad35b54d5354201ae2b9362c5a716babfe5c5b800d04d287: Status 404 returned error can't find the container with id e3cfe1af2b0f1d41ad35b54d5354201ae2b9362c5a716babfe5c5b800d04d287
Jul 09 15:37:32.902336 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:32.902290    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wn7sj/perf-node-gather-daemonset-l797w" event={"ID":"06a03c48-533e-4f8b-85b3-65059c3d60a0","Type":"ContainerStarted","Data":"0a7c3d05477e9962ee0d681433c096a91e8dfa1dc2a6c7d62ad649d5cc63ad70"}
Jul 09 15:37:32.902533 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:32.902355    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wn7sj/perf-node-gather-daemonset-l797w"
Jul 09 15:37:32.902533 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:32.902371    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wn7sj/perf-node-gather-daemonset-l797w" event={"ID":"06a03c48-533e-4f8b-85b3-65059c3d60a0","Type":"ContainerStarted","Data":"e3cfe1af2b0f1d41ad35b54d5354201ae2b9362c5a716babfe5c5b800d04d287"}
Jul 09 15:37:32.926990 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:32.926940    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wn7sj/perf-node-gather-daemonset-l797w" podStartSLOduration=0.926925794 podStartE2EDuration="926.925794ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 15:37:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:37:32.925830451 +0000 UTC m=+2560.768363383" watchObservedRunningTime="2026-07-09 15:37:32.926925794 +0000 UTC m=+2560.769458761"
Jul 09 15:37:33.291557 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:33.291476    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-qkh9h_c006160e-a992-4ef4-86d2-a0ecd918f582/networking-console-plugin/0.log"
Jul 09 15:37:36.265334 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:36.265307    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tjbtl_4da1e96e-5ef6-4039-9a5e-0f1745820cc8/dns/0.log"
Jul 09 15:37:36.288360 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:36.288329    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tjbtl_4da1e96e-5ef6-4039-9a5e-0f1745820cc8/kube-rbac-proxy/0.log"
Jul 09 15:37:36.363850 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:36.363824    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xmx5q_fcff5fbe-84d3-47a1-9cde-4db751cbaae6/dns-node-resolver/0.log"
Jul 09 15:37:37.052261 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:37.052235    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zxwhs_030200a1-2c06-4390-ab1b-d3e79bd705f2/node-ca/0.log"
Jul 09 15:37:38.229676 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:38.229645    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4rt9wg_522dc3ee-01e2-4682-96bc-76c238b9baf2/istio-proxy/0.log"
Jul 09 15:37:38.486252 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:38.486171    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8d68d4884-swz9s_904241fe-9e22-47b8-beca-a9df45ab3f25/kube-auth-proxy/0.log"
Jul 09 15:37:38.526808 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:38.526779    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-mjlqx_85ae6aa9-f89f-4a61-9630-9f6b2b82910d/istio-proxy/0.log"
Jul 09 15:37:38.552051 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:38.552024    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-mjlqx_85ae6aa9-f89f-4a61-9630-9f6b2b82910d/istio-proxy/1.log"
Jul 09 15:37:38.613418 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:38.613389    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-qx6fv_122b7856-6300-4e91-92e9-9fc7555df6ce/payload-pre-processing/0.log"
Jul 09 15:37:38.917361 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:38.917334    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wn7sj/perf-node-gather-daemonset-l797w"
Jul 09 15:37:39.480883 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:39.480853    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bsf52_fceb57a3-32ec-4a87-92a4-e92920e8326a/serve-healthcheck-canary/0.log"
Jul 09 15:37:40.142569 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:40.142544    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-c9s8h_fb0b26b0-9130-42ae-87a4-421786e8f65b/kube-rbac-proxy/0.log"
Jul 09 15:37:40.165188 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:40.165166    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-c9s8h_fb0b26b0-9130-42ae-87a4-421786e8f65b/exporter/0.log"
Jul 09 15:37:40.190759 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:40.190727    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-c9s8h_fb0b26b0-9130-42ae-87a4-421786e8f65b/extractor/0.log"
Jul 09 15:37:42.931452 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:42.931416    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-ktspl_bb5cf238-a44c-4502-b95f-6316351b7d19/manager/0.log"
Jul 09 15:37:43.064266 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:43.064241    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-fq2gh_851c3baa-0ea1-4651-b761-912e0f48701f/manager/0.log"
Jul 09 15:37:43.074976 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:43.074955    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4rt9wg_522dc3ee-01e2-4682-96bc-76c238b9baf2/istio-proxy/0.log"
Jul 09 15:37:43.155416 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:43.155387    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-79d77fd896-bjg7z_81a9da88-5e62-452f-ba09-b8cfcbfa7e45/manager/0.log"
Jul 09 15:37:43.206597 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:43.206526    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-jbt8f_c3a4351a-85e6-4fe2-aa97-6ff251a1f928/server/0.log"
Jul 09 15:37:43.277990 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:43.277964    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-wlr8v_135669fd-b0a8-4f26-933a-55c836e8b908/manager/0.log"
Jul 09 15:37:43.332596 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:43.332558    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8d68d4884-swz9s_904241fe-9e22-47b8-beca-a9df45ab3f25/kube-auth-proxy/0.log"
Jul 09 15:37:43.363092 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:43.363051    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-mjlqx_85ae6aa9-f89f-4a61-9630-9f6b2b82910d/istio-proxy/0.log"
Jul 09 15:37:43.396105 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:43.396053    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-mjlqx_85ae6aa9-f89f-4a61-9630-9f6b2b82910d/istio-proxy/1.log"
Jul 09 15:37:43.430646 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:43.430616    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-qx6fv_122b7856-6300-4e91-92e9-9fc7555df6ce/payload-pre-processing/0.log"
Jul 09 15:37:43.507340 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:43.507265    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69d458487d-75frk_3a9dc5e2-12a0-4235-ac1d-e425d48fd107/manager/0.log"
Jul 09 15:37:43.535045 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:43.535018    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69d458487d-75frk_3a9dc5e2-12a0-4235-ac1d-e425d48fd107/copy-manifests/0.log"
Jul 09 15:37:44.694771 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:44.694734    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4rt9wg_522dc3ee-01e2-4682-96bc-76c238b9baf2/istio-proxy/0.log"
Jul 09 15:37:44.918961 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:44.918931    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8d68d4884-swz9s_904241fe-9e22-47b8-beca-a9df45ab3f25/kube-auth-proxy/0.log"
Jul 09 15:37:44.931117 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:44.931088    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-sg8r9_95ebf602-4df7-4fed-b4cf-d65a2623f6f3/openshift-lws-operator/0.log"
Jul 09 15:37:44.942175 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:44.942156    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-mjlqx_85ae6aa9-f89f-4a61-9630-9f6b2b82910d/istio-proxy/0.log"
Jul 09 15:37:44.971211 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:44.971151    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-mjlqx_85ae6aa9-f89f-4a61-9630-9f6b2b82910d/istio-proxy/1.log"
Jul 09 15:37:45.003577 ip-10-0-137-94 kubenswrapper[2575]: I0709 15:37:45.003552    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-qx6fv_122b7856-6300-4e91-92e9-9fc7555df6ce/payload-pre-processing/0.log"