Jul 15 15:22:21.279177 ip-10-0-138-107 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 15 15:22:21.279189 ip-10-0-138-107 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 15 15:22:21.279195 ip-10-0-138-107 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 15 15:22:21.279441 ip-10-0-138-107 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 15 15:22:31.463984 ip-10-0-138-107 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 15 15:22:31.464000 ip-10-0-138-107 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 8bea01b38d3f432c87953c55e8f8df88 --
Jul 15 15:24:28.495023 ip-10-0-138-107 systemd[1]: Starting Kubernetes Kubelet...
Jul 15 15:24:28.972247 ip-10-0-138-107 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 15:24:28.972247 ip-10-0-138-107 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 15 15:24:28.972247 ip-10-0-138-107 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 15:24:28.972247 ip-10-0-138-107 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 15 15:24:28.972247 ip-10-0-138-107 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 15:24:28.972247 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.881978    2564 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 15 15:24:28.972247 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886642    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 15:24:28.972247 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886654    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 15:24:28.972247 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886657    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 15:24:28.972247 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886660    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 15:24:28.972247 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886664    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 15:24:28.972247 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886667    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 15:24:28.972247 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886669    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 15:24:28.972247 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886672    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 15:24:28.945389 ip-10-0-138-107 systemd[1]: Started Kubernetes Kubelet.
Jul 15 15:24:28.973373 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886674    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 15:24:28.973373 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886678    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 15:24:28.973373 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886680    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 15:24:28.973373 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886683    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 15:24:28.973373 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886685    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 15:24:28.973373 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886688    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 15:24:28.973373 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886694    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 15:24:28.973373 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886697    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 15:24:28.973373 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886699    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 15:24:28.973373 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886703    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 15:24:28.973373 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886707    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 15:24:28.973373 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886710    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 15:24:28.973373 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886713    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 15:24:28.973373 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886716    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 15:24:28.973373 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886720    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 15:24:28.973373 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886722    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 15:24:28.973373 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886725    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 15:24:28.973373 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886728    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 15:24:28.973373 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886730    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 15:24:28.973373 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886732    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 15:24:28.974713 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886735    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 15:24:28.974713 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886738    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 15:24:28.974713 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886740    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 15:24:28.974713 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886743    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 15:24:28.974713 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886745    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 15:24:28.974713 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886748    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 15:24:28.974713 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886750    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 15:24:28.974713 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886753    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 15:24:28.974713 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886771    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 15:24:28.974713 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886776    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 15:24:28.974713 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886779    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 15:24:28.974713 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886782    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 15:24:28.974713 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886785    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 15:24:28.974713 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886788    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 15:24:28.974713 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886790    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 15:24:28.974713 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886793    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 15:24:28.974713 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886796    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 15:24:28.974713 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886799    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 15:24:28.974713 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886801    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 15:24:28.977165 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886805    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 15:24:28.977165 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886807    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 15:24:28.977165 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886810    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 15:24:28.977165 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886813    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 15:24:28.977165 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886815    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 15:24:28.977165 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886818    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 15:24:28.977165 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886821    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 15:24:28.977165 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886823    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 15:24:28.977165 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886826    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 15:24:28.977165 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886828    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 15:24:28.977165 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886831    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 15:24:28.977165 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886833    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 15:24:28.977165 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886836    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 15:24:28.977165 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886840    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 15:24:28.977165 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886842    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 15:24:28.977165 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886845    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 15:24:28.977165 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886847    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 15:24:28.977165 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886850    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 15:24:28.977165 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886853    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 15:24:28.977165 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886856    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 15:24:28.978788 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886858    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 15:24:28.978788 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886861    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 15:24:28.978788 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886863    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 15:24:28.978788 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886866    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 15:24:28.978788 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886868    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 15:24:28.978788 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886871    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 15:24:28.978788 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886873    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 15:24:28.978788 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886876    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 15:24:28.978788 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886878    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 15:24:28.978788 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886881    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 15:24:28.978788 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886883    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 15:24:28.978788 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886886    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 15:24:28.978788 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886888    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 15:24:28.978788 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886891    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 15:24:28.978788 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886896    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 15:24:28.978788 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886899    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 15:24:28.978788 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886902    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 15:24:28.978788 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886906    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 15:24:28.978788 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886909    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 15:24:28.980594 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886911    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 15:24:28.980594 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886914    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 15:24:28.980594 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886917    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 15:24:28.980594 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886920    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 15:24:28.980594 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886923    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 15:24:28.980594 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886925    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 15:24:28.980594 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886929    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 15:24:28.980594 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886932    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 15:24:28.980594 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886934    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 15:24:28.980594 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886937    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 15:24:28.980594 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886940    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 15:24:28.980594 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886943    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 15:24:28.980594 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.886946    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 15:24:28.980594 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887659    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 15:24:28.980594 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887666    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 15:24:28.980594 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887669    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 15:24:28.980594 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887673    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 15:24:28.980594 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887676    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 15:24:28.980594 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887679    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 15:24:28.980594 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887681    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 15:24:28.980594 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887684    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 15:24:28.982048 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887686    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 15:24:28.982048 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887689    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 15:24:28.982048 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887691    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 15:24:28.982048 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887694    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 15:24:28.982048 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887696    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 15:24:28.982048 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887699    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 15:24:28.982048 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887702    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 15:24:28.982048 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887706    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 15:24:28.982048 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887708    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 15:24:28.982048 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887712    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 15:24:28.982048 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887716    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 15:24:28.982048 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887719    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 15:24:28.982048 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887722    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 15:24:28.982048 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887725    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 15:24:28.982048 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887727    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 15:24:28.982048 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887730    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 15:24:28.982048 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887734    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 15:24:28.982048 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887737    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 15:24:28.982048 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887740    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 15:24:28.983116 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887743    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 15:24:28.983116 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887746    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 15:24:28.983116 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887748    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 15:24:28.983116 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887750    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 15:24:28.983116 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887753    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 15:24:28.983116 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887774    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 15:24:28.983116 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887777    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 15:24:28.983116 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887780    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 15:24:28.983116 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887784    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 15:24:28.983116 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887787    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 15:24:28.983116 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887790    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 15:24:28.983116 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887792    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 15:24:28.983116 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887795    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 15:24:28.983116 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887798    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 15:24:28.983116 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887800    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 15:24:28.983116 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887803    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 15:24:28.983116 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887805    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 15:24:28.983116 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887808    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 15:24:28.983116 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887811    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 15:24:28.985464 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887814    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 15:24:28.985464 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887817    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 15:24:28.985464 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887820    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 15:24:28.985464 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887822    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 15:24:28.985464 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887825    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 15:24:28.985464 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887827    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 15:24:28.985464 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887830    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 15:24:28.985464 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887833    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 15:24:28.985464 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887835    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 15:24:28.985464 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887838    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 15:24:28.985464 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887841    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 15:24:28.985464 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887843    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 15:24:28.985464 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887846    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 15:24:28.985464 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887848    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 15:24:28.985464 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887852    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 15:24:28.985464 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887854    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 15:24:28.985464 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887857    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 15:24:28.985464 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887859    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 15:24:28.985464 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887862    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 15:24:28.985464 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887864    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 15:24:28.987606 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887867    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 15:24:28.987606 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887869    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 15:24:28.987606 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887872    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 15:24:28.987606 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887875    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 15:24:28.987606 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887877    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 15:24:28.987606 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887880    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 15:24:28.987606 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887884    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 15:24:28.987606 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887887    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 15:24:28.987606 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887889    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 15:24:28.987606 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887892    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 15:24:28.987606 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887895    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 15:24:28.987606 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887897    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 15:24:28.987606 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887900    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 15:24:28.987606 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887902    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 15:24:28.987606 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887905    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 15:24:28.987606 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887907    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 15:24:28.987606 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887910    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 15:24:28.987606 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887913    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 15:24:28.987606 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887916    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 15:24:28.987606 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887920    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 15:24:28.988980 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887922    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 15:24:28.988980 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887925    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 15:24:28.988980 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887929    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 15:24:28.988980 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887932    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 15:24:28.988980 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887934    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 15:24:28.988980 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887937    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 15:24:28.988980 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887939    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 15:24:28.988980 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887942    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 15:24:28.988980 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887944    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 15:24:28.988980 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887947    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 15:24:28.988980 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887949    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 15:24:28.988980 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887952    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 15:24:28.988980 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.887954    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 15:24:28.988980 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888325    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 15:24:28.988980 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888330    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 15:24:28.988980 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888333    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 15:24:28.988980 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888336    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 15:24:28.988980 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888339    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 15:24:28.988980 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888342    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 15:24:28.988980 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888349    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 15:24:28.990015 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888352    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 15:24:28.990015 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888355    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 15:24:28.990015 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888357    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 15:24:28.990015 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888360    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 15:24:28.990015 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888362    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 15:24:28.990015 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888365    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 15:24:28.990015 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888368    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 15:24:28.990015 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888371    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 15:24:28.990015 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888373    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 15:24:28.990015 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888376    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 15:24:28.990015 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888378    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 15:24:28.990015 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888381    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 15:24:28.990015 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888383    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 15:24:28.990015 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888386    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 15:24:28.990015 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888389    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 15:24:28.990015 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888392    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 15:24:28.990015 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888395    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 15:24:28.990015 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888397    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 15:24:28.990015 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888400    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 15:24:28.990015 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888403    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 15:24:28.992056 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888405    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 15:24:28.992056 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888408    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 15:24:28.992056 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888410    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 15:24:28.992056 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888413    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 15:24:28.992056 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888417    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 15:24:28.992056 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888420    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 15:24:28.992056 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888422    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 15:24:28.992056 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888424    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 15:24:28.992056 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888427    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 15:24:28.992056 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888429    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 15:24:28.992056 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888432    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 15:24:28.992056 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888435    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 15:24:28.992056 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888438    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 15:24:28.992056 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888440    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 15:24:28.992056 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888443    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 15:24:28.992056 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888445    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 15:24:28.992056 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888448    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 15:24:28.992056 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888450    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 15:24:28.992056 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888452    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 15:24:28.992056 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888456    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 15:24:28.993075 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888458    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 15:24:28.993075 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888461    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 15:24:28.993075 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888463    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 15:24:28.993075 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888466    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 15:24:28.993075 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888469    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 15:24:28.993075 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888472    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 15:24:28.993075 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888474    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 15:24:28.993075 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888477    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 15:24:28.993075 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888479    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 15:24:28.993075 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888481    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 15:24:28.993075 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888486    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 15:24:28.993075 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888489    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 15:24:28.993075 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888492    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 15:24:28.993075 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888495    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 15:24:28.993075 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888497    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 15:24:28.993075 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888501    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 15:24:28.993075 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888505    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 15:24:28.993075 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888507    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 15:24:28.993075 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888510    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 15:24:28.993963 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888512    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 15:24:28.993963 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888515    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 15:24:28.993963 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888517    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 15:24:28.993963 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888520    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 15:24:28.993963 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888523    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 15:24:28.993963 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888526    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 15:24:28.993963 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888528    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 15:24:28.993963 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888531    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 15:24:28.993963 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888533    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 15:24:28.993963 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888536    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 15:24:28.993963 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888538    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 15:24:28.993963 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888543    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 15:24:28.993963 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888546    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 15:24:28.993963 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888549    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 15:24:28.993963 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888552    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 15:24:28.993963 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888555    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 15:24:28.993963 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888558    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 15:24:28.993963 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888561    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 15:24:28.993963 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888564    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 15:24:28.993963 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888566    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 15:24:28.994662 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888570    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 15:24:28.994662 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888574    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 15:24:28.994662 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888576    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 15:24:28.994662 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888579    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 15:24:28.994662 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888581    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 15:24:28.994662 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888584    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 15:24:28.994662 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888586    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 15:24:28.994662 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888589    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 15:24:28.994662 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888591    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 15:24:28.994662 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888595    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 15:24:28.994662 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888597    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 15:24:28.994662 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888600    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 15:24:28.994662 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.888602    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 15:24:28.994662 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888668    2564 flags.go:64] FLAG: --address="0.0.0.0"
Jul 15 15:24:28.994662 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888675    2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 15 15:24:28.994662 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888680    2564 flags.go:64] FLAG: --anonymous-auth="true"
Jul 15 15:24:28.994662 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888687    2564 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 15 15:24:28.994662 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888692    2564 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 15 15:24:28.994662 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888697    2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 15 15:24:28.994662 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888703    2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 15 15:24:28.994662 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888709    2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 15 15:24:28.995496 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888713    2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 15 15:24:28.995496 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888718    2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 15 15:24:28.995496 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888721    2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 15 15:24:28.995496 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888724    2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 15 15:24:28.995496 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888727    2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 15 15:24:28.995496 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888732    2564 flags.go:64] FLAG: --cgroup-root=""
Jul 15 15:24:28.995496 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888735    2564 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 15 15:24:28.995496 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888738    2564 flags.go:64] FLAG: --client-ca-file=""
Jul 15 15:24:28.995496 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888740    2564 flags.go:64] FLAG: --cloud-provider="external"
Jul 15 15:24:28.995496 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888743    2564 flags.go:64] FLAG: --cluster-dns="[]"
Jul 15 15:24:28.995496 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888748    2564 flags.go:64] FLAG: --cluster-domain=""
Jul 15 15:24:28.995496 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888751    2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 15 15:24:28.995496 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888754    2564 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 15 15:24:28.995496 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888769    2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 15 15:24:28.995496 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888772    2564 flags.go:64] FLAG: --container-log-max-files="5"
Jul 15 15:24:28.995496 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888777    2564 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 15 15:24:28.995496 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888780    2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 15 15:24:28.995496 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888782    2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 15 15:24:28.995496 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888786    2564 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 15 15:24:28.995496 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888789    2564 flags.go:64] FLAG: --contention-profiling="false"
Jul 15 15:24:28.995496 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888794    2564 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 15 15:24:28.995496 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888797    2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 15 15:24:28.995496 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888800    2564 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 15 15:24:28.995496 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888803    2564 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 15 15:24:28.997490 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888807    2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 15 15:24:28.997490 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888810    2564 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 15 15:24:28.997490 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888813    2564 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 15 15:24:28.997490 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888817    2564 flags.go:64] FLAG: --enable-load-reader="false"
Jul 15 15:24:28.997490 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888820    2564 flags.go:64] FLAG: --enable-server="true"
Jul 15 15:24:28.997490 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888823    2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 15 15:24:28.997490 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888827    2564 flags.go:64] FLAG: --event-burst="100"
Jul 15 15:24:28.997490 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888830    2564 flags.go:64] FLAG: --event-qps="50"
Jul 15 15:24:28.997490 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888833    2564 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 15 15:24:28.997490 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888836    2564 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 15 15:24:28.997490 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888838    2564 flags.go:64] FLAG: --eviction-hard=""
Jul 15 15:24:28.997490 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888842    2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 15 15:24:28.997490 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888845    2564 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 15 15:24:28.997490 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888847    2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 15 15:24:28.997490 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888851    2564 flags.go:64] FLAG: --eviction-soft=""
Jul 15 15:24:28.997490 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888855    2564 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 15 15:24:28.997490 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888857    2564 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 15 15:24:28.997490 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888860    2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 15 15:24:28.997490 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888863    2564 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 15 15:24:28.997490 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888866    2564 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 15 15:24:28.997490 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888869    2564 flags.go:64] FLAG: --fail-swap-on="true"
Jul 15 15:24:28.997490 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888872    2564 flags.go:64] FLAG: --feature-gates=""
Jul 15 15:24:28.997490 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888875    2564 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 15 15:24:28.997490 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888878    2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 15 15:24:28.997490 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888881    2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 15 15:24:28.999121 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888884    2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 15 15:24:28.999121 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888887    2564 flags.go:64] FLAG: --healthz-port="10248"
Jul 15 15:24:28.999121 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888890    2564 flags.go:64] FLAG: --help="false"
Jul 15 15:24:28.999121 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888894    2564 flags.go:64] FLAG: --hostname-override="ip-10-0-138-107.ec2.internal"
Jul 15 15:24:28.999121 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888897    2564 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 15 15:24:28.999121 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888900    2564 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 15 15:24:28.999121 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888903    2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 15 15:24:28.999121 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888906    2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 15 15:24:28.999121 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888909    2564 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 15 15:24:28.999121 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888912    2564 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 15 15:24:28.999121 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888916    2564 flags.go:64] FLAG: --image-service-endpoint=""
Jul 15 15:24:28.999121 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888919    2564 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 15 15:24:28.999121 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888922    2564 flags.go:64] FLAG: --kube-api-burst="100"
Jul 15 15:24:28.999121 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888925    2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 15 15:24:28.999121 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888928    2564 flags.go:64] FLAG: --kube-api-qps="50"
Jul 15 15:24:28.999121 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888930    2564 flags.go:64] FLAG: --kube-reserved=""
Jul 15 15:24:28.999121 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888933    2564 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 15 15:24:28.999121 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888936    2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 15 15:24:28.999121 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888939    2564 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 15 15:24:28.999121 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888941    2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 15 15:24:28.999121 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888944    2564 flags.go:64] FLAG: --lock-file=""
Jul 15 15:24:28.999121 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888947    2564 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 15 15:24:28.999121 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888950    2564 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 15 15:24:28.999121 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888953    2564 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 15 15:24:29.001083 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888958    2564 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 15 15:24:29.001083 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888961    2564 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 15 15:24:29.001083 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888964    2564 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 15 15:24:29.001083 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888966    2564 flags.go:64] FLAG: --logging-format="text"
Jul 15 15:24:29.001083 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888969    2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 15 15:24:29.001083 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888972    2564 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 15 15:24:29.001083 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888975    2564 flags.go:64] FLAG: --manifest-url=""
Jul 15 15:24:29.001083 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888978    2564 flags.go:64] FLAG: --manifest-url-header=""
Jul 15 15:24:29.001083 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888982    2564 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 15 15:24:29.001083 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888985    2564 flags.go:64] FLAG: --max-open-files="1000000"
Jul 15 15:24:29.001083 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888989    2564 flags.go:64] FLAG: --max-pods="110"
Jul 15 15:24:29.001083 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888993    2564 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 15 15:24:29.001083 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888996    2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 15 15:24:29.001083 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.888999    2564 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 15 15:24:29.001083 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.889002    2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 15 15:24:29.001083 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.889004    2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 15 15:24:29.001083 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.889007    2564 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 15 15:24:29.001083 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.889010    2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 15 15:24:29.001083 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.889018    2564 flags.go:64] FLAG: --node-status-max-images="50"
Jul 15 15:24:29.001083 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.889021    2564 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 15 15:24:29.001083 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.889024    2564 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 15 15:24:29.001083 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.889027    2564 flags.go:64] FLAG: --pod-cidr=""
Jul 15 15:24:29.001083 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.889029    2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 15 15:24:29.004357 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.889035    2564 flags.go:64] FLAG: --pod-manifest-path=""
Jul 15 15:24:29.004357 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.889038    2564 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 15 15:24:29.004357 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.889041    2564 flags.go:64] FLAG: --pods-per-core="0"
Jul 15 15:24:29.004357 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.889044    2564 flags.go:64] FLAG: --port="10250"
Jul 15 15:24:29.004357 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.889047    2564 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 15 15:24:29.004357 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.889050    2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0bf4a45a2ae5ffb4d"
Jul 15 15:24:29.004357 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.889053    2564 flags.go:64] FLAG: --qos-reserved=""
Jul 15 15:24:29.004357 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.889056    2564 flags.go:64] FLAG: --read-only-port="10255"
Jul 15 15:24:29.004357 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.889059    2564 flags.go:64] FLAG: --register-node="true"
Jul 15 15:24:29.004357 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.889062    2564 flags.go:64] FLAG: --register-with-taints=""
Jul 15 15:24:29.004357 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.889071    2564 flags.go:64] FLAG: --registry-burst="10"
Jul 15 15:24:29.004357 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.889073    2564 flags.go:64] FLAG: --registry-qps="5"
Jul 15 15:24:29.004357 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.889076    2564 flags.go:64] FLAG: --reserved-cpus=""
Jul 15 15:24:29.004357 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.889079    2564 flags.go:64] FLAG: --reserved-memory=""
Jul 15 15:24:29.004357 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.889082    2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 15 15:24:29.004357 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.889085    2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 15 15:24:29.004357 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.889088    2564 flags.go:64] FLAG: --rotate-certificates="false"
Jul 15 15:24:29.004357 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.889091    2564 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 15 15:24:29.004357 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.889094    2564 flags.go:64] FLAG: --runonce="false"
Jul 15 15:24:29.004357 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.889097    2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 15 15:24:29.004357 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.889101    2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 15 15:24:29.004357 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.889104    2564 flags.go:64] FLAG: --seccomp-default="false"
Jul 15 15:24:29.004357 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.889106    2564 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 15 15:24:29.004357 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.889109    2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 15 15:24:29.004357 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.889112    2564 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 15 15:24:29.004357 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.889115    2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 15 15:24:29.005153 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.889118    2564 flags.go:64] FLAG: --storage-driver-password="root"
Jul 15 15:24:29.005153 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.889120    2564 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 15 15:24:29.005153 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.889125    2564 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 15 15:24:29.005153 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.889128    2564 flags.go:64] FLAG: --storage-driver-user="root"
Jul 15 15:24:29.005153 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.889131    2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 15 15:24:29.005153 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.889134    2564 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 15 15:24:29.005153 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.889137    2564 flags.go:64] FLAG: --system-cgroups=""
Jul 15 15:24:29.005153 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.889139    2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 15 15:24:29.005153 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.889145    2564 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 15 15:24:29.005153 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.889147    2564 flags.go:64] FLAG: --tls-cert-file=""
Jul 15 15:24:29.005153 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.889150    2564 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 15 15:24:29.005153 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.889154    2564 flags.go:64] FLAG: --tls-min-version=""
Jul 15 15:24:29.005153 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.889157    2564 flags.go:64] FLAG: --tls-private-key-file=""
Jul 15 15:24:29.005153 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.889160    2564 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 15 15:24:29.005153 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.889162    2564 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 15 15:24:29.005153 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.889166    2564 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 15 15:24:29.005153 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.889169    2564 flags.go:64] FLAG: --v="2"
Jul 15 15:24:29.005153 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.889172    2564 flags.go:64] FLAG: --version="false"
Jul 15 15:24:29.005153 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.889176    2564 flags.go:64] FLAG: --vmodule=""
Jul 15 15:24:29.005153 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.889180    2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 15 15:24:29.005153 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.889183    2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 15 15:24:29.005153 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889289    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 15:24:29.005153 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889292    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 15:24:29.005153 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889295    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 15:24:29.006654 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889298    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 15:24:29.006654 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889300    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 15:24:29.006654 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889304    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 15:24:29.006654 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889307    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 15:24:29.006654 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889309    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 15:24:29.006654 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889312    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 15:24:29.006654 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889315    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 15:24:29.006654 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889318    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 15:24:29.006654 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889320    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 15:24:29.006654 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889323    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 15:24:29.006654 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889327    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 15:24:29.006654 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889329    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 15:24:29.006654 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889333    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 15:24:29.006654 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889335    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 15:24:29.006654 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889338    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 15:24:29.006654 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889340    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 15:24:29.006654 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889343    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 15:24:29.006654 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889345    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 15:24:29.006654 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889348    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 15:24:29.006654 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889350    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 15:24:29.007277 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889354    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 15:24:29.007277 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889358    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 15:24:29.007277 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889361    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 15:24:29.007277 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889364    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 15:24:29.007277 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889367    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 15:24:29.007277 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889370    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 15:24:29.007277 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889372    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 15:24:29.007277 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889375    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 15:24:29.007277 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889378    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 15:24:29.007277 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889380    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 15:24:29.007277 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889382    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 15:24:29.007277 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889385    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 15:24:29.007277 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889387    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 15:24:29.007277 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889390    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 15:24:29.007277 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889393    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 15:24:29.007277 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889396    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 15:24:29.007277 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889398    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 15:24:29.007277 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889401    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 15:24:29.007277 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889404    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 15:24:29.007277 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889406    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 15:24:29.007949 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889409    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 15:24:29.007949 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889411    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 15:24:29.007949 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889416    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 15:24:29.007949 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889420    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 15:24:29.007949 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889423    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 15:24:29.007949 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889425    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 15:24:29.007949 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889428    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 15:24:29.007949 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889430    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 15:24:29.007949 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889433    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 15:24:29.007949 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889435    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 15:24:29.007949 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889438    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 15:24:29.007949 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889440    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 15:24:29.007949 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889443    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 15:24:29.007949 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889445    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 15:24:29.007949 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889448    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 15:24:29.007949 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889450    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 15:24:29.007949 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889453    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 15:24:29.007949 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889456    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 15:24:29.007949 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889458    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 15:24:29.277661 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889461    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 15:24:29.277661 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889464    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 15:24:29.277661 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889466    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 15:24:29.277661 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889469    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 15:24:29.277661 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889471    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 15:24:29.277661 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889474    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 15:24:29.277661 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889476    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 15:24:29.277661 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889480    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 15:24:29.277661 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889482    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 15:24:29.277661 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889485    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 15:24:29.277661 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889487    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 15:24:29.277661 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889490    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 15:24:29.277661 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889492    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 15:24:29.277661 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889494    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 15:24:29.277661 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889497    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 15:24:29.277661 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889501    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 15:24:29.277661 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889504    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 15:24:29.277661 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889506    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 15:24:29.277661 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889509    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 15:24:29.277661 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889512    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 15:24:29.294862 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889514    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 15:24:29.294862 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889517    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 15:24:29.294862 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889519    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 15:24:29.294862 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889522    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 15:24:29.294862 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889524    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 15:24:29.294862 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889527    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 15:24:29.294862 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889529    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 15:24:29.294862 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889532    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 15:24:29.294862 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889534    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 15:24:29.294862 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889538    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 15:24:29.294862 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889541    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 15:24:29.294862 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889545    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 15:24:29.294862 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889548    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 15:24:29.294862 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889550    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 15:24:29.294862 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889553    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 15:24:29.294862 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889555    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 15:24:29.294862 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.889558    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 15:24:29.295479 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.890365    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 15:24:29.295479 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.897073    2564 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 15 15:24:29.295479 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.897089    2564 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 15 15:24:29.295479 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.897105    2564 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 15 15:24:29.295479 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.897116    2564 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 15 15:24:29.295479 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897187    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 15:24:29.295479 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897193    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 15:24:29.295479 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897200    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 15:24:29.295479 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897205    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 15:24:29.295479 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897211    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 15:24:29.295479 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897215    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 15:24:29.295479 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897221    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 15:24:29.295479 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897226    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 15:24:29.295479 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897231    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 15:24:29.295984 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897235    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 15:24:29.295984 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897239    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 15:24:29.295984 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897243    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 15:24:29.295984 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897247    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 15:24:29.295984 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897250    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 15:24:29.295984 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897254    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 15:24:29.295984 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897261    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 15:24:29.295984 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897268    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 15:24:29.295984 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897272    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 15:24:29.295984 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897277    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 15:24:29.295984 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897281    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 15:24:29.295984 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897286    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 15:24:29.295984 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897291    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 15:24:29.295984 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897296    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 15:24:29.295984 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897300    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 15:24:29.295984 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897304    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 15:24:29.295984 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897308    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 15:24:29.295984 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897312    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 15:24:29.295984 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897316    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 15:24:29.296607 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897321    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 15:24:29.296607 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897324    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 15:24:29.296607 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897328    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 15:24:29.296607 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897332    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 15:24:29.296607 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897335    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 15:24:29.296607 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897339    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 15:24:29.296607 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897344    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 15:24:29.296607 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897348    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 15:24:29.296607 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897351    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 15:24:29.296607 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897355    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 15:24:29.296607 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897359    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 15:24:29.296607 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897362    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 15:24:29.296607 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897366    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 15:24:29.296607 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897371    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 15:24:29.296607 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897375    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 15:24:29.296607 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897378    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 15:24:29.296607 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897382    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 15:24:29.296607 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897386    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 15:24:29.296607 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897390    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 15:24:29.296607 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897396    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 15:24:29.297170 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897400    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 15:24:29.297170 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897403    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 15:24:29.297170 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897407    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 15:24:29.297170 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897411    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 15:24:29.297170 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897415    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 15:24:29.297170 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897419    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 15:24:29.297170 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897424    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 15:24:29.297170 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897428    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 15:24:29.297170 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897431    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 15:24:29.297170 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897435    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 15:24:29.297170 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897439    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 15:24:29.297170 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897443    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 15:24:29.297170 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897446    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 15:24:29.297170 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897450    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 15:24:29.297170 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897454    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 15:24:29.297170 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897457    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 15:24:29.297170 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897461    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 15:24:29.297170 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897466    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 15:24:29.297170 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897470    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 15:24:29.297170 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897473    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 15:24:29.297736 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897477    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 15:24:29.297736 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897483    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 15:24:29.297736 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897487    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 15:24:29.297736 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897491    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 15:24:29.297736 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897495    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 15:24:29.297736 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897498    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 15:24:29.297736 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897502    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 15:24:29.297736 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897505    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 15:24:29.297736 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897509    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 15:24:29.297736 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897513    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 15:24:29.297736 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897516    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 15:24:29.297736 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897523    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 15:24:29.297736 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897527    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 15:24:29.297736 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897531    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 15:24:29.297736 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897536    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 15:24:29.297736 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897539    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 15:24:29.297736 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897543    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 15:24:29.297736 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897547    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 15:24:29.297736 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897550    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 15:24:29.297736 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897555    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 15:24:29.298303 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897558    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 15:24:29.298303 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897562    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 15:24:29.298303 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897565    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 15:24:29.298303 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897569    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 15:24:29.298303 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897573    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 15:24:29.298303 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897577    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 15:24:29.298303 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897581    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 15:24:29.298303 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897584    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 15:24:29.298303 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897588    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 15:24:29.298303 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897592    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 15:24:29.298303 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897596    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 15:24:29.298303 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.897603    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 15:24:29.298303 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897747    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 15:24:29.298303 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897756    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 15:24:29.298743 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897774    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 15:24:29.298743 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897779    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 15:24:29.298743 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897784    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 15:24:29.298743 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897788    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 15:24:29.298743 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897792    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 15:24:29.298743 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897795    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 15:24:29.298743 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897799    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 15:24:29.298743 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897803    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 15:24:29.298743 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897807    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 15:24:29.298743 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897811    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 15:24:29.298743 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897816    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 15:24:29.298743 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897820    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 15:24:29.298743 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897843    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 15:24:29.298743 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897849    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 15:24:29.298743 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897853    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 15:24:29.298743 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897857    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 15:24:29.298743 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897862    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 15:24:29.298743 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897866    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 15:24:29.298743 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897871    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 15:24:29.298743 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897874    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 15:24:29.299304 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897878    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 15:24:29.299304 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897882    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 15:24:29.299304 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897885    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 15:24:29.299304 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897891    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 15:24:29.299304 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897895    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 15:24:29.299304 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897898    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 15:24:29.299304 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897902    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 15:24:29.299304 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897906    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 15:24:29.299304 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897910    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 15:24:29.299304 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897914    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 15:24:29.299304 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897917    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 15:24:29.299304 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897923    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 15:24:29.299304 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897927    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 15:24:29.299304 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897932    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 15:24:29.299304 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897937    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 15:24:29.299304 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897941    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 15:24:29.299304 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897945    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 15:24:29.299304 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897949    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 15:24:29.299304 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897953    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 15:24:29.299867 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897957    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 15:24:29.299867 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897961    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 15:24:29.299867 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897966    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 15:24:29.299867 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897972    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 15:24:29.299867 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897975    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 15:24:29.299867 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897980    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 15:24:29.299867 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897983    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 15:24:29.299867 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897987    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 15:24:29.299867 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897991    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 15:24:29.299867 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897995    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 15:24:29.299867 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.897999    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 15:24:29.299867 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.898003    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 15:24:29.299867 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.898009    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 15:24:29.299867 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.898014    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 15:24:29.299867 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.898019    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 15:24:29.299867 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.898022    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 15:24:29.299867 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.898026    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 15:24:29.299867 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.898030    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 15:24:29.299867 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.898033    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 15:24:29.300394 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.898037    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 15:24:29.300394 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.898041    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 15:24:29.300394 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.898046    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 15:24:29.300394 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.898049    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 15:24:29.300394 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.898053    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 15:24:29.300394 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.898057    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 15:24:29.300394 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.898061    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 15:24:29.300394 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.898065    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 15:24:29.300394 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.898069    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 15:24:29.300394 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.898072    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 15:24:29.300394 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.898076    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 15:24:29.300394 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.898079    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 15:24:29.300394 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.898083    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 15:24:29.300394 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.898086    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 15:24:29.300394 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.898090    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 15:24:29.300394 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.898094    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 15:24:29.300394 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.898099    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 15:24:29.300394 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.898102    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 15:24:29.300394 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.898106    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 15:24:29.300394 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.898110    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 15:24:29.300987 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.898114    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 15:24:29.300987 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.898118    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 15:24:29.300987 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.898121    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 15:24:29.300987 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.898125    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 15:24:29.300987 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.898129    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 15:24:29.300987 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.898132    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 15:24:29.300987 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.898136    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 15:24:29.300987 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.898140    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 15:24:29.300987 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.898144    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 15:24:29.300987 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.898148    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 15:24:29.300987 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.898152    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 15:24:29.300987 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.898155    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 15:24:29.300987 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.898158    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 15:24:29.300987 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.898162    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 15:24:29.300987 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.898166    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 15:24:29.300987 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.898170    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 15:24:29.300987 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.898173    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 15:24:29.300987 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.898178    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 15:24:29.300987 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:28.898181    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 15:24:29.301492 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.898188    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 15:24:29.301492 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.898305    2564 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 15 15:24:29.301492 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.900435    2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 15 15:24:29.301492 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.901672    2564 server.go:1019] "Starting client certificate rotation"
Jul 15 15:24:29.301492 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.901775    2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 15 15:24:29.301492 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.901816    2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 15 15:24:29.301492 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.906158    2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 15 15:24:29.301492 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.907974    2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 15 15:24:29.301492 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.916842    2564 log.go:25] "Validated CRI v1 runtime API"
Jul 15 15:24:29.301492 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.919693    2564 log.go:25] "Validated CRI v1 image API"
Jul 15 15:24:29.301492 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.921121    2564 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 15 15:24:29.301492 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.923935    2564 fs.go:135] Filesystem UUIDs: map[21daf007-26d9-4ef5-8f23-97eaded57723:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 acdb2021-bc5e-4e5b-8acd-ccb663c2523d:/dev/nvme0n1p4]
Jul 15 15:24:29.301888 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.923955    2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 15 15:24:29.301963 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.929281    2564 manager.go:216] Machine: {Timestamp:2026-07-15 15:24:28.927509218 +0000 UTC m=+0.313661684 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102314 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec273a8f1c1bbf4bdf88548e1814fc00 SystemUUID:ec273a8f-1c1b-bf4b-df88-548e1814fc00 BootID:8bea01b3-8d3f-432c-8795-3c55e8f8df88 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:28:16:7f:b2:07 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:28:16:7f:b2:07 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:e6:92:7f:1d:f7:20 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 15 15:24:29.301963 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.929371    2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 15 15:24:29.301963 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.929432    2564 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 15 15:24:29.301963 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.931049    2564 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 15 15:24:29.301963 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.931072    2564 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-107.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 15 15:24:29.301963 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.931847    2564 topology_manager.go:138] "Creating topology manager with none policy"
Jul 15 15:24:29.301963 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.931856    2564 container_manager_linux.go:309] "Creating device plugin manager"
Jul 15 15:24:29.301963 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.931863    2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 15 15:24:29.302268 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.932242    2564 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 15 15:24:29.302268 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.933257    2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 15 15:24:29.302268 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.933316    2564 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 15 15:24:29.302268 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.935858    2564 state_mem.go:36] "Initialized new in-memory state store"
Jul 15 15:24:29.302268 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.935974    2564 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 15 15:24:29.302268 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.935999    2564 kubelet.go:486] "Attempting to sync node with API server"
Jul 15 15:24:29.302268 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.936008    2564 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 15 15:24:29.302268 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.936021    2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 15 15:24:29.302268 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.936029    2564 kubelet.go:398] "Adding apiserver pod source"
Jul 15 15:24:29.302268 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.936037    2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 15 15:24:29.302268 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.936306    2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 15 15:24:29.302268 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.936324    2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 15 15:24:29.302268 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.938860    2564 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 15 15:24:29.302268 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.940512    2564 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 15 15:24:29.302268 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.940538    2564 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 15 15:24:29.302268 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.940675    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 15 15:24:29.302268 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.940687    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 15 15:24:29.302268 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.940692    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 15 15:24:29.302268 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.940698    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 15 15:24:29.302268 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.940706    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 15 15:24:29.302268 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.940711    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 15 15:24:29.302268 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.941168    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 15 15:24:29.302268 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.941175    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 15 15:24:29.302268 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.941180    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 15 15:24:29.302268 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.941185    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 15 15:24:29.302268 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.941194    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 15 15:24:29.302268 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.941201    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 15 15:24:29.302268 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.941887    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 15 15:24:29.302268 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.941894    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 15 15:24:29.302268 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.944676    2564 server.go:1268] "Started kubelet"
Jul 15 15:24:29.302268 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.944777    2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 15 15:24:29.302268 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.944744    2564 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 15 15:24:29.302268 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.944979    2564 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 15 15:24:29.302268 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.946045    2564 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 15 15:24:29.302268 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.946622    2564 server.go:310] "Adding debug handlers to kubelet server"
Jul 15 15:24:29.302268 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:28.948970    2564 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 15 15:24:29.302268 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.950276    2564 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-107.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 15 15:24:29.302268 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:28.950284    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-107.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 15 15:24:29.302268 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:28.950313    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 15 15:24:29.303708 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:28.950226    2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-107.ec2.internal.18c27fef7be4f695  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-107.ec2.internal,UID:ip-10-0-138-107.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-107.ec2.internal,},FirstTimestamp:2026-07-15 15:24:28.944651925 +0000 UTC m=+0.330804390,LastTimestamp:2026-07-15 15:24:28.944651925 +0000 UTC m=+0.330804390,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-107.ec2.internal,}"
Jul 15 15:24:29.303708 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.952424    2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 15 15:24:29.303708 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.952437    2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 15 15:24:29.303708 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:28.953334    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-107.ec2.internal\" not found"
Jul 15 15:24:29.303708 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.953570    2564 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 15 15:24:29.303708 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.953588    2564 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 15 15:24:29.303708 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.953779    2564 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 15 15:24:29.303708 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.953921    2564 reconstruct.go:97] "Volume reconstruction finished"
Jul 15 15:24:29.303708 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.953964    2564 reconciler.go:29] "Reconciler: start to sync state"
Jul 15 15:24:29.303708 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.955001    2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 15 15:24:29.303708 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.955015    2564 factory.go:55] Registering systemd factory
Jul 15 15:24:29.303708 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.955025    2564 factory.go:223] Registration of the systemd container factory successfully
Jul 15 15:24:29.303708 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.955259    2564 factory.go:153] Registering CRI-O factory
Jul 15 15:24:29.303708 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.955273    2564 factory.go:223] Registration of the crio container factory successfully
Jul 15 15:24:29.303708 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.955294    2564 factory.go:103] Registering Raw factory
Jul 15 15:24:29.303708 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.955311    2564 manager.go:1196] Started watching for new ooms in manager
Jul 15 15:24:29.303708 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:28.955911    2564 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-107.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 15 15:24:29.303708 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:28.956017    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 15 15:24:29.303708 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.956125    2564 manager.go:349] Starting recovery of all containers
Jul 15 15:24:29.303708 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.966327    2564 manager.go:354] Recovery completed
Jul 15 15:24:29.303708 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.972031    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 15:24:29.303708 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.973905    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-107.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 15:24:29.303708 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.973938    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-107.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 15:24:29.303708 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.973954    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-107.ec2.internal" event="NodeHasSufficientPID"
Jul 15 15:24:29.303708 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.975066    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 15:24:29.303708 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.975068    2564 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 15 15:24:29.303708 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.975080    2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 15 15:24:29.303708 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.975096    2564 state_mem.go:36] "Initialized new in-memory state store"
Jul 15 15:24:29.303708 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.975725    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-107.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 15:24:29.303708 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.975751    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-107.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 15:24:29.303708 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.975792    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-107.ec2.internal" event="NodeHasSufficientPID"
Jul 15 15:24:29.305154 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:28.976085    2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-107.ec2.internal.18c27fef7da38f39  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-107.ec2.internal,UID:ip-10-0-138-107.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-107.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-107.ec2.internal,},FirstTimestamp:2026-07-15 15:24:28.973920057 +0000 UTC m=+0.360072533,LastTimestamp:2026-07-15 15:24:28.973920057 +0000 UTC m=+0.360072533,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-107.ec2.internal,}"
Jul 15 15:24:29.305154 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.976243    2564 policy_none.go:49] "None policy: Start"
Jul 15 15:24:29.305154 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.976258    2564 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 15 15:24:29.305154 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.976268    2564 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 15 15:24:29.305154 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:28.977401    2564 policy_none.go:47] "Start"
Jul 15 15:24:29.305154 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:28.985276    2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-107.ec2.internal.18c27fef7da3f3cb  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-107.ec2.internal,UID:ip-10-0-138-107.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-138-107.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-138-107.ec2.internal,},FirstTimestamp:2026-07-15 15:24:28.973945803 +0000 UTC m=+0.360098270,LastTimestamp:2026-07-15 15:24:28.973945803 +0000 UTC m=+0.360098270,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-107.ec2.internal,}"
Jul 15 15:24:29.305154 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:28.995886    2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-107.ec2.internal.18c27fef7da431fb  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-107.ec2.internal,UID:ip-10-0-138-107.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-138-107.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-138-107.ec2.internal,},FirstTimestamp:2026-07-15 15:24:28.973961723 +0000 UTC m=+0.360114189,LastTimestamp:2026-07-15 15:24:28.973961723 +0000 UTC m=+0.360114189,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-107.ec2.internal,}"
Jul 15 15:24:29.305154 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:29.008250    2564 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-138-107.ec2.internal.18c27fef7da38f39\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-107.ec2.internal.18c27fef7da38f39  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-107.ec2.internal,UID:ip-10-0-138-107.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-107.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-107.ec2.internal,},FirstTimestamp:2026-07-15 15:24:28.973920057 +0000 UTC m=+0.360072533,LastTimestamp:2026-07-15 15:24:28.975736274 +0000 UTC m=+0.361888743,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-107.ec2.internal,}"
Jul 15 15:24:30.613152 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:29.021561    2564 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-138-107.ec2.internal.18c27fef7da3f3cb\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-107.ec2.internal.18c27fef7da3f3cb  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-107.ec2.internal,UID:ip-10-0-138-107.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-138-107.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-138-107.ec2.internal,},FirstTimestamp:2026-07-15 15:24:28.973945803 +0000 UTC m=+0.360098270,LastTimestamp:2026-07-15 15:24:28.975783512 +0000 UTC m=+0.361935977,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-107.ec2.internal,}"
Jul 15 15:24:30.613152 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:29.031222    2564 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-138-107.ec2.internal.18c27fef7da431fb\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-107.ec2.internal.18c27fef7da431fb  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-107.ec2.internal,UID:ip-10-0-138-107.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-138-107.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-138-107.ec2.internal,},FirstTimestamp:2026-07-15 15:24:28.973961723 +0000 UTC m=+0.360114189,LastTimestamp:2026-07-15 15:24:28.975797409 +0000 UTC m=+0.361949875,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-107.ec2.internal,}"
Jul 15 15:24:30.613152 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:29.041268    2564 manager.go:337] "Starting Device Plugin manager"
Jul 15 15:24:30.613152 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:29.041304    2564 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 15 15:24:30.613152 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:29.041313    2564 server.go:87] "Starting device plugin registration server"
Jul 15 15:24:30.613152 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:29.041517    2564 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 15 15:24:30.613152 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:29.041525    2564 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 15 15:24:30.613152 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:29.041704    2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 15 15:24:30.613152 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:29.041813    2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 15 15:24:30.613152 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:29.041821    2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 15 15:24:30.613152 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:29.042138    2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 15 15:24:30.613152 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:29.042190    2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-107.ec2.internal\" not found"
Jul 15 15:24:30.613152 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:29.051858    2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-107.ec2.internal.18c27fef81ca24e5  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-107.ec2.internal,UID:ip-10-0-138-107.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-138-107.ec2.internal,},FirstTimestamp:2026-07-15 15:24:29.043557605 +0000 UTC m=+0.429710061,LastTimestamp:2026-07-15 15:24:29.043557605 +0000 UTC m=+0.429710061,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-107.ec2.internal,}"
Jul 15 15:24:30.613152 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:29.067810    2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dhs7j"
Jul 15 15:24:30.613152 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:29.073548    2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dhs7j"
Jul 15 15:24:30.613152 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:29.141991    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 15:24:30.613152 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:29.142866    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-107.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 15:24:30.613152 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:29.142892    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-107.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 15:24:30.614274 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:29.142906    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-107.ec2.internal" event="NodeHasSufficientPID"
Jul 15 15:24:30.614274 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:29.142935    2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-107.ec2.internal"
Jul 15 15:24:30.614274 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:29.163356    2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-107.ec2.internal"
Jul 15 15:24:30.614274 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:29.163372    2564 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-107.ec2.internal\": node \"ip-10-0-138-107.ec2.internal\" not found"
Jul 15 15:24:30.614274 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:29.181297    2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 15 15:24:30.614274 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:29.182713    2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 15 15:24:30.614274 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:29.182745    2564 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 15 15:24:30.614274 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:29.182782    2564 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 15 15:24:30.614274 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:29.182820    2564 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 15 15:24:30.614274 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:29.184863    2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 15:24:30.614274 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:29.185477    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-107.ec2.internal\" not found"
Jul 15 15:24:30.614274 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:29.283323    2564 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-107.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-107.ec2.internal"]
Jul 15 15:24:30.614274 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:29.283373    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 15:24:30.614274 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:29.284685    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-107.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 15:24:30.614274 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:29.284701    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-107.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 15:24:30.614274 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:29.284711    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-107.ec2.internal" event="NodeHasSufficientPID"
Jul 15 15:24:30.614274 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:29.285847    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-107.ec2.internal\" not found"
Jul 15 15:24:30.614274 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:29.286405    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 15:24:30.614274 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:29.286506    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-107.ec2.internal"
Jul 15 15:24:30.614274 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:29.286535    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 15:24:30.614274 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:29.287088    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-107.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 15:24:30.614274 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:29.287096    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-107.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 15:24:30.614274 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:29.287116    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-107.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 15:24:30.614274 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:29.287133    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-107.ec2.internal" event="NodeHasSufficientPID"
Jul 15 15:24:30.614274 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:29.287134    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-107.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 15:24:30.614274 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:29.287181    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-107.ec2.internal" event="NodeHasSufficientPID"
Jul 15 15:24:30.614274 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:29.288717    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-107.ec2.internal"
Jul 15 15:24:30.614274 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:29.288738    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 15:24:30.614274 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:29.289372    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-107.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 15:24:30.614274 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:29.289398    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-107.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 15:24:30.614274 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:29.289411    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-107.ec2.internal" event="NodeHasSufficientPID"
Jul 15 15:24:30.614274 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:29.309425    2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-107.ec2.internal\" not found" node="ip-10-0-138-107.ec2.internal"
Jul 15 15:24:30.614274 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:29.310830    2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-107.ec2.internal\" not found" node="ip-10-0-138-107.ec2.internal"
Jul 15 15:24:30.615274 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:29.356594    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b19951ca4f9c82c97fd02d9646bbed61-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-107.ec2.internal\" (UID: \"b19951ca4f9c82c97fd02d9646bbed61\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-107.ec2.internal"
Jul 15 15:24:30.615274 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:29.356618    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b19951ca4f9c82c97fd02d9646bbed61-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-107.ec2.internal\" (UID: \"b19951ca4f9c82c97fd02d9646bbed61\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-107.ec2.internal"
Jul 15 15:24:30.615274 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:29.356632    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ab8a58b7f0cfe687e1e923428993b5f1-config\") pod \"kube-apiserver-proxy-ip-10-0-138-107.ec2.internal\" (UID: \"ab8a58b7f0cfe687e1e923428993b5f1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-107.ec2.internal"
Jul 15 15:24:30.615274 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:30.426172    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-107.ec2.internal\" not found"
Jul 15 15:24:30.615274 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:30.497668    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b19951ca4f9c82c97fd02d9646bbed61-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-107.ec2.internal\" (UID: \"b19951ca4f9c82c97fd02d9646bbed61\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-107.ec2.internal"
Jul 15 15:24:30.615274 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:30.497690    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b19951ca4f9c82c97fd02d9646bbed61-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-107.ec2.internal\" (UID: \"b19951ca4f9c82c97fd02d9646bbed61\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-107.ec2.internal"
Jul 15 15:24:30.615274 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:30.497705    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ab8a58b7f0cfe687e1e923428993b5f1-config\") pod \"kube-apiserver-proxy-ip-10-0-138-107.ec2.internal\" (UID: \"ab8a58b7f0cfe687e1e923428993b5f1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-107.ec2.internal"
Jul 15 15:24:30.615274 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:30.497739    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ab8a58b7f0cfe687e1e923428993b5f1-config\") pod \"kube-apiserver-proxy-ip-10-0-138-107.ec2.internal\" (UID: \"ab8a58b7f0cfe687e1e923428993b5f1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-107.ec2.internal"
Jul 15 15:24:30.615274 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:30.497759    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b19951ca4f9c82c97fd02d9646bbed61-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-107.ec2.internal\" (UID: \"b19951ca4f9c82c97fd02d9646bbed61\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-107.ec2.internal"
Jul 15 15:24:30.615274 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:30.497778    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b19951ca4f9c82c97fd02d9646bbed61-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-107.ec2.internal\" (UID: \"b19951ca4f9c82c97fd02d9646bbed61\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-107.ec2.internal"
Jul 15 15:24:30.615274 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:30.526768    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-107.ec2.internal\" not found"
Jul 15 15:24:30.863361 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:30.627226    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-107.ec2.internal\" not found"
Jul 15 15:24:30.863361 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:30.651373    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-107.ec2.internal"
Jul 15 15:24:30.863361 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:30.653497    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-107.ec2.internal"
Jul 15 15:24:30.863361 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:30.728266    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-107.ec2.internal\" not found"
Jul 15 15:24:30.863361 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:30.828724    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-107.ec2.internal\" not found"
Jul 15 15:24:31.098566 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:30.929169    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-107.ec2.internal\" not found"
Jul 15 15:24:31.098566 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:30.941309    2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 15 15:24:31.098566 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:30.941430    2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 15 15:24:31.098566 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:31.009871    2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 15:24:31.098566 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:31.030201    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-107.ec2.internal\" not found"
Jul 15 15:24:31.098566 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:31.039327    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 15:24:31.098566 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:31.040229    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-107.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 15:24:31.098566 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:31.040254    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-107.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 15:24:31.098566 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:31.040263    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-107.ec2.internal" event="NodeHasSufficientPID"
Jul 15 15:24:31.371791 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:31.109673    2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 15:24:31.371791 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:31.116587    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-14 15:19:30 +0000 UTC" deadline="2028-01-15 11:56:20.961123631 +0000 UTC"
Jul 15 15:24:31.371791 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:31.116617    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13172h31m49.844509189s"
Jul 15 15:24:31.371791 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:31.194755    2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-107.ec2.internal"
Jul 15 15:24:31.371791 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:31.208455    2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 15 15:24:31.371791 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:31.209147    2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-107.ec2.internal"
Jul 15 15:24:31.371791 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:31.221668    2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 15 15:24:31.615066 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:31.596287    2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 15:24:31.868460 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:31.748754    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab8a58b7f0cfe687e1e923428993b5f1.slice/crio-2b56bb12b266248d7b6914b4e5596fe3e577b5e9e81c1912bae3baa24e4bbd30 WatchSource:0}: Error finding container 2b56bb12b266248d7b6914b4e5596fe3e577b5e9e81c1912bae3baa24e4bbd30: Status 404 returned error can't find the container with id 2b56bb12b266248d7b6914b4e5596fe3e577b5e9e81c1912bae3baa24e4bbd30
Jul 15 15:24:31.868460 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:31.749113    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb19951ca4f9c82c97fd02d9646bbed61.slice/crio-ec49b22bb14cc693cc65d0ca2f9e6eb98a6bab1b635f0f6c6d8e3c4beba6f92c WatchSource:0}: Error finding container ec49b22bb14cc693cc65d0ca2f9e6eb98a6bab1b635f0f6c6d8e3c4beba6f92c: Status 404 returned error can't find the container with id ec49b22bb14cc693cc65d0ca2f9e6eb98a6bab1b635f0f6c6d8e3c4beba6f92c
Jul 15 15:24:31.868460 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:31.753598    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 15:24:32.118706 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:31.976847    2564 apiserver.go:52] "Watching apiserver"
Jul 15 15:24:32.118706 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:31.985949    2564 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 15 15:24:32.118706 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:31.988838    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-lrbjr","kube-system/global-pull-secret-syncer-rbktn","kube-system/kube-apiserver-proxy-ip-10-0-138-107.ec2.internal","openshift-dns/node-resolver-4bhw5","openshift-image-registry/node-ca-dq4f9","openshift-network-diagnostics/network-check-target-b7s72","openshift-ovn-kubernetes/ovnkube-node-bfw7r","kube-system/konnectivity-agent-bz8r7","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5hf8","openshift-cluster-node-tuning-operator/tuned-2l7hr","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-107.ec2.internal","openshift-multus/multus-additional-cni-plugins-2s2fn","openshift-multus/multus-djdlq","openshift-multus/network-metrics-daemon-w7zbl"]
Jul 15 15:24:32.118706 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:31.993239    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bfw7r"
Jul 15 15:24:32.118706 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:31.994490    2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 15 15:24:32.118706 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:31.995518    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-djdlq"
Jul 15 15:24:32.118706 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:31.996122    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 15 15:24:32.118706 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:31.996133    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 15 15:24:32.118706 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:31.996224    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 15 15:24:32.118706 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:31.996257    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 15 15:24:32.118706 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:31.996273    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 15 15:24:32.118706 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:31.996256    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 15 15:24:32.118706 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:31.996901    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-6d5nf\""
Jul 15 15:24:32.118706 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:31.997695    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w7zbl"
Jul 15 15:24:32.118706 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:31.997752    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w7zbl" podUID="60d786ac-9c8b-48df-8e67-6aa7e976718d"
Jul 15 15:24:32.118706 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:31.998197    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 15 15:24:32.118706 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:31.998612    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 15 15:24:32.118706 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:31.998626    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-qwf6k\""
Jul 15 15:24:32.118706 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:31.998612    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 15 15:24:32.118706 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:31.998789    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 15 15:24:32.118706 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:31.999964    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4bhw5"
Jul 15 15:24:32.118706 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.002173    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dq4f9"
Jul 15 15:24:32.118706 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.004678    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b7s72"
Jul 15 15:24:32.118706 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:32.004725    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b7s72" podUID="bff44260-d747-4265-af29-596728c30967"
Jul 15 15:24:32.118706 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.005327    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pq8nx\" (UniqueName: \"kubernetes.io/projected/15e11302-d7ea-4408-b48b-01b0aad5a6dd-kube-api-access-pq8nx\") pod \"multus-djdlq\" (UID: \"15e11302-d7ea-4408-b48b-01b0aad5a6dd\") " pod="openshift-multus/multus-djdlq"
Jul 15 15:24:32.121218 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.005348    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/55d0e798-7e5a-4f3e-afc2-67dfb308d934-host-slash\") pod \"ovnkube-node-bfw7r\" (UID: \"55d0e798-7e5a-4f3e-afc2-67dfb308d934\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfw7r"
Jul 15 15:24:32.121218 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.005372    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/55d0e798-7e5a-4f3e-afc2-67dfb308d934-log-socket\") pod \"ovnkube-node-bfw7r\" (UID: \"55d0e798-7e5a-4f3e-afc2-67dfb308d934\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfw7r"
Jul 15 15:24:32.121218 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.005387    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/15e11302-d7ea-4408-b48b-01b0aad5a6dd-host-var-lib-cni-multus\") pod \"multus-djdlq\" (UID: \"15e11302-d7ea-4408-b48b-01b0aad5a6dd\") " pod="openshift-multus/multus-djdlq"
Jul 15 15:24:32.121218 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.005406    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/15e11302-d7ea-4408-b48b-01b0aad5a6dd-system-cni-dir\") pod \"multus-djdlq\" (UID: \"15e11302-d7ea-4408-b48b-01b0aad5a6dd\") " pod="openshift-multus/multus-djdlq"
Jul 15 15:24:32.121218 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.005428    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/15e11302-d7ea-4408-b48b-01b0aad5a6dd-cni-binary-copy\") pod \"multus-djdlq\" (UID: \"15e11302-d7ea-4408-b48b-01b0aad5a6dd\") " pod="openshift-multus/multus-djdlq"
Jul 15 15:24:32.121218 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.005471    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/55d0e798-7e5a-4f3e-afc2-67dfb308d934-etc-openvswitch\") pod \"ovnkube-node-bfw7r\" (UID: \"55d0e798-7e5a-4f3e-afc2-67dfb308d934\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfw7r"
Jul 15 15:24:32.121218 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.005505    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/55d0e798-7e5a-4f3e-afc2-67dfb308d934-run-ovn\") pod \"ovnkube-node-bfw7r\" (UID: \"55d0e798-7e5a-4f3e-afc2-67dfb308d934\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfw7r"
Jul 15 15:24:32.121218 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.005525    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 15 15:24:32.121218 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.005531    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/15e11302-d7ea-4408-b48b-01b0aad5a6dd-host-var-lib-kubelet\") pod \"multus-djdlq\" (UID: \"15e11302-d7ea-4408-b48b-01b0aad5a6dd\") " pod="openshift-multus/multus-djdlq"
Jul 15 15:24:32.121218 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.005559    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/55d0e798-7e5a-4f3e-afc2-67dfb308d934-host-kubelet\") pod \"ovnkube-node-bfw7r\" (UID: \"55d0e798-7e5a-4f3e-afc2-67dfb308d934\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfw7r"
Jul 15 15:24:32.121218 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.005568    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 15 15:24:32.121218 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.005582    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/55d0e798-7e5a-4f3e-afc2-67dfb308d934-systemd-units\") pod \"ovnkube-node-bfw7r\" (UID: \"55d0e798-7e5a-4f3e-afc2-67dfb308d934\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfw7r"
Jul 15 15:24:32.121218 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.005601    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-mdpqs\""
Jul 15 15:24:32.121218 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.005623    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/55d0e798-7e5a-4f3e-afc2-67dfb308d934-host-run-netns\") pod \"ovnkube-node-bfw7r\" (UID: \"55d0e798-7e5a-4f3e-afc2-67dfb308d934\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfw7r"
Jul 15 15:24:32.121218 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.005648    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/55d0e798-7e5a-4f3e-afc2-67dfb308d934-run-systemd\") pod \"ovnkube-node-bfw7r\" (UID: \"55d0e798-7e5a-4f3e-afc2-67dfb308d934\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfw7r"
Jul 15 15:24:32.121218 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.005671    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/55d0e798-7e5a-4f3e-afc2-67dfb308d934-node-log\") pod \"ovnkube-node-bfw7r\" (UID: \"55d0e798-7e5a-4f3e-afc2-67dfb308d934\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfw7r"
Jul 15 15:24:32.122877 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.005706    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/15e11302-d7ea-4408-b48b-01b0aad5a6dd-multus-cni-dir\") pod \"multus-djdlq\" (UID: \"15e11302-d7ea-4408-b48b-01b0aad5a6dd\") " pod="openshift-multus/multus-djdlq"
Jul 15 15:24:32.122877 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.005735    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/15e11302-d7ea-4408-b48b-01b0aad5a6dd-multus-socket-dir-parent\") pod \"multus-djdlq\" (UID: \"15e11302-d7ea-4408-b48b-01b0aad5a6dd\") " pod="openshift-multus/multus-djdlq"
Jul 15 15:24:32.122877 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.005709    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-kpjbn\""
Jul 15 15:24:32.122877 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.005760    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/15e11302-d7ea-4408-b48b-01b0aad5a6dd-host-run-multus-certs\") pod \"multus-djdlq\" (UID: \"15e11302-d7ea-4408-b48b-01b0aad5a6dd\") " pod="openshift-multus/multus-djdlq"
Jul 15 15:24:32.122877 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.005783    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/15e11302-d7ea-4408-b48b-01b0aad5a6dd-hostroot\") pod \"multus-djdlq\" (UID: \"15e11302-d7ea-4408-b48b-01b0aad5a6dd\") " pod="openshift-multus/multus-djdlq"
Jul 15 15:24:32.122877 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.005804    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/15e11302-d7ea-4408-b48b-01b0aad5a6dd-multus-daemon-config\") pod \"multus-djdlq\" (UID: \"15e11302-d7ea-4408-b48b-01b0aad5a6dd\") " pod="openshift-multus/multus-djdlq"
Jul 15 15:24:32.122877 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.005813    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 15 15:24:32.122877 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.005825    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/55d0e798-7e5a-4f3e-afc2-67dfb308d934-ovnkube-script-lib\") pod \"ovnkube-node-bfw7r\" (UID: \"55d0e798-7e5a-4f3e-afc2-67dfb308d934\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfw7r"
Jul 15 15:24:32.122877 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.005862    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/15e11302-d7ea-4408-b48b-01b0aad5a6dd-os-release\") pod \"multus-djdlq\" (UID: \"15e11302-d7ea-4408-b48b-01b0aad5a6dd\") " pod="openshift-multus/multus-djdlq"
Jul 15 15:24:32.122877 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.005890    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/55d0e798-7e5a-4f3e-afc2-67dfb308d934-run-openvswitch\") pod \"ovnkube-node-bfw7r\" (UID: \"55d0e798-7e5a-4f3e-afc2-67dfb308d934\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfw7r"
Jul 15 15:24:32.122877 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.005916    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/55d0e798-7e5a-4f3e-afc2-67dfb308d934-host-run-ovn-kubernetes\") pod \"ovnkube-node-bfw7r\" (UID: \"55d0e798-7e5a-4f3e-afc2-67dfb308d934\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfw7r"
Jul 15 15:24:32.122877 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.005941    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/15e11302-d7ea-4408-b48b-01b0aad5a6dd-cnibin\") pod \"multus-djdlq\" (UID: \"15e11302-d7ea-4408-b48b-01b0aad5a6dd\") " pod="openshift-multus/multus-djdlq"
Jul 15 15:24:32.122877 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.005964    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/15e11302-d7ea-4408-b48b-01b0aad5a6dd-host-var-lib-cni-bin\") pod \"multus-djdlq\" (UID: \"15e11302-d7ea-4408-b48b-01b0aad5a6dd\") " pod="openshift-multus/multus-djdlq"
Jul 15 15:24:32.122877 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.005985    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/55d0e798-7e5a-4f3e-afc2-67dfb308d934-host-cni-bin\") pod \"ovnkube-node-bfw7r\" (UID: \"55d0e798-7e5a-4f3e-afc2-67dfb308d934\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfw7r"
Jul 15 15:24:32.122877 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.006028    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/55d0e798-7e5a-4f3e-afc2-67dfb308d934-ovnkube-config\") pod \"ovnkube-node-bfw7r\" (UID: \"55d0e798-7e5a-4f3e-afc2-67dfb308d934\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfw7r"
Jul 15 15:24:32.123761 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.006051    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/55d0e798-7e5a-4f3e-afc2-67dfb308d934-env-overrides\") pod \"ovnkube-node-bfw7r\" (UID: \"55d0e798-7e5a-4f3e-afc2-67dfb308d934\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfw7r"
Jul 15 15:24:32.123761 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.006073    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qbfp\" (UniqueName: \"kubernetes.io/projected/55d0e798-7e5a-4f3e-afc2-67dfb308d934-kube-api-access-7qbfp\") pod \"ovnkube-node-bfw7r\" (UID: \"55d0e798-7e5a-4f3e-afc2-67dfb308d934\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfw7r"
Jul 15 15:24:32.123761 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.006096    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/15e11302-d7ea-4408-b48b-01b0aad5a6dd-host-run-k8s-cni-cncf-io\") pod \"multus-djdlq\" (UID: \"15e11302-d7ea-4408-b48b-01b0aad5a6dd\") " pod="openshift-multus/multus-djdlq"
Jul 15 15:24:32.123761 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.006133    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/15e11302-d7ea-4408-b48b-01b0aad5a6dd-host-run-netns\") pod \"multus-djdlq\" (UID: \"15e11302-d7ea-4408-b48b-01b0aad5a6dd\") " pod="openshift-multus/multus-djdlq"
Jul 15 15:24:32.123761 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.006162    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/15e11302-d7ea-4408-b48b-01b0aad5a6dd-multus-conf-dir\") pod \"multus-djdlq\" (UID: \"15e11302-d7ea-4408-b48b-01b0aad5a6dd\") " pod="openshift-multus/multus-djdlq"
Jul 15 15:24:32.123761 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.006188    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/15e11302-d7ea-4408-b48b-01b0aad5a6dd-etc-kubernetes\") pod \"multus-djdlq\" (UID: \"15e11302-d7ea-4408-b48b-01b0aad5a6dd\") " pod="openshift-multus/multus-djdlq"
Jul 15 15:24:32.123761 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.006225    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/55d0e798-7e5a-4f3e-afc2-67dfb308d934-var-lib-openvswitch\") pod \"ovnkube-node-bfw7r\" (UID: \"55d0e798-7e5a-4f3e-afc2-67dfb308d934\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfw7r"
Jul 15 15:24:32.123761 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.006253    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/55d0e798-7e5a-4f3e-afc2-67dfb308d934-host-cni-netd\") pod \"ovnkube-node-bfw7r\" (UID: \"55d0e798-7e5a-4f3e-afc2-67dfb308d934\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfw7r"
Jul 15 15:24:32.123761 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.006278    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/55d0e798-7e5a-4f3e-afc2-67dfb308d934-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bfw7r\" (UID: \"55d0e798-7e5a-4f3e-afc2-67dfb308d934\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfw7r"
Jul 15 15:24:32.123761 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.006309    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/55d0e798-7e5a-4f3e-afc2-67dfb308d934-ovn-node-metrics-cert\") pod \"ovnkube-node-bfw7r\" (UID: \"55d0e798-7e5a-4f3e-afc2-67dfb308d934\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfw7r"
Jul 15 15:24:32.123761 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.006608    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 15 15:24:32.123761 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.006609    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 15 15:24:32.123761 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.006823    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5hf8"
Jul 15 15:24:32.123761 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.009268    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 15 15:24:32.123761 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.009409    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 15 15:24:32.123761 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.009482    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 15 15:24:32.123761 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.009582    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-88s66\""
Jul 15 15:24:32.123761 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.010202    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lrbjr"
Jul 15 15:24:32.125709 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.011620    2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 15 15:24:32.125709 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.012373    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rbktn"
Jul 15 15:24:32.125709 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.012410    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 15 15:24:32.125709 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:32.012468    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rbktn" podUID="3988961d-1cd0-4fd2-aa28-80610f3ed94b"
Jul 15 15:24:32.125709 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.012563    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 15 15:24:32.125709 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.012817    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-cjt29\""
Jul 15 15:24:32.125709 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.013129    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 15 15:24:32.125709 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.015362    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2l7hr"
Jul 15 15:24:32.125709 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.018593    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bz8r7"
Jul 15 15:24:32.125709 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.019963    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2s2fn"
Jul 15 15:24:32.125709 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.020489    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 15 15:24:32.125709 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.020509    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 15 15:24:32.125709 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.020539    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-bfqhk\""
Jul 15 15:24:32.125709 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.021218    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-84qt5\""
Jul 15 15:24:32.125709 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.021560    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 15 15:24:32.125709 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.021728    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 15 15:24:32.125709 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.022319    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 15 15:24:32.125709 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.022342    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 15 15:24:32.125709 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.022701    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-kspfz\""
Jul 15 15:24:32.125709 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.039567    2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-xsqwk"
Jul 15 15:24:32.125709 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.050173    2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-xsqwk"
Jul 15 15:24:32.125709 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.095205    2564 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 15 15:24:32.125709 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.106788    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqpwn\" (UniqueName: \"kubernetes.io/projected/41596280-81e4-4be2-808b-8b53102dbe5a-kube-api-access-dqpwn\") pod \"iptables-alerter-lrbjr\" (UID: \"41596280-81e4-4be2-808b-8b53102dbe5a\") " pod="openshift-network-operator/iptables-alerter-lrbjr"
Jul 15 15:24:32.125709 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.106810    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6749dd0d-651a-432e-b79a-b580fb6a9200-etc-sysconfig\") pod \"tuned-2l7hr\" (UID: \"6749dd0d-651a-432e-b79a-b580fb6a9200\") " pod="openshift-cluster-node-tuning-operator/tuned-2l7hr"
Jul 15 15:24:32.125709 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.106826    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/52587e3b-cd74-43d1-86aa-29a127627f90-hosts-file\") pod \"node-resolver-4bhw5\" (UID: \"52587e3b-cd74-43d1-86aa-29a127627f90\") " pod="openshift-dns/node-resolver-4bhw5"
Jul 15 15:24:32.126976 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.106848    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/15e11302-d7ea-4408-b48b-01b0aad5a6dd-cni-binary-copy\") pod \"multus-djdlq\" (UID: \"15e11302-d7ea-4408-b48b-01b0aad5a6dd\") " pod="openshift-multus/multus-djdlq"
Jul 15 15:24:32.126976 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.106872    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/55d0e798-7e5a-4f3e-afc2-67dfb308d934-etc-openvswitch\") pod \"ovnkube-node-bfw7r\" (UID: \"55d0e798-7e5a-4f3e-afc2-67dfb308d934\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfw7r"
Jul 15 15:24:32.126976 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.106897    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/aa03530f-36a5-49a7-b513-1add7f6af1ce-agent-certs\") pod \"konnectivity-agent-bz8r7\" (UID: \"aa03530f-36a5-49a7-b513-1add7f6af1ce\") " pod="kube-system/konnectivity-agent-bz8r7"
Jul 15 15:24:32.126976 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.106917    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/55d0e798-7e5a-4f3e-afc2-67dfb308d934-etc-openvswitch\") pod \"ovnkube-node-bfw7r\" (UID: \"55d0e798-7e5a-4f3e-afc2-67dfb308d934\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfw7r"
Jul 15 15:24:32.126976 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.106919    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcfzp\" (UniqueName: \"kubernetes.io/projected/bd4f0795-8b44-4ea5-9a78-6c790d60ab3d-kube-api-access-tcfzp\") pod \"node-ca-dq4f9\" (UID: \"bd4f0795-8b44-4ea5-9a78-6c790d60ab3d\") " pod="openshift-image-registry/node-ca-dq4f9"
Jul 15 15:24:32.126976 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.106958    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6749dd0d-651a-432e-b79a-b580fb6a9200-run\") pod \"tuned-2l7hr\" (UID: \"6749dd0d-651a-432e-b79a-b580fb6a9200\") " pod="openshift-cluster-node-tuning-operator/tuned-2l7hr"
Jul 15 15:24:32.126976 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.106983    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/83ea2fad-6953-4605-bd20-4ca74169f20d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2s2fn\" (UID: \"83ea2fad-6953-4605-bd20-4ca74169f20d\") " pod="openshift-multus/multus-additional-cni-plugins-2s2fn"
Jul 15 15:24:32.126976 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.107026    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqlkk\" (UniqueName: \"kubernetes.io/projected/4f72bead-ee18-4b6c-b262-7248e623c104-kube-api-access-nqlkk\") pod \"aws-ebs-csi-driver-node-f5hf8\" (UID: \"4f72bead-ee18-4b6c-b262-7248e623c104\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5hf8"
Jul 15 15:24:32.126976 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.107054    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/55d0e798-7e5a-4f3e-afc2-67dfb308d934-host-kubelet\") pod \"ovnkube-node-bfw7r\" (UID: \"55d0e798-7e5a-4f3e-afc2-67dfb308d934\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfw7r"
Jul 15 15:24:32.126976 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.107103    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/55d0e798-7e5a-4f3e-afc2-67dfb308d934-host-kubelet\") pod \"ovnkube-node-bfw7r\" (UID: \"55d0e798-7e5a-4f3e-afc2-67dfb308d934\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfw7r"
Jul 15 15:24:32.126976 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.107122    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/55d0e798-7e5a-4f3e-afc2-67dfb308d934-systemd-units\") pod \"ovnkube-node-bfw7r\" (UID: \"55d0e798-7e5a-4f3e-afc2-67dfb308d934\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfw7r"
Jul 15 15:24:32.126976 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.107144    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/55d0e798-7e5a-4f3e-afc2-67dfb308d934-host-run-netns\") pod \"ovnkube-node-bfw7r\" (UID: \"55d0e798-7e5a-4f3e-afc2-67dfb308d934\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfw7r"
Jul 15 15:24:32.126976 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.107158    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/55d0e798-7e5a-4f3e-afc2-67dfb308d934-run-systemd\") pod \"ovnkube-node-bfw7r\" (UID: \"55d0e798-7e5a-4f3e-afc2-67dfb308d934\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfw7r"
Jul 15 15:24:32.126976 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.107175    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/41596280-81e4-4be2-808b-8b53102dbe5a-iptables-alerter-script\") pod \"iptables-alerter-lrbjr\" (UID: \"41596280-81e4-4be2-808b-8b53102dbe5a\") " pod="openshift-network-operator/iptables-alerter-lrbjr"
Jul 15 15:24:32.128237 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.107157    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/55d0e798-7e5a-4f3e-afc2-67dfb308d934-systemd-units\") pod \"ovnkube-node-bfw7r\" (UID: \"55d0e798-7e5a-4f3e-afc2-67dfb308d934\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfw7r"
Jul 15 15:24:32.128237 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.107185    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/55d0e798-7e5a-4f3e-afc2-67dfb308d934-host-run-netns\") pod \"ovnkube-node-bfw7r\" (UID: \"55d0e798-7e5a-4f3e-afc2-67dfb308d934\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfw7r"
Jul 15 15:24:32.128237 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.107195    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6749dd0d-651a-432e-b79a-b580fb6a9200-etc-modprobe-d\") pod \"tuned-2l7hr\" (UID: \"6749dd0d-651a-432e-b79a-b580fb6a9200\") " pod="openshift-cluster-node-tuning-operator/tuned-2l7hr"
Jul 15 15:24:32.128237 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.107203    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/55d0e798-7e5a-4f3e-afc2-67dfb308d934-run-systemd\") pod \"ovnkube-node-bfw7r\" (UID: \"55d0e798-7e5a-4f3e-afc2-67dfb308d934\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfw7r"
Jul 15 15:24:32.128237 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.107215    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjk6r\" (UniqueName: \"kubernetes.io/projected/6749dd0d-651a-432e-b79a-b580fb6a9200-kube-api-access-bjk6r\") pod \"tuned-2l7hr\" (UID: \"6749dd0d-651a-432e-b79a-b580fb6a9200\") " pod="openshift-cluster-node-tuning-operator/tuned-2l7hr"
Jul 15 15:24:32.128237 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.107230    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/83ea2fad-6953-4605-bd20-4ca74169f20d-cni-binary-copy\") pod \"multus-additional-cni-plugins-2s2fn\" (UID: \"83ea2fad-6953-4605-bd20-4ca74169f20d\") " pod="openshift-multus/multus-additional-cni-plugins-2s2fn"
Jul 15 15:24:32.128237 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.107245    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/15e11302-d7ea-4408-b48b-01b0aad5a6dd-multus-cni-dir\") pod \"multus-djdlq\" (UID: \"15e11302-d7ea-4408-b48b-01b0aad5a6dd\") " pod="openshift-multus/multus-djdlq"
Jul 15 15:24:32.128237 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.107262    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/15e11302-d7ea-4408-b48b-01b0aad5a6dd-host-run-multus-certs\") pod \"multus-djdlq\" (UID: \"15e11302-d7ea-4408-b48b-01b0aad5a6dd\") " pod="openshift-multus/multus-djdlq"
Jul 15 15:24:32.128237 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.107289    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3988961d-1cd0-4fd2-aa28-80610f3ed94b-kubelet-config\") pod \"global-pull-secret-syncer-rbktn\" (UID: \"3988961d-1cd0-4fd2-aa28-80610f3ed94b\") " pod="kube-system/global-pull-secret-syncer-rbktn"
Jul 15 15:24:32.128237 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.107311    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/83ea2fad-6953-4605-bd20-4ca74169f20d-os-release\") pod \"multus-additional-cni-plugins-2s2fn\" (UID: \"83ea2fad-6953-4605-bd20-4ca74169f20d\") " pod="openshift-multus/multus-additional-cni-plugins-2s2fn"
Jul 15 15:24:32.128237 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.107321    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/15e11302-d7ea-4408-b48b-01b0aad5a6dd-host-run-multus-certs\") pod \"multus-djdlq\" (UID: \"15e11302-d7ea-4408-b48b-01b0aad5a6dd\") " pod="openshift-multus/multus-djdlq"
Jul 15 15:24:32.128237 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.107333    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9gs6\" (UniqueName: \"kubernetes.io/projected/52587e3b-cd74-43d1-86aa-29a127627f90-kube-api-access-k9gs6\") pod \"node-resolver-4bhw5\" (UID: \"52587e3b-cd74-43d1-86aa-29a127627f90\") " pod="openshift-dns/node-resolver-4bhw5"
Jul 15 15:24:32.128237 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.107366    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/15e11302-d7ea-4408-b48b-01b0aad5a6dd-hostroot\") pod \"multus-djdlq\" (UID: \"15e11302-d7ea-4408-b48b-01b0aad5a6dd\") " pod="openshift-multus/multus-djdlq"
Jul 15 15:24:32.128237 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.107372    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/15e11302-d7ea-4408-b48b-01b0aad5a6dd-cni-binary-copy\") pod \"multus-djdlq\" (UID: \"15e11302-d7ea-4408-b48b-01b0aad5a6dd\") " pod="openshift-multus/multus-djdlq"
Jul 15 15:24:32.129331 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.107387    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6749dd0d-651a-432e-b79a-b580fb6a9200-sys\") pod \"tuned-2l7hr\" (UID: \"6749dd0d-651a-432e-b79a-b580fb6a9200\") " pod="openshift-cluster-node-tuning-operator/tuned-2l7hr"
Jul 15 15:24:32.129331 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.107402    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/55d0e798-7e5a-4f3e-afc2-67dfb308d934-run-openvswitch\") pod \"ovnkube-node-bfw7r\" (UID: \"55d0e798-7e5a-4f3e-afc2-67dfb308d934\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfw7r"
Jul 15 15:24:32.129331 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.107419    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4f72bead-ee18-4b6c-b262-7248e623c104-kubelet-dir\") pod \"aws-ebs-csi-driver-node-f5hf8\" (UID: \"4f72bead-ee18-4b6c-b262-7248e623c104\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5hf8"
Jul 15 15:24:32.129331 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.107444    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/15e11302-d7ea-4408-b48b-01b0aad5a6dd-multus-cni-dir\") pod \"multus-djdlq\" (UID: \"15e11302-d7ea-4408-b48b-01b0aad5a6dd\") " pod="openshift-multus/multus-djdlq"
Jul 15 15:24:32.129331 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.107446    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/15e11302-d7ea-4408-b48b-01b0aad5a6dd-cnibin\") pod \"multus-djdlq\" (UID: \"15e11302-d7ea-4408-b48b-01b0aad5a6dd\") " pod="openshift-multus/multus-djdlq"
Jul 15 15:24:32.129331 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.107471    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/15e11302-d7ea-4408-b48b-01b0aad5a6dd-hostroot\") pod \"multus-djdlq\" (UID: \"15e11302-d7ea-4408-b48b-01b0aad5a6dd\") " pod="openshift-multus/multus-djdlq"
Jul 15 15:24:32.129331 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.107473    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/55d0e798-7e5a-4f3e-afc2-67dfb308d934-host-cni-bin\") pod \"ovnkube-node-bfw7r\" (UID: \"55d0e798-7e5a-4f3e-afc2-67dfb308d934\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfw7r"
Jul 15 15:24:32.129331 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.107500    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/55d0e798-7e5a-4f3e-afc2-67dfb308d934-host-cni-bin\") pod \"ovnkube-node-bfw7r\" (UID: \"55d0e798-7e5a-4f3e-afc2-67dfb308d934\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfw7r"
Jul 15 15:24:32.129331 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.107520    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/55d0e798-7e5a-4f3e-afc2-67dfb308d934-env-overrides\") pod \"ovnkube-node-bfw7r\" (UID: \"55d0e798-7e5a-4f3e-afc2-67dfb308d934\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfw7r"
Jul 15 15:24:32.129331 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.107525    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/15e11302-d7ea-4408-b48b-01b0aad5a6dd-cnibin\") pod \"multus-djdlq\" (UID: \"15e11302-d7ea-4408-b48b-01b0aad5a6dd\") " pod="openshift-multus/multus-djdlq"
Jul 15 15:24:32.129331 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.107531    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/55d0e798-7e5a-4f3e-afc2-67dfb308d934-run-openvswitch\") pod \"ovnkube-node-bfw7r\" (UID: \"55d0e798-7e5a-4f3e-afc2-67dfb308d934\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfw7r"
Jul 15 15:24:32.129331 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.107545    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qbfp\" (UniqueName: \"kubernetes.io/projected/55d0e798-7e5a-4f3e-afc2-67dfb308d934-kube-api-access-7qbfp\") pod \"ovnkube-node-bfw7r\" (UID: \"55d0e798-7e5a-4f3e-afc2-67dfb308d934\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfw7r"
Jul 15 15:24:32.129331 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.107566    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6749dd0d-651a-432e-b79a-b580fb6a9200-lib-modules\") pod \"tuned-2l7hr\" (UID: \"6749dd0d-651a-432e-b79a-b580fb6a9200\") " pod="openshift-cluster-node-tuning-operator/tuned-2l7hr"
Jul 15 15:24:32.129331 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.107675    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6749dd0d-651a-432e-b79a-b580fb6a9200-var-lib-kubelet\") pod \"tuned-2l7hr\" (UID: \"6749dd0d-651a-432e-b79a-b580fb6a9200\") " pod="openshift-cluster-node-tuning-operator/tuned-2l7hr"
Jul 15 15:24:32.129331 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.107699    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6749dd0d-651a-432e-b79a-b580fb6a9200-host\") pod \"tuned-2l7hr\" (UID: \"6749dd0d-651a-432e-b79a-b580fb6a9200\") " pod="openshift-cluster-node-tuning-operator/tuned-2l7hr"
Jul 15 15:24:32.130211 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.107721    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6749dd0d-651a-432e-b79a-b580fb6a9200-tmp\") pod \"tuned-2l7hr\" (UID: \"6749dd0d-651a-432e-b79a-b580fb6a9200\") " pod="openshift-cluster-node-tuning-operator/tuned-2l7hr"
Jul 15 15:24:32.130211 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.107746    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/15e11302-d7ea-4408-b48b-01b0aad5a6dd-host-run-netns\") pod \"multus-djdlq\" (UID: \"15e11302-d7ea-4408-b48b-01b0aad5a6dd\") " pod="openshift-multus/multus-djdlq"
Jul 15 15:24:32.130211 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.107770    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/15e11302-d7ea-4408-b48b-01b0aad5a6dd-etc-kubernetes\") pod \"multus-djdlq\" (UID: \"15e11302-d7ea-4408-b48b-01b0aad5a6dd\") " pod="openshift-multus/multus-djdlq"
Jul 15 15:24:32.130211 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.107793    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/55d0e798-7e5a-4f3e-afc2-67dfb308d934-var-lib-openvswitch\") pod \"ovnkube-node-bfw7r\" (UID: \"55d0e798-7e5a-4f3e-afc2-67dfb308d934\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfw7r"
Jul 15 15:24:32.130211 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.107815    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6749dd0d-651a-432e-b79a-b580fb6a9200-etc-sysctl-d\") pod \"tuned-2l7hr\" (UID: \"6749dd0d-651a-432e-b79a-b580fb6a9200\") " pod="openshift-cluster-node-tuning-operator/tuned-2l7hr"
Jul 15 15:24:32.130211 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.107829    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/15e11302-d7ea-4408-b48b-01b0aad5a6dd-host-run-netns\") pod \"multus-djdlq\" (UID: \"15e11302-d7ea-4408-b48b-01b0aad5a6dd\") " pod="openshift-multus/multus-djdlq"
Jul 15 15:24:32.130211 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.107831    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/15e11302-d7ea-4408-b48b-01b0aad5a6dd-etc-kubernetes\") pod \"multus-djdlq\" (UID: \"15e11302-d7ea-4408-b48b-01b0aad5a6dd\") " pod="openshift-multus/multus-djdlq"
Jul 15 15:24:32.130211 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.107856    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/55d0e798-7e5a-4f3e-afc2-67dfb308d934-var-lib-openvswitch\") pod \"ovnkube-node-bfw7r\" (UID: \"55d0e798-7e5a-4f3e-afc2-67dfb308d934\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfw7r"
Jul 15 15:24:32.130211 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.107840    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2txnn\" (UniqueName: \"kubernetes.io/projected/83ea2fad-6953-4605-bd20-4ca74169f20d-kube-api-access-2txnn\") pod \"multus-additional-cni-plugins-2s2fn\" (UID: \"83ea2fad-6953-4605-bd20-4ca74169f20d\") " pod="openshift-multus/multus-additional-cni-plugins-2s2fn"
Jul 15 15:24:32.130211 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.107891    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60d786ac-9c8b-48df-8e67-6aa7e976718d-metrics-certs\") pod \"network-metrics-daemon-w7zbl\" (UID: \"60d786ac-9c8b-48df-8e67-6aa7e976718d\") " pod="openshift-multus/network-metrics-daemon-w7zbl"
Jul 15 15:24:32.130211 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.107911    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/55d0e798-7e5a-4f3e-afc2-67dfb308d934-log-socket\") pod \"ovnkube-node-bfw7r\" (UID: \"55d0e798-7e5a-4f3e-afc2-67dfb308d934\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfw7r"
Jul 15 15:24:32.130211 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.107936    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6749dd0d-651a-432e-b79a-b580fb6a9200-etc-sysctl-conf\") pod \"tuned-2l7hr\" (UID: \"6749dd0d-651a-432e-b79a-b580fb6a9200\") " pod="openshift-cluster-node-tuning-operator/tuned-2l7hr"
Jul 15 15:24:32.130211 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.107952    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/15e11302-d7ea-4408-b48b-01b0aad5a6dd-host-var-lib-cni-multus\") pod \"multus-djdlq\" (UID: \"15e11302-d7ea-4408-b48b-01b0aad5a6dd\") " pod="openshift-multus/multus-djdlq"
Jul 15 15:24:32.130211 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.107956    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/55d0e798-7e5a-4f3e-afc2-67dfb308d934-env-overrides\") pod \"ovnkube-node-bfw7r\" (UID: \"55d0e798-7e5a-4f3e-afc2-67dfb308d934\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfw7r"
Jul 15 15:24:32.130865 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.107963    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/55d0e798-7e5a-4f3e-afc2-67dfb308d934-log-socket\") pod \"ovnkube-node-bfw7r\" (UID: \"55d0e798-7e5a-4f3e-afc2-67dfb308d934\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfw7r"
Jul 15 15:24:32.130865 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.107967    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/15e11302-d7ea-4408-b48b-01b0aad5a6dd-system-cni-dir\") pod \"multus-djdlq\" (UID: \"15e11302-d7ea-4408-b48b-01b0aad5a6dd\") " pod="openshift-multus/multus-djdlq"
Jul 15 15:24:32.130865 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.108005    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/55d0e798-7e5a-4f3e-afc2-67dfb308d934-run-ovn\") pod \"ovnkube-node-bfw7r\" (UID: \"55d0e798-7e5a-4f3e-afc2-67dfb308d934\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfw7r"
Jul 15 15:24:32.130865 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.108026    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/15e11302-d7ea-4408-b48b-01b0aad5a6dd-host-var-lib-cni-multus\") pod \"multus-djdlq\" (UID: \"15e11302-d7ea-4408-b48b-01b0aad5a6dd\") " pod="openshift-multus/multus-djdlq"
Jul 15 15:24:32.130865 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.108041    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3988961d-1cd0-4fd2-aa28-80610f3ed94b-dbus\") pod \"global-pull-secret-syncer-rbktn\" (UID: \"3988961d-1cd0-4fd2-aa28-80610f3ed94b\") " pod="kube-system/global-pull-secret-syncer-rbktn"
Jul 15 15:24:32.130865 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.108057    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3988961d-1cd0-4fd2-aa28-80610f3ed94b-original-pull-secret\") pod \"global-pull-secret-syncer-rbktn\" (UID: \"3988961d-1cd0-4fd2-aa28-80610f3ed94b\") " pod="kube-system/global-pull-secret-syncer-rbktn"
Jul 15 15:24:32.130865 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.108059    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/15e11302-d7ea-4408-b48b-01b0aad5a6dd-system-cni-dir\") pod \"multus-djdlq\" (UID: \"15e11302-d7ea-4408-b48b-01b0aad5a6dd\") " pod="openshift-multus/multus-djdlq"
Jul 15 15:24:32.130865 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.108088    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/55d0e798-7e5a-4f3e-afc2-67dfb308d934-run-ovn\") pod \"ovnkube-node-bfw7r\" (UID: \"55d0e798-7e5a-4f3e-afc2-67dfb308d934\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfw7r"
Jul 15 15:24:32.130865 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.108081    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bd4f0795-8b44-4ea5-9a78-6c790d60ab3d-host\") pod \"node-ca-dq4f9\" (UID: \"bd4f0795-8b44-4ea5-9a78-6c790d60ab3d\") " pod="openshift-image-registry/node-ca-dq4f9"
Jul 15 15:24:32.130865 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.108122    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52587e3b-cd74-43d1-86aa-29a127627f90-tmp-dir\") pod \"node-resolver-4bhw5\" (UID: \"52587e3b-cd74-43d1-86aa-29a127627f90\") " pod="openshift-dns/node-resolver-4bhw5"
Jul 15 15:24:32.130865 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.108141    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4f72bead-ee18-4b6c-b262-7248e623c104-device-dir\") pod \"aws-ebs-csi-driver-node-f5hf8\" (UID: \"4f72bead-ee18-4b6c-b262-7248e623c104\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5hf8"
Jul 15 15:24:32.130865 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.108159    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/15e11302-d7ea-4408-b48b-01b0aad5a6dd-host-var-lib-kubelet\") pod \"multus-djdlq\" (UID: \"15e11302-d7ea-4408-b48b-01b0aad5a6dd\") " pod="openshift-multus/multus-djdlq"
Jul 15 15:24:32.130865 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.108182    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/55d0e798-7e5a-4f3e-afc2-67dfb308d934-node-log\") pod \"ovnkube-node-bfw7r\" (UID: \"55d0e798-7e5a-4f3e-afc2-67dfb308d934\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfw7r"
Jul 15 15:24:32.130865 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.108211    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/55d0e798-7e5a-4f3e-afc2-67dfb308d934-node-log\") pod \"ovnkube-node-bfw7r\" (UID: \"55d0e798-7e5a-4f3e-afc2-67dfb308d934\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfw7r"
Jul 15 15:24:32.130865 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.108231    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/15e11302-d7ea-4408-b48b-01b0aad5a6dd-host-var-lib-kubelet\") pod \"multus-djdlq\" (UID: \"15e11302-d7ea-4408-b48b-01b0aad5a6dd\") " pod="openshift-multus/multus-djdlq"
Jul 15 15:24:32.131735 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.108257    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6749dd0d-651a-432e-b79a-b580fb6a9200-etc-systemd\") pod \"tuned-2l7hr\" (UID: \"6749dd0d-651a-432e-b79a-b580fb6a9200\") " pod="openshift-cluster-node-tuning-operator/tuned-2l7hr"
Jul 15 15:24:32.131735 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.108283    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/83ea2fad-6953-4605-bd20-4ca74169f20d-system-cni-dir\") pod \"multus-additional-cni-plugins-2s2fn\" (UID: \"83ea2fad-6953-4605-bd20-4ca74169f20d\") " pod="openshift-multus/multus-additional-cni-plugins-2s2fn"
Jul 15 15:24:32.131735 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.108299    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4f72bead-ee18-4b6c-b262-7248e623c104-sys-fs\") pod \"aws-ebs-csi-driver-node-f5hf8\" (UID: \"4f72bead-ee18-4b6c-b262-7248e623c104\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5hf8"
Jul 15 15:24:32.131735 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.108342    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/15e11302-d7ea-4408-b48b-01b0aad5a6dd-multus-socket-dir-parent\") pod \"multus-djdlq\" (UID: \"15e11302-d7ea-4408-b48b-01b0aad5a6dd\") " pod="openshift-multus/multus-djdlq"
Jul 15 15:24:32.131735 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.108362    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4f72bead-ee18-4b6c-b262-7248e623c104-socket-dir\") pod \"aws-ebs-csi-driver-node-f5hf8\" (UID: \"4f72bead-ee18-4b6c-b262-7248e623c104\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5hf8"
Jul 15 15:24:32.131735 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.108376    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4f72bead-ee18-4b6c-b262-7248e623c104-etc-selinux\") pod \"aws-ebs-csi-driver-node-f5hf8\" (UID: \"4f72bead-ee18-4b6c-b262-7248e623c104\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5hf8"
Jul 15 15:24:32.131735 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.108392    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/15e11302-d7ea-4408-b48b-01b0aad5a6dd-multus-daemon-config\") pod \"multus-djdlq\" (UID: \"15e11302-d7ea-4408-b48b-01b0aad5a6dd\") " pod="openshift-multus/multus-djdlq"
Jul 15 15:24:32.131735 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.108408    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/55d0e798-7e5a-4f3e-afc2-67dfb308d934-ovnkube-script-lib\") pod \"ovnkube-node-bfw7r\" (UID: \"55d0e798-7e5a-4f3e-afc2-67dfb308d934\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfw7r"
Jul 15 15:24:32.131735 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.108422    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/83ea2fad-6953-4605-bd20-4ca74169f20d-cnibin\") pod \"multus-additional-cni-plugins-2s2fn\" (UID: \"83ea2fad-6953-4605-bd20-4ca74169f20d\") " pod="openshift-multus/multus-additional-cni-plugins-2s2fn"
Jul 15 15:24:32.131735 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.108455    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/15e11302-d7ea-4408-b48b-01b0aad5a6dd-multus-socket-dir-parent\") pod \"multus-djdlq\" (UID: \"15e11302-d7ea-4408-b48b-01b0aad5a6dd\") " pod="openshift-multus/multus-djdlq"
Jul 15 15:24:32.131735 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.108496    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/15e11302-d7ea-4408-b48b-01b0aad5a6dd-os-release\") pod \"multus-djdlq\" (UID: \"15e11302-d7ea-4408-b48b-01b0aad5a6dd\") " pod="openshift-multus/multus-djdlq"
Jul 15 15:24:32.131735 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.108521    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/55d0e798-7e5a-4f3e-afc2-67dfb308d934-host-run-ovn-kubernetes\") pod \"ovnkube-node-bfw7r\" (UID: \"55d0e798-7e5a-4f3e-afc2-67dfb308d934\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfw7r"
Jul 15 15:24:32.131735 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.108548    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czw52\" (UniqueName: \"kubernetes.io/projected/bff44260-d747-4265-af29-596728c30967-kube-api-access-czw52\") pod \"network-check-target-b7s72\" (UID: \"bff44260-d747-4265-af29-596728c30967\") " pod="openshift-network-diagnostics/network-check-target-b7s72"
Jul 15 15:24:32.131735 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.108573    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnz6m\" (UniqueName: \"kubernetes.io/projected/60d786ac-9c8b-48df-8e67-6aa7e976718d-kube-api-access-jnz6m\") pod \"network-metrics-daemon-w7zbl\" (UID: \"60d786ac-9c8b-48df-8e67-6aa7e976718d\") " pod="openshift-multus/network-metrics-daemon-w7zbl"
Jul 15 15:24:32.133036 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.108598    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4f72bead-ee18-4b6c-b262-7248e623c104-registration-dir\") pod \"aws-ebs-csi-driver-node-f5hf8\" (UID: \"4f72bead-ee18-4b6c-b262-7248e623c104\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5hf8"
Jul 15 15:24:32.133036 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.108610    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/55d0e798-7e5a-4f3e-afc2-67dfb308d934-host-run-ovn-kubernetes\") pod \"ovnkube-node-bfw7r\" (UID: \"55d0e798-7e5a-4f3e-afc2-67dfb308d934\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfw7r"
Jul 15 15:24:32.133036 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.108611    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/15e11302-d7ea-4408-b48b-01b0aad5a6dd-os-release\") pod \"multus-djdlq\" (UID: \"15e11302-d7ea-4408-b48b-01b0aad5a6dd\") " pod="openshift-multus/multus-djdlq"
Jul 15 15:24:32.133036 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.108636    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/15e11302-d7ea-4408-b48b-01b0aad5a6dd-host-var-lib-cni-bin\") pod \"multus-djdlq\" (UID: \"15e11302-d7ea-4408-b48b-01b0aad5a6dd\") " pod="openshift-multus/multus-djdlq"
Jul 15 15:24:32.133036 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.108678    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/55d0e798-7e5a-4f3e-afc2-67dfb308d934-ovnkube-config\") pod \"ovnkube-node-bfw7r\" (UID: \"55d0e798-7e5a-4f3e-afc2-67dfb308d934\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfw7r"
Jul 15 15:24:32.133036 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.108683    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/15e11302-d7ea-4408-b48b-01b0aad5a6dd-host-var-lib-cni-bin\") pod \"multus-djdlq\" (UID: \"15e11302-d7ea-4408-b48b-01b0aad5a6dd\") " pod="openshift-multus/multus-djdlq"
Jul 15 15:24:32.133036 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.108710    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bd4f0795-8b44-4ea5-9a78-6c790d60ab3d-serviceca\") pod \"node-ca-dq4f9\" (UID: \"bd4f0795-8b44-4ea5-9a78-6c790d60ab3d\") " pod="openshift-image-registry/node-ca-dq4f9"
Jul 15 15:24:32.133036 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.108735    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6749dd0d-651a-432e-b79a-b580fb6a9200-etc-kubernetes\") pod \"tuned-2l7hr\" (UID: \"6749dd0d-651a-432e-b79a-b580fb6a9200\") " pod="openshift-cluster-node-tuning-operator/tuned-2l7hr"
Jul 15 15:24:32.133036 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.108758    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/83ea2fad-6953-4605-bd20-4ca74169f20d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2s2fn\" (UID: \"83ea2fad-6953-4605-bd20-4ca74169f20d\") " pod="openshift-multus/multus-additional-cni-plugins-2s2fn"
Jul 15 15:24:32.133036 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.108783    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/83ea2fad-6953-4605-bd20-4ca74169f20d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2s2fn\" (UID: \"83ea2fad-6953-4605-bd20-4ca74169f20d\") " pod="openshift-multus/multus-additional-cni-plugins-2s2fn"
Jul 15 15:24:32.133036 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.108809    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/15e11302-d7ea-4408-b48b-01b0aad5a6dd-multus-daemon-config\") pod \"multus-djdlq\" (UID: \"15e11302-d7ea-4408-b48b-01b0aad5a6dd\") " pod="openshift-multus/multus-djdlq"
Jul 15 15:24:32.133036 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.108809    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/15e11302-d7ea-4408-b48b-01b0aad5a6dd-host-run-k8s-cni-cncf-io\") pod \"multus-djdlq\" (UID: \"15e11302-d7ea-4408-b48b-01b0aad5a6dd\") " pod="openshift-multus/multus-djdlq"
Jul 15 15:24:32.133036 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.108844    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/15e11302-d7ea-4408-b48b-01b0aad5a6dd-host-run-k8s-cni-cncf-io\") pod \"multus-djdlq\" (UID: \"15e11302-d7ea-4408-b48b-01b0aad5a6dd\") " pod="openshift-multus/multus-djdlq"
Jul 15 15:24:32.133036 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.108852    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/15e11302-d7ea-4408-b48b-01b0aad5a6dd-multus-conf-dir\") pod \"multus-djdlq\" (UID: \"15e11302-d7ea-4408-b48b-01b0aad5a6dd\") " pod="openshift-multus/multus-djdlq"
Jul 15 15:24:32.133908 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.108875    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/55d0e798-7e5a-4f3e-afc2-67dfb308d934-host-cni-netd\") pod \"ovnkube-node-bfw7r\" (UID: \"55d0e798-7e5a-4f3e-afc2-67dfb308d934\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfw7r"
Jul 15 15:24:32.133908 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.108883    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/55d0e798-7e5a-4f3e-afc2-67dfb308d934-ovnkube-script-lib\") pod \"ovnkube-node-bfw7r\" (UID: \"55d0e798-7e5a-4f3e-afc2-67dfb308d934\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfw7r"
Jul 15 15:24:32.133908 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.108892    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/55d0e798-7e5a-4f3e-afc2-67dfb308d934-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bfw7r\" (UID: \"55d0e798-7e5a-4f3e-afc2-67dfb308d934\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfw7r"
Jul 15 15:24:32.133908 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.108902    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/15e11302-d7ea-4408-b48b-01b0aad5a6dd-multus-conf-dir\") pod \"multus-djdlq\" (UID: \"15e11302-d7ea-4408-b48b-01b0aad5a6dd\") " pod="openshift-multus/multus-djdlq"
Jul 15 15:24:32.133908 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.108909    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/55d0e798-7e5a-4f3e-afc2-67dfb308d934-ovn-node-metrics-cert\") pod \"ovnkube-node-bfw7r\" (UID: \"55d0e798-7e5a-4f3e-afc2-67dfb308d934\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfw7r"
Jul 15 15:24:32.133908 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.108918    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/55d0e798-7e5a-4f3e-afc2-67dfb308d934-host-cni-netd\") pod \"ovnkube-node-bfw7r\" (UID: \"55d0e798-7e5a-4f3e-afc2-67dfb308d934\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfw7r"
Jul 15 15:24:32.133908 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.108937    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/41596280-81e4-4be2-808b-8b53102dbe5a-host-slash\") pod \"iptables-alerter-lrbjr\" (UID: \"41596280-81e4-4be2-808b-8b53102dbe5a\") " pod="openshift-network-operator/iptables-alerter-lrbjr"
Jul 15 15:24:32.133908 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.108962    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/aa03530f-36a5-49a7-b513-1add7f6af1ce-konnectivity-ca\") pod \"konnectivity-agent-bz8r7\" (UID: \"aa03530f-36a5-49a7-b513-1add7f6af1ce\") " pod="kube-system/konnectivity-agent-bz8r7"
Jul 15 15:24:32.133908 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.108977    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6749dd0d-651a-432e-b79a-b580fb6a9200-etc-tuned\") pod \"tuned-2l7hr\" (UID: \"6749dd0d-651a-432e-b79a-b580fb6a9200\") " pod="openshift-cluster-node-tuning-operator/tuned-2l7hr"
Jul 15 15:24:32.133908 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.108936    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/55d0e798-7e5a-4f3e-afc2-67dfb308d934-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bfw7r\" (UID: \"55d0e798-7e5a-4f3e-afc2-67dfb308d934\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfw7r"
Jul 15 15:24:32.133908 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.109023    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pq8nx\" (UniqueName: \"kubernetes.io/projected/15e11302-d7ea-4408-b48b-01b0aad5a6dd-kube-api-access-pq8nx\") pod \"multus-djdlq\" (UID: \"15e11302-d7ea-4408-b48b-01b0aad5a6dd\") " pod="openshift-multus/multus-djdlq"
Jul 15 15:24:32.133908 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.109042    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/55d0e798-7e5a-4f3e-afc2-67dfb308d934-host-slash\") pod \"ovnkube-node-bfw7r\" (UID: \"55d0e798-7e5a-4f3e-afc2-67dfb308d934\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfw7r"
Jul 15 15:24:32.133908 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.109108    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/55d0e798-7e5a-4f3e-afc2-67dfb308d934-host-slash\") pod \"ovnkube-node-bfw7r\" (UID: \"55d0e798-7e5a-4f3e-afc2-67dfb308d934\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfw7r"
Jul 15 15:24:32.133908 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.109162    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/55d0e798-7e5a-4f3e-afc2-67dfb308d934-ovnkube-config\") pod \"ovnkube-node-bfw7r\" (UID: \"55d0e798-7e5a-4f3e-afc2-67dfb308d934\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfw7r"
Jul 15 15:24:32.133908 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.109162    2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 15 15:24:32.134577 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.112043    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/55d0e798-7e5a-4f3e-afc2-67dfb308d934-ovn-node-metrics-cert\") pod \"ovnkube-node-bfw7r\" (UID: \"55d0e798-7e5a-4f3e-afc2-67dfb308d934\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfw7r"
Jul 15 15:24:32.134577 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.116330    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qbfp\" (UniqueName: \"kubernetes.io/projected/55d0e798-7e5a-4f3e-afc2-67dfb308d934-kube-api-access-7qbfp\") pod \"ovnkube-node-bfw7r\" (UID: \"55d0e798-7e5a-4f3e-afc2-67dfb308d934\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfw7r"
Jul 15 15:24:32.134577 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.116537    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pq8nx\" (UniqueName: \"kubernetes.io/projected/15e11302-d7ea-4408-b48b-01b0aad5a6dd-kube-api-access-pq8nx\") pod \"multus-djdlq\" (UID: \"15e11302-d7ea-4408-b48b-01b0aad5a6dd\") " pod="openshift-multus/multus-djdlq"
Jul 15 15:24:32.366503 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.209500    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6749dd0d-651a-432e-b79a-b580fb6a9200-lib-modules\") pod \"tuned-2l7hr\" (UID: \"6749dd0d-651a-432e-b79a-b580fb6a9200\") " pod="openshift-cluster-node-tuning-operator/tuned-2l7hr"
Jul 15 15:24:32.366503 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.209521    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6749dd0d-651a-432e-b79a-b580fb6a9200-var-lib-kubelet\") pod \"tuned-2l7hr\" (UID: \"6749dd0d-651a-432e-b79a-b580fb6a9200\") " pod="openshift-cluster-node-tuning-operator/tuned-2l7hr"
Jul 15 15:24:32.366503 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.209534    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6749dd0d-651a-432e-b79a-b580fb6a9200-host\") pod \"tuned-2l7hr\" (UID: \"6749dd0d-651a-432e-b79a-b580fb6a9200\") " pod="openshift-cluster-node-tuning-operator/tuned-2l7hr"
Jul 15 15:24:32.366503 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.209546    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6749dd0d-651a-432e-b79a-b580fb6a9200-tmp\") pod \"tuned-2l7hr\" (UID: \"6749dd0d-651a-432e-b79a-b580fb6a9200\") " pod="openshift-cluster-node-tuning-operator/tuned-2l7hr"
Jul 15 15:24:32.366503 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.209561    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6749dd0d-651a-432e-b79a-b580fb6a9200-etc-sysctl-d\") pod \"tuned-2l7hr\" (UID: \"6749dd0d-651a-432e-b79a-b580fb6a9200\") " pod="openshift-cluster-node-tuning-operator/tuned-2l7hr"
Jul 15 15:24:32.366503 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.209576    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2txnn\" (UniqueName: \"kubernetes.io/projected/83ea2fad-6953-4605-bd20-4ca74169f20d-kube-api-access-2txnn\") pod \"multus-additional-cni-plugins-2s2fn\" (UID: \"83ea2fad-6953-4605-bd20-4ca74169f20d\") " pod="openshift-multus/multus-additional-cni-plugins-2s2fn"
Jul 15 15:24:32.366503 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.209626    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6749dd0d-651a-432e-b79a-b580fb6a9200-host\") pod \"tuned-2l7hr\" (UID: \"6749dd0d-651a-432e-b79a-b580fb6a9200\") " pod="openshift-cluster-node-tuning-operator/tuned-2l7hr"
Jul 15 15:24:32.366503 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.209651    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6749dd0d-651a-432e-b79a-b580fb6a9200-lib-modules\") pod \"tuned-2l7hr\" (UID: \"6749dd0d-651a-432e-b79a-b580fb6a9200\") " pod="openshift-cluster-node-tuning-operator/tuned-2l7hr"
Jul 15 15:24:32.366503 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.209665    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60d786ac-9c8b-48df-8e67-6aa7e976718d-metrics-certs\") pod \"network-metrics-daemon-w7zbl\" (UID: \"60d786ac-9c8b-48df-8e67-6aa7e976718d\") " pod="openshift-multus/network-metrics-daemon-w7zbl"
Jul 15 15:24:32.366503 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.209669    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6749dd0d-651a-432e-b79a-b580fb6a9200-etc-sysctl-d\") pod \"tuned-2l7hr\" (UID: \"6749dd0d-651a-432e-b79a-b580fb6a9200\") " pod="openshift-cluster-node-tuning-operator/tuned-2l7hr"
Jul 15 15:24:32.366503 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.209695    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6749dd0d-651a-432e-b79a-b580fb6a9200-etc-sysctl-conf\") pod \"tuned-2l7hr\" (UID: \"6749dd0d-651a-432e-b79a-b580fb6a9200\") " pod="openshift-cluster-node-tuning-operator/tuned-2l7hr"
Jul 15 15:24:32.366503 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.209721    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3988961d-1cd0-4fd2-aa28-80610f3ed94b-dbus\") pod \"global-pull-secret-syncer-rbktn\" (UID: \"3988961d-1cd0-4fd2-aa28-80610f3ed94b\") " pod="kube-system/global-pull-secret-syncer-rbktn"
Jul 15 15:24:32.366503 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:32.209733    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 15:24:32.366503 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.209737    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3988961d-1cd0-4fd2-aa28-80610f3ed94b-original-pull-secret\") pod \"global-pull-secret-syncer-rbktn\" (UID: \"3988961d-1cd0-4fd2-aa28-80610f3ed94b\") " pod="kube-system/global-pull-secret-syncer-rbktn"
Jul 15 15:24:32.366503 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.209801    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3988961d-1cd0-4fd2-aa28-80610f3ed94b-dbus\") pod \"global-pull-secret-syncer-rbktn\" (UID: \"3988961d-1cd0-4fd2-aa28-80610f3ed94b\") " pod="kube-system/global-pull-secret-syncer-rbktn"
Jul 15 15:24:32.366503 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:32.209806    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 15:24:32.368283 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.209802    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6749dd0d-651a-432e-b79a-b580fb6a9200-etc-sysctl-conf\") pod \"tuned-2l7hr\" (UID: \"6749dd0d-651a-432e-b79a-b580fb6a9200\") " pod="openshift-cluster-node-tuning-operator/tuned-2l7hr"
Jul 15 15:24:32.368283 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:32.209833    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60d786ac-9c8b-48df-8e67-6aa7e976718d-metrics-certs podName:60d786ac-9c8b-48df-8e67-6aa7e976718d nodeName:}" failed. No retries permitted until 2026-07-15 15:24:32.70977767 +0000 UTC m=+3.055680846 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/60d786ac-9c8b-48df-8e67-6aa7e976718d-metrics-certs") pod "network-metrics-daemon-w7zbl" (UID: "60d786ac-9c8b-48df-8e67-6aa7e976718d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 15:24:32.368283 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.209838    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6749dd0d-651a-432e-b79a-b580fb6a9200-var-lib-kubelet\") pod \"tuned-2l7hr\" (UID: \"6749dd0d-651a-432e-b79a-b580fb6a9200\") " pod="openshift-cluster-node-tuning-operator/tuned-2l7hr"
Jul 15 15:24:32.368283 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:32.209892    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3988961d-1cd0-4fd2-aa28-80610f3ed94b-original-pull-secret podName:3988961d-1cd0-4fd2-aa28-80610f3ed94b nodeName:}" failed. No retries permitted until 2026-07-15 15:24:32.709879935 +0000 UTC m=+3.055783105 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3988961d-1cd0-4fd2-aa28-80610f3ed94b-original-pull-secret") pod "global-pull-secret-syncer-rbktn" (UID: "3988961d-1cd0-4fd2-aa28-80610f3ed94b") : object "kube-system"/"original-pull-secret" not registered
Jul 15 15:24:32.368283 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.209906    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bd4f0795-8b44-4ea5-9a78-6c790d60ab3d-host\") pod \"node-ca-dq4f9\" (UID: \"bd4f0795-8b44-4ea5-9a78-6c790d60ab3d\") " pod="openshift-image-registry/node-ca-dq4f9"
Jul 15 15:24:32.368283 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.209922    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52587e3b-cd74-43d1-86aa-29a127627f90-tmp-dir\") pod \"node-resolver-4bhw5\" (UID: \"52587e3b-cd74-43d1-86aa-29a127627f90\") " pod="openshift-dns/node-resolver-4bhw5"
Jul 15 15:24:32.368283 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.209936    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4f72bead-ee18-4b6c-b262-7248e623c104-device-dir\") pod \"aws-ebs-csi-driver-node-f5hf8\" (UID: \"4f72bead-ee18-4b6c-b262-7248e623c104\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5hf8"
Jul 15 15:24:32.368283 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.209958    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6749dd0d-651a-432e-b79a-b580fb6a9200-etc-systemd\") pod \"tuned-2l7hr\" (UID: \"6749dd0d-651a-432e-b79a-b580fb6a9200\") " pod="openshift-cluster-node-tuning-operator/tuned-2l7hr"
Jul 15 15:24:32.368283 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.209965    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bd4f0795-8b44-4ea5-9a78-6c790d60ab3d-host\") pod \"node-ca-dq4f9\" (UID: \"bd4f0795-8b44-4ea5-9a78-6c790d60ab3d\") " pod="openshift-image-registry/node-ca-dq4f9"
Jul 15 15:24:32.368283 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.209976    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/83ea2fad-6953-4605-bd20-4ca74169f20d-system-cni-dir\") pod \"multus-additional-cni-plugins-2s2fn\" (UID: \"83ea2fad-6953-4605-bd20-4ca74169f20d\") " pod="openshift-multus/multus-additional-cni-plugins-2s2fn"
Jul 15 15:24:32.368283 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.209990    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4f72bead-ee18-4b6c-b262-7248e623c104-sys-fs\") pod \"aws-ebs-csi-driver-node-f5hf8\" (UID: \"4f72bead-ee18-4b6c-b262-7248e623c104\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5hf8"
Jul 15 15:24:32.368283 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.210025    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4f72bead-ee18-4b6c-b262-7248e623c104-socket-dir\") pod \"aws-ebs-csi-driver-node-f5hf8\" (UID: \"4f72bead-ee18-4b6c-b262-7248e623c104\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5hf8"
Jul 15 15:24:32.368283 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.210036    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6749dd0d-651a-432e-b79a-b580fb6a9200-etc-systemd\") pod \"tuned-2l7hr\" (UID: \"6749dd0d-651a-432e-b79a-b580fb6a9200\") " pod="openshift-cluster-node-tuning-operator/tuned-2l7hr"
Jul 15 15:24:32.369361 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.210026    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4f72bead-ee18-4b6c-b262-7248e623c104-device-dir\") pod \"aws-ebs-csi-driver-node-f5hf8\" (UID: \"4f72bead-ee18-4b6c-b262-7248e623c104\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5hf8"
Jul 15 15:24:32.369361 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.210049    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/83ea2fad-6953-4605-bd20-4ca74169f20d-system-cni-dir\") pod \"multus-additional-cni-plugins-2s2fn\" (UID: \"83ea2fad-6953-4605-bd20-4ca74169f20d\") " pod="openshift-multus/multus-additional-cni-plugins-2s2fn"
Jul 15 15:24:32.369361 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.210071    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4f72bead-ee18-4b6c-b262-7248e623c104-sys-fs\") pod \"aws-ebs-csi-driver-node-f5hf8\" (UID: \"4f72bead-ee18-4b6c-b262-7248e623c104\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5hf8"
Jul 15 15:24:32.369361 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.210073    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4f72bead-ee18-4b6c-b262-7248e623c104-etc-selinux\") pod \"aws-ebs-csi-driver-node-f5hf8\" (UID: \"4f72bead-ee18-4b6c-b262-7248e623c104\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5hf8"
Jul 15 15:24:32.369361 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.210102    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4f72bead-ee18-4b6c-b262-7248e623c104-etc-selinux\") pod \"aws-ebs-csi-driver-node-f5hf8\" (UID: \"4f72bead-ee18-4b6c-b262-7248e623c104\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5hf8"
Jul 15 15:24:32.369361 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.210116    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/83ea2fad-6953-4605-bd20-4ca74169f20d-cnibin\") pod \"multus-additional-cni-plugins-2s2fn\" (UID: \"83ea2fad-6953-4605-bd20-4ca74169f20d\") " pod="openshift-multus/multus-additional-cni-plugins-2s2fn"
Jul 15 15:24:32.369361 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.210129    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4f72bead-ee18-4b6c-b262-7248e623c104-socket-dir\") pod \"aws-ebs-csi-driver-node-f5hf8\" (UID: \"4f72bead-ee18-4b6c-b262-7248e623c104\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5hf8"
Jul 15 15:24:32.369361 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.210145    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czw52\" (UniqueName: \"kubernetes.io/projected/bff44260-d747-4265-af29-596728c30967-kube-api-access-czw52\") pod \"network-check-target-b7s72\" (UID: \"bff44260-d747-4265-af29-596728c30967\") " pod="openshift-network-diagnostics/network-check-target-b7s72"
Jul 15 15:24:32.369361 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.210161    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/83ea2fad-6953-4605-bd20-4ca74169f20d-cnibin\") pod \"multus-additional-cni-plugins-2s2fn\" (UID: \"83ea2fad-6953-4605-bd20-4ca74169f20d\") " pod="openshift-multus/multus-additional-cni-plugins-2s2fn"
Jul 15 15:24:32.369361 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.210170    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnz6m\" (UniqueName: \"kubernetes.io/projected/60d786ac-9c8b-48df-8e67-6aa7e976718d-kube-api-access-jnz6m\") pod \"network-metrics-daemon-w7zbl\" (UID: \"60d786ac-9c8b-48df-8e67-6aa7e976718d\") " pod="openshift-multus/network-metrics-daemon-w7zbl"
Jul 15 15:24:32.369361 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.210201    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4f72bead-ee18-4b6c-b262-7248e623c104-registration-dir\") pod \"aws-ebs-csi-driver-node-f5hf8\" (UID: \"4f72bead-ee18-4b6c-b262-7248e623c104\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5hf8"
Jul 15 15:24:32.369361 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.210274    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bd4f0795-8b44-4ea5-9a78-6c790d60ab3d-serviceca\") pod \"node-ca-dq4f9\" (UID: \"bd4f0795-8b44-4ea5-9a78-6c790d60ab3d\") " pod="openshift-image-registry/node-ca-dq4f9"
Jul 15 15:24:32.369361 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.210293    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6749dd0d-651a-432e-b79a-b580fb6a9200-etc-kubernetes\") pod \"tuned-2l7hr\" (UID: \"6749dd0d-651a-432e-b79a-b580fb6a9200\") " pod="openshift-cluster-node-tuning-operator/tuned-2l7hr"
Jul 15 15:24:32.369361 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.210309    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/83ea2fad-6953-4605-bd20-4ca74169f20d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2s2fn\" (UID: \"83ea2fad-6953-4605-bd20-4ca74169f20d\") " pod="openshift-multus/multus-additional-cni-plugins-2s2fn"
Jul 15 15:24:32.370444 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.210327    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/83ea2fad-6953-4605-bd20-4ca74169f20d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2s2fn\" (UID: \"83ea2fad-6953-4605-bd20-4ca74169f20d\") " pod="openshift-multus/multus-additional-cni-plugins-2s2fn"
Jul 15 15:24:32.370444 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.210356    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/41596280-81e4-4be2-808b-8b53102dbe5a-host-slash\") pod \"iptables-alerter-lrbjr\" (UID: \"41596280-81e4-4be2-808b-8b53102dbe5a\") " pod="openshift-network-operator/iptables-alerter-lrbjr"
Jul 15 15:24:32.370444 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.210367    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6749dd0d-651a-432e-b79a-b580fb6a9200-etc-kubernetes\") pod \"tuned-2l7hr\" (UID: \"6749dd0d-651a-432e-b79a-b580fb6a9200\") " pod="openshift-cluster-node-tuning-operator/tuned-2l7hr"
Jul 15 15:24:32.370444 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.210375    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4f72bead-ee18-4b6c-b262-7248e623c104-registration-dir\") pod \"aws-ebs-csi-driver-node-f5hf8\" (UID: \"4f72bead-ee18-4b6c-b262-7248e623c104\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5hf8"
Jul 15 15:24:32.370444 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.210380    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/aa03530f-36a5-49a7-b513-1add7f6af1ce-konnectivity-ca\") pod \"konnectivity-agent-bz8r7\" (UID: \"aa03530f-36a5-49a7-b513-1add7f6af1ce\") " pod="kube-system/konnectivity-agent-bz8r7"
Jul 15 15:24:32.370444 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.210944    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6749dd0d-651a-432e-b79a-b580fb6a9200-etc-tuned\") pod \"tuned-2l7hr\" (UID: \"6749dd0d-651a-432e-b79a-b580fb6a9200\") " pod="openshift-cluster-node-tuning-operator/tuned-2l7hr"
Jul 15 15:24:32.370444 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.210992    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqpwn\" (UniqueName: \"kubernetes.io/projected/41596280-81e4-4be2-808b-8b53102dbe5a-kube-api-access-dqpwn\") pod \"iptables-alerter-lrbjr\" (UID: \"41596280-81e4-4be2-808b-8b53102dbe5a\") " pod="openshift-network-operator/iptables-alerter-lrbjr"
Jul 15 15:24:32.370444 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.211039    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6749dd0d-651a-432e-b79a-b580fb6a9200-etc-sysconfig\") pod \"tuned-2l7hr\" (UID: \"6749dd0d-651a-432e-b79a-b580fb6a9200\") " pod="openshift-cluster-node-tuning-operator/tuned-2l7hr"
Jul 15 15:24:32.370444 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.211068    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/52587e3b-cd74-43d1-86aa-29a127627f90-hosts-file\") pod \"node-resolver-4bhw5\" (UID: \"52587e3b-cd74-43d1-86aa-29a127627f90\") " pod="openshift-dns/node-resolver-4bhw5"
Jul 15 15:24:32.370444 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.211093    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/aa03530f-36a5-49a7-b513-1add7f6af1ce-agent-certs\") pod \"konnectivity-agent-bz8r7\" (UID: \"aa03530f-36a5-49a7-b513-1add7f6af1ce\") " pod="kube-system/konnectivity-agent-bz8r7"
Jul 15 15:24:32.370444 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.211111    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcfzp\" (UniqueName: \"kubernetes.io/projected/bd4f0795-8b44-4ea5-9a78-6c790d60ab3d-kube-api-access-tcfzp\") pod \"node-ca-dq4f9\" (UID: \"bd4f0795-8b44-4ea5-9a78-6c790d60ab3d\") " pod="openshift-image-registry/node-ca-dq4f9"
Jul 15 15:24:32.370444 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.211141    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6749dd0d-651a-432e-b79a-b580fb6a9200-run\") pod \"tuned-2l7hr\" (UID: \"6749dd0d-651a-432e-b79a-b580fb6a9200\") " pod="openshift-cluster-node-tuning-operator/tuned-2l7hr"
Jul 15 15:24:32.370444 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.210955    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52587e3b-cd74-43d1-86aa-29a127627f90-tmp-dir\") pod \"node-resolver-4bhw5\" (UID: \"52587e3b-cd74-43d1-86aa-29a127627f90\") " pod="openshift-dns/node-resolver-4bhw5"
Jul 15 15:24:32.370444 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.211174    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/83ea2fad-6953-4605-bd20-4ca74169f20d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2s2fn\" (UID: \"83ea2fad-6953-4605-bd20-4ca74169f20d\") " pod="openshift-multus/multus-additional-cni-plugins-2s2fn"
Jul 15 15:24:32.371152 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.211209    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqlkk\" (UniqueName: \"kubernetes.io/projected/4f72bead-ee18-4b6c-b262-7248e623c104-kube-api-access-nqlkk\") pod \"aws-ebs-csi-driver-node-f5hf8\" (UID: \"4f72bead-ee18-4b6c-b262-7248e623c104\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5hf8"
Jul 15 15:24:32.371152 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.211241    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/41596280-81e4-4be2-808b-8b53102dbe5a-iptables-alerter-script\") pod \"iptables-alerter-lrbjr\" (UID: \"41596280-81e4-4be2-808b-8b53102dbe5a\") " pod="openshift-network-operator/iptables-alerter-lrbjr"
Jul 15 15:24:32.371152 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.211249    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/52587e3b-cd74-43d1-86aa-29a127627f90-hosts-file\") pod \"node-resolver-4bhw5\" (UID: \"52587e3b-cd74-43d1-86aa-29a127627f90\") " pod="openshift-dns/node-resolver-4bhw5"
Jul 15 15:24:32.371152 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.210806    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/41596280-81e4-4be2-808b-8b53102dbe5a-host-slash\") pod \"iptables-alerter-lrbjr\" (UID: \"41596280-81e4-4be2-808b-8b53102dbe5a\") " pod="openshift-network-operator/iptables-alerter-lrbjr"
Jul 15 15:24:32.371152 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.211275    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6749dd0d-651a-432e-b79a-b580fb6a9200-etc-modprobe-d\") pod \"tuned-2l7hr\" (UID: \"6749dd0d-651a-432e-b79a-b580fb6a9200\") " pod="openshift-cluster-node-tuning-operator/tuned-2l7hr"
Jul 15 15:24:32.371152 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.211309    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjk6r\" (UniqueName: \"kubernetes.io/projected/6749dd0d-651a-432e-b79a-b580fb6a9200-kube-api-access-bjk6r\") pod \"tuned-2l7hr\" (UID: \"6749dd0d-651a-432e-b79a-b580fb6a9200\") " pod="openshift-cluster-node-tuning-operator/tuned-2l7hr"
Jul 15 15:24:32.371152 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.211390    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6749dd0d-651a-432e-b79a-b580fb6a9200-etc-sysconfig\") pod \"tuned-2l7hr\" (UID: \"6749dd0d-651a-432e-b79a-b580fb6a9200\") " pod="openshift-cluster-node-tuning-operator/tuned-2l7hr"
Jul 15 15:24:32.371152 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.211442    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/83ea2fad-6953-4605-bd20-4ca74169f20d-cni-binary-copy\") pod \"multus-additional-cni-plugins-2s2fn\" (UID: \"83ea2fad-6953-4605-bd20-4ca74169f20d\") " pod="openshift-multus/multus-additional-cni-plugins-2s2fn"
Jul 15 15:24:32.371152 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.211474    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/aa03530f-36a5-49a7-b513-1add7f6af1ce-konnectivity-ca\") pod \"konnectivity-agent-bz8r7\" (UID: \"aa03530f-36a5-49a7-b513-1add7f6af1ce\") " pod="kube-system/konnectivity-agent-bz8r7"
Jul 15 15:24:32.371152 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.211479    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6749dd0d-651a-432e-b79a-b580fb6a9200-etc-modprobe-d\") pod \"tuned-2l7hr\" (UID: \"6749dd0d-651a-432e-b79a-b580fb6a9200\") " pod="openshift-cluster-node-tuning-operator/tuned-2l7hr"
Jul 15 15:24:32.371152 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.211241    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bd4f0795-8b44-4ea5-9a78-6c790d60ab3d-serviceca\") pod \"node-ca-dq4f9\" (UID: \"bd4f0795-8b44-4ea5-9a78-6c790d60ab3d\") " pod="openshift-image-registry/node-ca-dq4f9"
Jul 15 15:24:32.371152 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.211499    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3988961d-1cd0-4fd2-aa28-80610f3ed94b-kubelet-config\") pod \"global-pull-secret-syncer-rbktn\" (UID: \"3988961d-1cd0-4fd2-aa28-80610f3ed94b\") " pod="kube-system/global-pull-secret-syncer-rbktn"
Jul 15 15:24:32.371152 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.211545    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/83ea2fad-6953-4605-bd20-4ca74169f20d-os-release\") pod \"multus-additional-cni-plugins-2s2fn\" (UID: \"83ea2fad-6953-4605-bd20-4ca74169f20d\") " pod="openshift-multus/multus-additional-cni-plugins-2s2fn"
Jul 15 15:24:32.371152 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.211575    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9gs6\" (UniqueName: \"kubernetes.io/projected/52587e3b-cd74-43d1-86aa-29a127627f90-kube-api-access-k9gs6\") pod \"node-resolver-4bhw5\" (UID: \"52587e3b-cd74-43d1-86aa-29a127627f90\") " pod="openshift-dns/node-resolver-4bhw5"
Jul 15 15:24:32.372588 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.211603    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6749dd0d-651a-432e-b79a-b580fb6a9200-sys\") pod \"tuned-2l7hr\" (UID: \"6749dd0d-651a-432e-b79a-b580fb6a9200\") " pod="openshift-cluster-node-tuning-operator/tuned-2l7hr"
Jul 15 15:24:32.372588 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.211610    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3988961d-1cd0-4fd2-aa28-80610f3ed94b-kubelet-config\") pod \"global-pull-secret-syncer-rbktn\" (UID: \"3988961d-1cd0-4fd2-aa28-80610f3ed94b\") " pod="kube-system/global-pull-secret-syncer-rbktn"
Jul 15 15:24:32.372588 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.211711    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/83ea2fad-6953-4605-bd20-4ca74169f20d-os-release\") pod \"multus-additional-cni-plugins-2s2fn\" (UID: \"83ea2fad-6953-4605-bd20-4ca74169f20d\") " pod="openshift-multus/multus-additional-cni-plugins-2s2fn"
Jul 15 15:24:32.372588 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.211756    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4f72bead-ee18-4b6c-b262-7248e623c104-kubelet-dir\") pod \"aws-ebs-csi-driver-node-f5hf8\" (UID: \"4f72bead-ee18-4b6c-b262-7248e623c104\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5hf8"
Jul 15 15:24:32.372588 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.211857    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4f72bead-ee18-4b6c-b262-7248e623c104-kubelet-dir\") pod \"aws-ebs-csi-driver-node-f5hf8\" (UID: \"4f72bead-ee18-4b6c-b262-7248e623c104\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5hf8"
Jul 15 15:24:32.372588 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.211915    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6749dd0d-651a-432e-b79a-b580fb6a9200-run\") pod \"tuned-2l7hr\" (UID: \"6749dd0d-651a-432e-b79a-b580fb6a9200\") " pod="openshift-cluster-node-tuning-operator/tuned-2l7hr"
Jul 15 15:24:32.372588 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.211927    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6749dd0d-651a-432e-b79a-b580fb6a9200-sys\") pod \"tuned-2l7hr\" (UID: \"6749dd0d-651a-432e-b79a-b580fb6a9200\") " pod="openshift-cluster-node-tuning-operator/tuned-2l7hr"
Jul 15 15:24:32.372588 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.212037    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/83ea2fad-6953-4605-bd20-4ca74169f20d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2s2fn\" (UID: \"83ea2fad-6953-4605-bd20-4ca74169f20d\") " pod="openshift-multus/multus-additional-cni-plugins-2s2fn"
Jul 15 15:24:32.372588 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.212154    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/83ea2fad-6953-4605-bd20-4ca74169f20d-cni-binary-copy\") pod \"multus-additional-cni-plugins-2s2fn\" (UID: \"83ea2fad-6953-4605-bd20-4ca74169f20d\") " pod="openshift-multus/multus-additional-cni-plugins-2s2fn"
Jul 15 15:24:32.372588 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.212265    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6749dd0d-651a-432e-b79a-b580fb6a9200-tmp\") pod \"tuned-2l7hr\" (UID: \"6749dd0d-651a-432e-b79a-b580fb6a9200\") " pod="openshift-cluster-node-tuning-operator/tuned-2l7hr"
Jul 15 15:24:32.372588 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.212315    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/83ea2fad-6953-4605-bd20-4ca74169f20d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2s2fn\" (UID: \"83ea2fad-6953-4605-bd20-4ca74169f20d\") " pod="openshift-multus/multus-additional-cni-plugins-2s2fn"
Jul 15 15:24:32.372588 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.212334    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/83ea2fad-6953-4605-bd20-4ca74169f20d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2s2fn\" (UID: \"83ea2fad-6953-4605-bd20-4ca74169f20d\") " pod="openshift-multus/multus-additional-cni-plugins-2s2fn"
Jul 15 15:24:32.372588 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.212777    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/41596280-81e4-4be2-808b-8b53102dbe5a-iptables-alerter-script\") pod \"iptables-alerter-lrbjr\" (UID: \"41596280-81e4-4be2-808b-8b53102dbe5a\") " pod="openshift-network-operator/iptables-alerter-lrbjr"
Jul 15 15:24:32.372588 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.217162    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/aa03530f-36a5-49a7-b513-1add7f6af1ce-agent-certs\") pod \"konnectivity-agent-bz8r7\" (UID: \"aa03530f-36a5-49a7-b513-1add7f6af1ce\") " pod="kube-system/konnectivity-agent-bz8r7"
Jul 15 15:24:32.373466 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.217803    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6749dd0d-651a-432e-b79a-b580fb6a9200-etc-tuned\") pod \"tuned-2l7hr\" (UID: \"6749dd0d-651a-432e-b79a-b580fb6a9200\") " pod="openshift-cluster-node-tuning-operator/tuned-2l7hr"
Jul 15 15:24:32.373466 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:32.220369    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 15:24:32.373466 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:32.220382    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 15:24:32.373466 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:32.220392    2564 projected.go:196] Error preparing data for projected volume kube-api-access-czw52 for pod openshift-network-diagnostics/network-check-target-b7s72: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 15:24:32.373466 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:32.220433    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bff44260-d747-4265-af29-596728c30967-kube-api-access-czw52 podName:bff44260-d747-4265-af29-596728c30967 nodeName:}" failed. No retries permitted until 2026-07-15 15:24:32.720423166 +0000 UTC m=+3.066326337 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-czw52" (UniqueName: "kubernetes.io/projected/bff44260-d747-4265-af29-596728c30967-kube-api-access-czw52") pod "network-check-target-b7s72" (UID: "bff44260-d747-4265-af29-596728c30967") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 15:24:32.373466 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.221532    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnz6m\" (UniqueName: \"kubernetes.io/projected/60d786ac-9c8b-48df-8e67-6aa7e976718d-kube-api-access-jnz6m\") pod \"network-metrics-daemon-w7zbl\" (UID: \"60d786ac-9c8b-48df-8e67-6aa7e976718d\") " pod="openshift-multus/network-metrics-daemon-w7zbl"
Jul 15 15:24:32.373466 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.223128    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjk6r\" (UniqueName: \"kubernetes.io/projected/6749dd0d-651a-432e-b79a-b580fb6a9200-kube-api-access-bjk6r\") pod \"tuned-2l7hr\" (UID: \"6749dd0d-651a-432e-b79a-b580fb6a9200\") " pod="openshift-cluster-node-tuning-operator/tuned-2l7hr"
Jul 15 15:24:32.373466 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.223126    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2txnn\" (UniqueName: \"kubernetes.io/projected/83ea2fad-6953-4605-bd20-4ca74169f20d-kube-api-access-2txnn\") pod \"multus-additional-cni-plugins-2s2fn\" (UID: \"83ea2fad-6953-4605-bd20-4ca74169f20d\") " pod="openshift-multus/multus-additional-cni-plugins-2s2fn"
Jul 15 15:24:32.373466 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.223517    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqlkk\" (UniqueName: \"kubernetes.io/projected/4f72bead-ee18-4b6c-b262-7248e623c104-kube-api-access-nqlkk\") pod \"aws-ebs-csi-driver-node-f5hf8\" (UID: \"4f72bead-ee18-4b6c-b262-7248e623c104\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5hf8"
Jul 15 15:24:32.373466 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.223621    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqpwn\" (UniqueName: \"kubernetes.io/projected/41596280-81e4-4be2-808b-8b53102dbe5a-kube-api-access-dqpwn\") pod \"iptables-alerter-lrbjr\" (UID: \"41596280-81e4-4be2-808b-8b53102dbe5a\") " pod="openshift-network-operator/iptables-alerter-lrbjr"
Jul 15 15:24:32.373466 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.224134    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcfzp\" (UniqueName: \"kubernetes.io/projected/bd4f0795-8b44-4ea5-9a78-6c790d60ab3d-kube-api-access-tcfzp\") pod \"node-ca-dq4f9\" (UID: \"bd4f0795-8b44-4ea5-9a78-6c790d60ab3d\") " pod="openshift-image-registry/node-ca-dq4f9"
Jul 15 15:24:32.373466 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.224638    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9gs6\" (UniqueName: \"kubernetes.io/projected/52587e3b-cd74-43d1-86aa-29a127627f90-kube-api-access-k9gs6\") pod \"node-resolver-4bhw5\" (UID: \"52587e3b-cd74-43d1-86aa-29a127627f90\") " pod="openshift-dns/node-resolver-4bhw5"
Jul 15 15:24:32.373466 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.226590    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-107.ec2.internal" event={"ID":"b19951ca4f9c82c97fd02d9646bbed61","Type":"ContainerStarted","Data":"ec49b22bb14cc693cc65d0ca2f9e6eb98a6bab1b635f0f6c6d8e3c4beba6f92c"}
Jul 15 15:24:32.373466 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.227531    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-107.ec2.internal" event={"ID":"ab8a58b7f0cfe687e1e923428993b5f1","Type":"ContainerStarted","Data":"2b56bb12b266248d7b6914b4e5596fe3e577b5e9e81c1912bae3baa24e4bbd30"}
Jul 15 15:24:32.373466 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.302797    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bfw7r"
Jul 15 15:24:32.374558 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.309865    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-djdlq"
Jul 15 15:24:32.374558 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:32.314480    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55d0e798_7e5a_4f3e_afc2_67dfb308d934.slice/crio-f104e1ad2425cc36f71de432c8c09a7b691dcb962b761cd102a43bf6f4cd6ff8 WatchSource:0}: Error finding container f104e1ad2425cc36f71de432c8c09a7b691dcb962b761cd102a43bf6f4cd6ff8: Status 404 returned error can't find the container with id f104e1ad2425cc36f71de432c8c09a7b691dcb962b761cd102a43bf6f4cd6ff8
Jul 15 15:24:32.374558 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.316699    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4bhw5"
Jul 15 15:24:32.374558 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:32.319194    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15e11302_d7ea_4408_b48b_01b0aad5a6dd.slice/crio-1109f2e4a66022a524ad84a1362411255127b116fdb6f275eea119a27c909603 WatchSource:0}: Error finding container 1109f2e4a66022a524ad84a1362411255127b116fdb6f275eea119a27c909603: Status 404 returned error can't find the container with id 1109f2e4a66022a524ad84a1362411255127b116fdb6f275eea119a27c909603
Jul 15 15:24:32.374558 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.324509    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dq4f9"
Jul 15 15:24:32.374558 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.329833    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5hf8"
Jul 15 15:24:32.374558 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:32.330855    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52587e3b_cd74_43d1_86aa_29a127627f90.slice/crio-2b3d65b9a8ce7d0696889234103b183964286fcbe82f66139fc9fea03b58b53f WatchSource:0}: Error finding container 2b3d65b9a8ce7d0696889234103b183964286fcbe82f66139fc9fea03b58b53f: Status 404 returned error can't find the container with id 2b3d65b9a8ce7d0696889234103b183964286fcbe82f66139fc9fea03b58b53f
Jul 15 15:24:32.374558 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.336030    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lrbjr"
Jul 15 15:24:32.374558 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:32.337939    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd4f0795_8b44_4ea5_9a78_6c790d60ab3d.slice/crio-b4be6dc0140b903828d8daa0d596a1f46eae21c3c6677a0f65584a3bfaf39e86 WatchSource:0}: Error finding container b4be6dc0140b903828d8daa0d596a1f46eae21c3c6677a0f65584a3bfaf39e86: Status 404 returned error can't find the container with id b4be6dc0140b903828d8daa0d596a1f46eae21c3c6677a0f65584a3bfaf39e86
Jul 15 15:24:32.374558 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:32.339911    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f72bead_ee18_4b6c_b262_7248e623c104.slice/crio-8d350d09e6ee01d8d5f6f60db02c562f99dcd9edd1f79f0b1d2179484eb94f9b WatchSource:0}: Error finding container 8d350d09e6ee01d8d5f6f60db02c562f99dcd9edd1f79f0b1d2179484eb94f9b: Status 404 returned error can't find the container with id 8d350d09e6ee01d8d5f6f60db02c562f99dcd9edd1f79f0b1d2179484eb94f9b
Jul 15 15:24:32.374558 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.340533    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2l7hr"
Jul 15 15:24:32.374558 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:32.344668    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41596280_81e4_4be2_808b_8b53102dbe5a.slice/crio-43ccd3a4b5cd2c5719fce1aee30cb42c688a30f9853916ff71f03aaf606b1133 WatchSource:0}: Error finding container 43ccd3a4b5cd2c5719fce1aee30cb42c688a30f9853916ff71f03aaf606b1133: Status 404 returned error can't find the container with id 43ccd3a4b5cd2c5719fce1aee30cb42c688a30f9853916ff71f03aaf606b1133
Jul 15 15:24:32.374558 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.347783    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bz8r7"
Jul 15 15:24:32.374558 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:32.348978    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6749dd0d_651a_432e_b79a_b580fb6a9200.slice/crio-04254561fbcb77d8b8511c85a4ed53ec07921edb2cc2792f2bd67580a378f505 WatchSource:0}: Error finding container 04254561fbcb77d8b8511c85a4ed53ec07921edb2cc2792f2bd67580a378f505: Status 404 returned error can't find the container with id 04254561fbcb77d8b8511c85a4ed53ec07921edb2cc2792f2bd67580a378f505
Jul 15 15:24:32.374558 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.352563    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2s2fn"
Jul 15 15:24:32.375430 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:24:32.356607    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa03530f_36a5_49a7_b513_1add7f6af1ce.slice/crio-e332e49679a89bbbff0eec831944c8a2a4736e1f8c80c5eb1c4fc0c6623b9011 WatchSource:0}: Error finding container e332e49679a89bbbff0eec831944c8a2a4736e1f8c80c5eb1c4fc0c6623b9011: Status 404 returned error can't find the container with id e332e49679a89bbbff0eec831944c8a2a4736e1f8c80c5eb1c4fc0c6623b9011
Jul 15 15:24:32.611706 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.414277    2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 15:24:32.731743 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.716020    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60d786ac-9c8b-48df-8e67-6aa7e976718d-metrics-certs\") pod \"network-metrics-daemon-w7zbl\" (UID: \"60d786ac-9c8b-48df-8e67-6aa7e976718d\") " pod="openshift-multus/network-metrics-daemon-w7zbl"
Jul 15 15:24:32.731743 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.716065    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3988961d-1cd0-4fd2-aa28-80610f3ed94b-original-pull-secret\") pod \"global-pull-secret-syncer-rbktn\" (UID: \"3988961d-1cd0-4fd2-aa28-80610f3ed94b\") " pod="kube-system/global-pull-secret-syncer-rbktn"
Jul 15 15:24:32.731743 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:32.716185    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 15:24:32.731743 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:32.716243    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60d786ac-9c8b-48df-8e67-6aa7e976718d-metrics-certs podName:60d786ac-9c8b-48df-8e67-6aa7e976718d nodeName:}" failed. No retries permitted until 2026-07-15 15:24:33.716223805 +0000 UTC m=+4.062126980 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/60d786ac-9c8b-48df-8e67-6aa7e976718d-metrics-certs") pod "network-metrics-daemon-w7zbl" (UID: "60d786ac-9c8b-48df-8e67-6aa7e976718d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 15:24:32.731743 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:32.716185    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 15:24:32.731743 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:32.716351    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3988961d-1cd0-4fd2-aa28-80610f3ed94b-original-pull-secret podName:3988961d-1cd0-4fd2-aa28-80610f3ed94b nodeName:}" failed. No retries permitted until 2026-07-15 15:24:33.716329923 +0000 UTC m=+4.062233109 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3988961d-1cd0-4fd2-aa28-80610f3ed94b-original-pull-secret") pod "global-pull-secret-syncer-rbktn" (UID: "3988961d-1cd0-4fd2-aa28-80610f3ed94b") : object "kube-system"/"original-pull-secret" not registered
Jul 15 15:24:32.858556 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:32.816903    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czw52\" (UniqueName: \"kubernetes.io/projected/bff44260-d747-4265-af29-596728c30967-kube-api-access-czw52\") pod \"network-check-target-b7s72\" (UID: \"bff44260-d747-4265-af29-596728c30967\") " pod="openshift-network-diagnostics/network-check-target-b7s72"
Jul 15 15:24:32.858556 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:32.817063    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 15:24:32.858556 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:32.817090    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 15:24:32.858556 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:32.817102    2564 projected.go:196] Error preparing data for projected volume kube-api-access-czw52 for pod openshift-network-diagnostics/network-check-target-b7s72: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 15:24:32.858556 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:32.817170    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bff44260-d747-4265-af29-596728c30967-kube-api-access-czw52 podName:bff44260-d747-4265-af29-596728c30967 nodeName:}" failed. No retries permitted until 2026-07-15 15:24:33.817152899 +0000 UTC m=+4.163056071 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-czw52" (UniqueName: "kubernetes.io/projected/bff44260-d747-4265-af29-596728c30967-kube-api-access-czw52") pod "network-check-target-b7s72" (UID: "bff44260-d747-4265-af29-596728c30967") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 15:24:33.053490 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:33.053450    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 15:19:32 +0000 UTC" deadline="2027-12-30 23:00:41.227117329 +0000 UTC"
Jul 15 15:24:33.053612 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:33.053492    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12799h36m8.173633438s"
Jul 15 15:24:33.223607 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:33.223528    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rbktn"
Jul 15 15:24:33.224304 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:33.223668    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rbktn" podUID="3988961d-1cd0-4fd2-aa28-80610f3ed94b"
Jul 15 15:24:33.242701 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:33.242672    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lrbjr" event={"ID":"41596280-81e4-4be2-808b-8b53102dbe5a","Type":"ContainerStarted","Data":"43ccd3a4b5cd2c5719fce1aee30cb42c688a30f9853916ff71f03aaf606b1133"}
Jul 15 15:24:33.245400 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:33.245328    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4bhw5" event={"ID":"52587e3b-cd74-43d1-86aa-29a127627f90","Type":"ContainerStarted","Data":"2b3d65b9a8ce7d0696889234103b183964286fcbe82f66139fc9fea03b58b53f"}
Jul 15 15:24:33.247306 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:33.247260    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bfw7r" event={"ID":"55d0e798-7e5a-4f3e-afc2-67dfb308d934","Type":"ContainerStarted","Data":"f104e1ad2425cc36f71de432c8c09a7b691dcb962b761cd102a43bf6f4cd6ff8"}
Jul 15 15:24:33.251667 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:33.251644    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2l7hr" event={"ID":"6749dd0d-651a-432e-b79a-b580fb6a9200","Type":"ContainerStarted","Data":"04254561fbcb77d8b8511c85a4ed53ec07921edb2cc2792f2bd67580a378f505"}
Jul 15 15:24:33.254127 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:33.254102    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5hf8" event={"ID":"4f72bead-ee18-4b6c-b262-7248e623c104","Type":"ContainerStarted","Data":"8d350d09e6ee01d8d5f6f60db02c562f99dcd9edd1f79f0b1d2179484eb94f9b"}
Jul 15 15:24:33.258747 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:33.258724    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dq4f9" event={"ID":"bd4f0795-8b44-4ea5-9a78-6c790d60ab3d","Type":"ContainerStarted","Data":"b4be6dc0140b903828d8daa0d596a1f46eae21c3c6677a0f65584a3bfaf39e86"}
Jul 15 15:24:33.279022 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:33.275671    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-djdlq" event={"ID":"15e11302-d7ea-4408-b48b-01b0aad5a6dd","Type":"ContainerStarted","Data":"1109f2e4a66022a524ad84a1362411255127b116fdb6f275eea119a27c909603"}
Jul 15 15:24:33.290379 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:33.290358    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2s2fn" event={"ID":"83ea2fad-6953-4605-bd20-4ca74169f20d","Type":"ContainerStarted","Data":"eba0f8e6fdb2d8f4045c257954fef8ee8e5070b2302895a9ab572fdf28d9936f"}
Jul 15 15:24:33.302391 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:33.302054    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bz8r7" event={"ID":"aa03530f-36a5-49a7-b513-1add7f6af1ce","Type":"ContainerStarted","Data":"e332e49679a89bbbff0eec831944c8a2a4736e1f8c80c5eb1c4fc0c6623b9011"}
Jul 15 15:24:33.724186 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:33.724161    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3988961d-1cd0-4fd2-aa28-80610f3ed94b-original-pull-secret\") pod \"global-pull-secret-syncer-rbktn\" (UID: \"3988961d-1cd0-4fd2-aa28-80610f3ed94b\") " pod="kube-system/global-pull-secret-syncer-rbktn"
Jul 15 15:24:33.724330 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:33.724258    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60d786ac-9c8b-48df-8e67-6aa7e976718d-metrics-certs\") pod \"network-metrics-daemon-w7zbl\" (UID: \"60d786ac-9c8b-48df-8e67-6aa7e976718d\") " pod="openshift-multus/network-metrics-daemon-w7zbl"
Jul 15 15:24:33.724420 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:33.724378    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 15:24:33.724477 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:33.724441    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60d786ac-9c8b-48df-8e67-6aa7e976718d-metrics-certs podName:60d786ac-9c8b-48df-8e67-6aa7e976718d nodeName:}" failed. No retries permitted until 2026-07-15 15:24:35.724421675 +0000 UTC m=+6.070324863 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/60d786ac-9c8b-48df-8e67-6aa7e976718d-metrics-certs") pod "network-metrics-daemon-w7zbl" (UID: "60d786ac-9c8b-48df-8e67-6aa7e976718d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 15:24:33.724999 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:33.724977    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 15:24:33.725098 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:33.725047    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3988961d-1cd0-4fd2-aa28-80610f3ed94b-original-pull-secret podName:3988961d-1cd0-4fd2-aa28-80610f3ed94b nodeName:}" failed. No retries permitted until 2026-07-15 15:24:35.725030611 +0000 UTC m=+6.070933789 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3988961d-1cd0-4fd2-aa28-80610f3ed94b-original-pull-secret") pod "global-pull-secret-syncer-rbktn" (UID: "3988961d-1cd0-4fd2-aa28-80610f3ed94b") : object "kube-system"/"original-pull-secret" not registered
Jul 15 15:24:33.825761 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:33.825725    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czw52\" (UniqueName: \"kubernetes.io/projected/bff44260-d747-4265-af29-596728c30967-kube-api-access-czw52\") pod \"network-check-target-b7s72\" (UID: \"bff44260-d747-4265-af29-596728c30967\") " pod="openshift-network-diagnostics/network-check-target-b7s72"
Jul 15 15:24:33.825975 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:33.825954    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 15:24:33.826065 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:33.825983    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 15:24:33.826065 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:33.825996    2564 projected.go:196] Error preparing data for projected volume kube-api-access-czw52 for pod openshift-network-diagnostics/network-check-target-b7s72: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 15:24:33.826176 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:33.826071    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bff44260-d747-4265-af29-596728c30967-kube-api-access-czw52 podName:bff44260-d747-4265-af29-596728c30967 nodeName:}" failed. No retries permitted until 2026-07-15 15:24:35.826053883 +0000 UTC m=+6.171957068 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-czw52" (UniqueName: "kubernetes.io/projected/bff44260-d747-4265-af29-596728c30967-kube-api-access-czw52") pod "network-check-target-b7s72" (UID: "bff44260-d747-4265-af29-596728c30967") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 15:24:34.054665 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:34.054582    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 15:19:32 +0000 UTC" deadline="2028-05-01 09:20:17.274885782 +0000 UTC"
Jul 15 15:24:34.054665 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:34.054616    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15737h55m43.220273907s"
Jul 15 15:24:34.231616 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:34.229990    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w7zbl"
Jul 15 15:24:34.231616 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:34.230194    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w7zbl" podUID="60d786ac-9c8b-48df-8e67-6aa7e976718d"
Jul 15 15:24:34.231616 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:34.230652    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b7s72"
Jul 15 15:24:34.231616 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:34.230765    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b7s72" podUID="bff44260-d747-4265-af29-596728c30967"
Jul 15 15:24:35.224110 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:35.223618    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rbktn"
Jul 15 15:24:35.224110 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:35.223756    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rbktn" podUID="3988961d-1cd0-4fd2-aa28-80610f3ed94b"
Jul 15 15:24:35.742719 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:35.742668    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60d786ac-9c8b-48df-8e67-6aa7e976718d-metrics-certs\") pod \"network-metrics-daemon-w7zbl\" (UID: \"60d786ac-9c8b-48df-8e67-6aa7e976718d\") " pod="openshift-multus/network-metrics-daemon-w7zbl"
Jul 15 15:24:35.743204 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:35.742731    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3988961d-1cd0-4fd2-aa28-80610f3ed94b-original-pull-secret\") pod \"global-pull-secret-syncer-rbktn\" (UID: \"3988961d-1cd0-4fd2-aa28-80610f3ed94b\") " pod="kube-system/global-pull-secret-syncer-rbktn"
Jul 15 15:24:35.743204 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:35.742838    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 15:24:35.743204 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:35.742858    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 15:24:35.743204 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:35.742910    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60d786ac-9c8b-48df-8e67-6aa7e976718d-metrics-certs podName:60d786ac-9c8b-48df-8e67-6aa7e976718d nodeName:}" failed. No retries permitted until 2026-07-15 15:24:39.742890744 +0000 UTC m=+10.088793921 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/60d786ac-9c8b-48df-8e67-6aa7e976718d-metrics-certs") pod "network-metrics-daemon-w7zbl" (UID: "60d786ac-9c8b-48df-8e67-6aa7e976718d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 15:24:35.743204 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:35.742927    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3988961d-1cd0-4fd2-aa28-80610f3ed94b-original-pull-secret podName:3988961d-1cd0-4fd2-aa28-80610f3ed94b nodeName:}" failed. No retries permitted until 2026-07-15 15:24:39.742918763 +0000 UTC m=+10.088821936 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3988961d-1cd0-4fd2-aa28-80610f3ed94b-original-pull-secret") pod "global-pull-secret-syncer-rbktn" (UID: "3988961d-1cd0-4fd2-aa28-80610f3ed94b") : object "kube-system"/"original-pull-secret" not registered
Jul 15 15:24:35.843789 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:35.843749    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czw52\" (UniqueName: \"kubernetes.io/projected/bff44260-d747-4265-af29-596728c30967-kube-api-access-czw52\") pod \"network-check-target-b7s72\" (UID: \"bff44260-d747-4265-af29-596728c30967\") " pod="openshift-network-diagnostics/network-check-target-b7s72"
Jul 15 15:24:35.843966 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:35.843904    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 15:24:35.843966 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:35.843936    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 15:24:35.843966 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:35.843949    2564 projected.go:196] Error preparing data for projected volume kube-api-access-czw52 for pod openshift-network-diagnostics/network-check-target-b7s72: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 15:24:35.844154 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:35.844033    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bff44260-d747-4265-af29-596728c30967-kube-api-access-czw52 podName:bff44260-d747-4265-af29-596728c30967 nodeName:}" failed. No retries permitted until 2026-07-15 15:24:39.843999115 +0000 UTC m=+10.189902289 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-czw52" (UniqueName: "kubernetes.io/projected/bff44260-d747-4265-af29-596728c30967-kube-api-access-czw52") pod "network-check-target-b7s72" (UID: "bff44260-d747-4265-af29-596728c30967") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 15:24:36.225665 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:36.225575    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w7zbl"
Jul 15 15:24:36.225825 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:36.225714    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w7zbl" podUID="60d786ac-9c8b-48df-8e67-6aa7e976718d"
Jul 15 15:24:36.226124 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:36.226104    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b7s72"
Jul 15 15:24:36.226240 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:36.226198    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b7s72" podUID="bff44260-d747-4265-af29-596728c30967"
Jul 15 15:24:37.223842 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:37.223814    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rbktn"
Jul 15 15:24:37.224319 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:37.223931    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rbktn" podUID="3988961d-1cd0-4fd2-aa28-80610f3ed94b"
Jul 15 15:24:38.223522 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:38.223486    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b7s72"
Jul 15 15:24:38.223687 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:38.223615    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b7s72" podUID="bff44260-d747-4265-af29-596728c30967"
Jul 15 15:24:38.224219 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:38.224069    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w7zbl"
Jul 15 15:24:38.224219 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:38.224180    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w7zbl" podUID="60d786ac-9c8b-48df-8e67-6aa7e976718d"
Jul 15 15:24:39.223683 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:39.223657    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rbktn"
Jul 15 15:24:39.223855 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:39.223768    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rbktn" podUID="3988961d-1cd0-4fd2-aa28-80610f3ed94b"
Jul 15 15:24:39.778255 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:39.778223    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60d786ac-9c8b-48df-8e67-6aa7e976718d-metrics-certs\") pod \"network-metrics-daemon-w7zbl\" (UID: \"60d786ac-9c8b-48df-8e67-6aa7e976718d\") " pod="openshift-multus/network-metrics-daemon-w7zbl"
Jul 15 15:24:39.778255 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:39.778261    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3988961d-1cd0-4fd2-aa28-80610f3ed94b-original-pull-secret\") pod \"global-pull-secret-syncer-rbktn\" (UID: \"3988961d-1cd0-4fd2-aa28-80610f3ed94b\") " pod="kube-system/global-pull-secret-syncer-rbktn"
Jul 15 15:24:39.778781 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:39.778413    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 15:24:39.778781 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:39.778463    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3988961d-1cd0-4fd2-aa28-80610f3ed94b-original-pull-secret podName:3988961d-1cd0-4fd2-aa28-80610f3ed94b nodeName:}" failed. No retries permitted until 2026-07-15 15:24:47.778449209 +0000 UTC m=+18.124352381 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3988961d-1cd0-4fd2-aa28-80610f3ed94b-original-pull-secret") pod "global-pull-secret-syncer-rbktn" (UID: "3988961d-1cd0-4fd2-aa28-80610f3ed94b") : object "kube-system"/"original-pull-secret" not registered
Jul 15 15:24:39.778781 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:39.778471    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 15:24:39.778781 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:39.778533    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60d786ac-9c8b-48df-8e67-6aa7e976718d-metrics-certs podName:60d786ac-9c8b-48df-8e67-6aa7e976718d nodeName:}" failed. No retries permitted until 2026-07-15 15:24:47.778514724 +0000 UTC m=+18.124417901 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/60d786ac-9c8b-48df-8e67-6aa7e976718d-metrics-certs") pod "network-metrics-daemon-w7zbl" (UID: "60d786ac-9c8b-48df-8e67-6aa7e976718d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 15:24:39.879542 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:39.879503    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czw52\" (UniqueName: \"kubernetes.io/projected/bff44260-d747-4265-af29-596728c30967-kube-api-access-czw52\") pod \"network-check-target-b7s72\" (UID: \"bff44260-d747-4265-af29-596728c30967\") " pod="openshift-network-diagnostics/network-check-target-b7s72"
Jul 15 15:24:39.879717 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:39.879684    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 15:24:39.879717 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:39.879702    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 15:24:39.879717 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:39.879711    2564 projected.go:196] Error preparing data for projected volume kube-api-access-czw52 for pod openshift-network-diagnostics/network-check-target-b7s72: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 15:24:39.879890 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:39.879759    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bff44260-d747-4265-af29-596728c30967-kube-api-access-czw52 podName:bff44260-d747-4265-af29-596728c30967 nodeName:}" failed. No retries permitted until 2026-07-15 15:24:47.879740524 +0000 UTC m=+18.225643711 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-czw52" (UniqueName: "kubernetes.io/projected/bff44260-d747-4265-af29-596728c30967-kube-api-access-czw52") pod "network-check-target-b7s72" (UID: "bff44260-d747-4265-af29-596728c30967") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 15:24:40.224862 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:40.224784    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b7s72"
Jul 15 15:24:40.225046 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:40.224896    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b7s72" podUID="bff44260-d747-4265-af29-596728c30967"
Jul 15 15:24:40.225324 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:40.225304    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w7zbl"
Jul 15 15:24:40.225445 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:40.225420    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w7zbl" podUID="60d786ac-9c8b-48df-8e67-6aa7e976718d"
Jul 15 15:24:41.224491 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:41.223954    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rbktn"
Jul 15 15:24:41.224491 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:41.224119    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rbktn" podUID="3988961d-1cd0-4fd2-aa28-80610f3ed94b"
Jul 15 15:24:42.223862 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:42.223826    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b7s72"
Jul 15 15:24:42.224029 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:42.223873    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w7zbl"
Jul 15 15:24:42.224029 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:42.223953    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b7s72" podUID="bff44260-d747-4265-af29-596728c30967"
Jul 15 15:24:42.224149 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:42.224123    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w7zbl" podUID="60d786ac-9c8b-48df-8e67-6aa7e976718d"
Jul 15 15:24:43.223563 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:43.223533    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rbktn"
Jul 15 15:24:43.224025 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:43.223656    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rbktn" podUID="3988961d-1cd0-4fd2-aa28-80610f3ed94b"
Jul 15 15:24:44.223825 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:44.223790    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b7s72"
Jul 15 15:24:44.224263 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:44.223933    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b7s72" podUID="bff44260-d747-4265-af29-596728c30967"
Jul 15 15:24:44.224263 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:44.223993    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w7zbl"
Jul 15 15:24:44.224263 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:44.224142    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w7zbl" podUID="60d786ac-9c8b-48df-8e67-6aa7e976718d"
Jul 15 15:24:45.224158 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:45.224126    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rbktn"
Jul 15 15:24:45.224561 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:45.224237    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rbktn" podUID="3988961d-1cd0-4fd2-aa28-80610f3ed94b"
Jul 15 15:24:46.223508 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:46.223470    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b7s72"
Jul 15 15:24:46.223667 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:46.223513    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w7zbl"
Jul 15 15:24:46.223667 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:46.223603    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b7s72" podUID="bff44260-d747-4265-af29-596728c30967"
Jul 15 15:24:46.223751 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:46.223679    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w7zbl" podUID="60d786ac-9c8b-48df-8e67-6aa7e976718d"
Jul 15 15:24:47.223210 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:47.223178    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rbktn"
Jul 15 15:24:47.223604 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:47.223287    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rbktn" podUID="3988961d-1cd0-4fd2-aa28-80610f3ed94b"
Jul 15 15:24:47.838712 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:47.838683    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60d786ac-9c8b-48df-8e67-6aa7e976718d-metrics-certs\") pod \"network-metrics-daemon-w7zbl\" (UID: \"60d786ac-9c8b-48df-8e67-6aa7e976718d\") " pod="openshift-multus/network-metrics-daemon-w7zbl"
Jul 15 15:24:47.838712 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:47.838719    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3988961d-1cd0-4fd2-aa28-80610f3ed94b-original-pull-secret\") pod \"global-pull-secret-syncer-rbktn\" (UID: \"3988961d-1cd0-4fd2-aa28-80610f3ed94b\") " pod="kube-system/global-pull-secret-syncer-rbktn"
Jul 15 15:24:47.838940 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:47.838834    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 15:24:47.838940 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:47.838855    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 15:24:47.838940 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:47.838897    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3988961d-1cd0-4fd2-aa28-80610f3ed94b-original-pull-secret podName:3988961d-1cd0-4fd2-aa28-80610f3ed94b nodeName:}" failed. No retries permitted until 2026-07-15 15:25:03.838882666 +0000 UTC m=+34.184785837 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3988961d-1cd0-4fd2-aa28-80610f3ed94b-original-pull-secret") pod "global-pull-secret-syncer-rbktn" (UID: "3988961d-1cd0-4fd2-aa28-80610f3ed94b") : object "kube-system"/"original-pull-secret" not registered
Jul 15 15:24:47.838940 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:47.838909    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60d786ac-9c8b-48df-8e67-6aa7e976718d-metrics-certs podName:60d786ac-9c8b-48df-8e67-6aa7e976718d nodeName:}" failed. No retries permitted until 2026-07-15 15:25:03.838903016 +0000 UTC m=+34.184806187 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/60d786ac-9c8b-48df-8e67-6aa7e976718d-metrics-certs") pod "network-metrics-daemon-w7zbl" (UID: "60d786ac-9c8b-48df-8e67-6aa7e976718d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 15:24:47.939047 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:47.939018    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czw52\" (UniqueName: \"kubernetes.io/projected/bff44260-d747-4265-af29-596728c30967-kube-api-access-czw52\") pod \"network-check-target-b7s72\" (UID: \"bff44260-d747-4265-af29-596728c30967\") " pod="openshift-network-diagnostics/network-check-target-b7s72"
Jul 15 15:24:47.939170 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:47.939148    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 15:24:47.939220 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:47.939175    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 15:24:47.939220 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:47.939186    2564 projected.go:196] Error preparing data for projected volume kube-api-access-czw52 for pod openshift-network-diagnostics/network-check-target-b7s72: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 15:24:47.939298 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:47.939245    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bff44260-d747-4265-af29-596728c30967-kube-api-access-czw52 podName:bff44260-d747-4265-af29-596728c30967 nodeName:}" failed. No retries permitted until 2026-07-15 15:25:03.939230317 +0000 UTC m=+34.285133511 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-czw52" (UniqueName: "kubernetes.io/projected/bff44260-d747-4265-af29-596728c30967-kube-api-access-czw52") pod "network-check-target-b7s72" (UID: "bff44260-d747-4265-af29-596728c30967") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 15:24:48.224271 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:48.224190    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b7s72"
Jul 15 15:24:48.224704 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:48.224203    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w7zbl"
Jul 15 15:24:48.224704 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:48.224328    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b7s72" podUID="bff44260-d747-4265-af29-596728c30967"
Jul 15 15:24:48.224704 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:48.224407    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w7zbl" podUID="60d786ac-9c8b-48df-8e67-6aa7e976718d"
Jul 15 15:24:49.224236 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:49.224203    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rbktn"
Jul 15 15:24:49.224415 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:49.224313    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rbktn" podUID="3988961d-1cd0-4fd2-aa28-80610f3ed94b"
Jul 15 15:24:50.224962 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:50.224927    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w7zbl"
Jul 15 15:24:50.225422 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:50.224940    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b7s72"
Jul 15 15:24:50.225422 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:50.225082    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w7zbl" podUID="60d786ac-9c8b-48df-8e67-6aa7e976718d"
Jul 15 15:24:50.225422 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:50.225164    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b7s72" podUID="bff44260-d747-4265-af29-596728c30967"
Jul 15 15:24:51.223211 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:51.223177    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rbktn"
Jul 15 15:24:51.223374 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:51.223301    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rbktn" podUID="3988961d-1cd0-4fd2-aa28-80610f3ed94b"
Jul 15 15:24:52.223972 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:52.223941    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w7zbl"
Jul 15 15:24:52.224314 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:52.224063    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w7zbl" podUID="60d786ac-9c8b-48df-8e67-6aa7e976718d"
Jul 15 15:24:52.224314 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:52.224104    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b7s72"
Jul 15 15:24:52.224314 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:52.224149    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b7s72" podUID="bff44260-d747-4265-af29-596728c30967"
Jul 15 15:24:53.223837 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:53.223694    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rbktn"
Jul 15 15:24:53.223969 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:53.223915    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rbktn" podUID="3988961d-1cd0-4fd2-aa28-80610f3ed94b"
Jul 15 15:24:53.356414 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:53.356389    2564 generic.go:356] "Generic (PLEG): container finished" podID="b19951ca4f9c82c97fd02d9646bbed61" containerID="5b0447a3ef7f9a2ebcd446dccd91f386c8c7c71bb41835932fc064e676972e59" exitCode=0
Jul 15 15:24:53.357287 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:53.356462    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-107.ec2.internal" event={"ID":"b19951ca4f9c82c97fd02d9646bbed61","Type":"ContainerDied","Data":"5b0447a3ef7f9a2ebcd446dccd91f386c8c7c71bb41835932fc064e676972e59"}
Jul 15 15:24:53.357908 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:53.357885    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-107.ec2.internal" event={"ID":"ab8a58b7f0cfe687e1e923428993b5f1","Type":"ContainerStarted","Data":"2e79c3d1832961af6927eac68f633295488940ae8902efb5fba44766c9d4fb6c"}
Jul 15 15:24:53.359467 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:53.359449    2564 generic.go:356] "Generic (PLEG): container finished" podID="83ea2fad-6953-4605-bd20-4ca74169f20d" containerID="2a912cd7b84a5e163c2b953d04d5b0788d096598a9e5015f5d63580976b2a1da" exitCode=0
Jul 15 15:24:53.359564 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:53.359519    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2s2fn" event={"ID":"83ea2fad-6953-4605-bd20-4ca74169f20d","Type":"ContainerDied","Data":"2a912cd7b84a5e163c2b953d04d5b0788d096598a9e5015f5d63580976b2a1da"}
Jul 15 15:24:53.360923 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:53.360841    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bz8r7" event={"ID":"aa03530f-36a5-49a7-b513-1add7f6af1ce","Type":"ContainerStarted","Data":"a619f3c31f0ddc4b18269fa04ed61e52b62a6b3ef8afd26c8c05a6811e21fc82"}
Jul 15 15:24:53.362416 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:53.362367    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4bhw5" event={"ID":"52587e3b-cd74-43d1-86aa-29a127627f90","Type":"ContainerStarted","Data":"8ed1a30646e2cd08d2ea39abdde023efc16bec63d0d0029e5389111370f90a2b"}
Jul 15 15:24:53.365097 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:53.365081    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfw7r_55d0e798-7e5a-4f3e-afc2-67dfb308d934/ovn-acl-logging/0.log"
Jul 15 15:24:53.365434 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:53.365410    2564 generic.go:356] "Generic (PLEG): container finished" podID="55d0e798-7e5a-4f3e-afc2-67dfb308d934" containerID="b5303f02b374974006a75360b574bc2e23b34316ef955a7d193bdaea6682f2f7" exitCode=1
Jul 15 15:24:53.365536 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:53.365434    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bfw7r" event={"ID":"55d0e798-7e5a-4f3e-afc2-67dfb308d934","Type":"ContainerStarted","Data":"a449a496bb157a29901290895163da75f0fb3e44de046fa9cc6bae47c60b0324"}
Jul 15 15:24:53.365536 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:53.365488    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bfw7r" event={"ID":"55d0e798-7e5a-4f3e-afc2-67dfb308d934","Type":"ContainerStarted","Data":"5c1c2c6e2dea8a311c3214f28551cba3ab576437e1d933ef62c6627c1f1735f1"}
Jul 15 15:24:53.365536 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:53.365529    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bfw7r" event={"ID":"55d0e798-7e5a-4f3e-afc2-67dfb308d934","Type":"ContainerStarted","Data":"0be86bc83641ddae29a979608965129a1e8e941aa3b00f618f5744aa58056188"}
Jul 15 15:24:53.365660 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:53.365569    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bfw7r" event={"ID":"55d0e798-7e5a-4f3e-afc2-67dfb308d934","Type":"ContainerStarted","Data":"0fcc98e46e9a47914e9673eaee6d861986d2def5b220e2ddcc12a718775f0464"}
Jul 15 15:24:53.365660 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:53.365613    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bfw7r" event={"ID":"55d0e798-7e5a-4f3e-afc2-67dfb308d934","Type":"ContainerDied","Data":"b5303f02b374974006a75360b574bc2e23b34316ef955a7d193bdaea6682f2f7"}
Jul 15 15:24:53.365660 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:53.365647    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bfw7r" event={"ID":"55d0e798-7e5a-4f3e-afc2-67dfb308d934","Type":"ContainerStarted","Data":"bb3d4b285359b4788791403eba1dbb2de5fbd2907fc193ff0bae79598dc5744c"}
Jul 15 15:24:53.366752 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:53.366729    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2l7hr" event={"ID":"6749dd0d-651a-432e-b79a-b580fb6a9200","Type":"ContainerStarted","Data":"1d1b88fed55d0b50c068e56c38aa77647612c4724b8562fe7ea985f64c947ca9"}
Jul 15 15:24:53.368087 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:53.368069    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5hf8" event={"ID":"4f72bead-ee18-4b6c-b262-7248e623c104","Type":"ContainerStarted","Data":"f8db1f479f3d19ac1953dc11b36f16fd2bf46565d71f35aa39b90c6621ec2a8f"}
Jul 15 15:24:53.369349 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:53.369329    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dq4f9" event={"ID":"bd4f0795-8b44-4ea5-9a78-6c790d60ab3d","Type":"ContainerStarted","Data":"83dbff89636197e062842648f017de271a6664ca346f995db2f6f4f5c4042b52"}
Jul 15 15:24:53.370568 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:53.370551    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-djdlq" event={"ID":"15e11302-d7ea-4408-b48b-01b0aad5a6dd","Type":"ContainerStarted","Data":"77f5449ca45cd6bddcf7e54d67830282f48408fbb4dc8447adf7135705e96d97"}
Jul 15 15:24:53.372375 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:53.372342    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-107.ec2.internal" podStartSLOduration=22.372330985 podStartE2EDuration="22.372330985s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 15:24:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:24:53.371801148 +0000 UTC m=+23.717704342" watchObservedRunningTime="2026-07-15 15:24:53.372330985 +0000 UTC m=+23.718234177"
Jul 15 15:24:53.387783 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:53.387747    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-2l7hr" podStartSLOduration=3.35427126 podStartE2EDuration="23.387735612s" totalImagesPullingTime="20.033464352s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 15:24:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:24:53.387500214 +0000 UTC m=+23.733403441" watchObservedRunningTime="2026-07-15 15:24:53.387735612 +0000 UTC m=+23.733638805"
Jul 15 15:24:53.403684 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:53.403647    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-djdlq" podStartSLOduration=2.956619314 podStartE2EDuration="23.403636706s" totalImagesPullingTime="20.447017392s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 15:24:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:24:53.403474652 +0000 UTC m=+23.749377845" watchObservedRunningTime="2026-07-15 15:24:53.403636706 +0000 UTC m=+23.749539881"
Jul 15 15:24:53.438351 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:53.438311    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-bz8r7" podStartSLOduration=3.345366308 podStartE2EDuration="23.438300477s" totalImagesPullingTime="20.092934169s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:24:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:24:53.417750106 +0000 UTC m=+23.763653298" watchObservedRunningTime="2026-07-15 15:24:53.438300477 +0000 UTC m=+23.784203669"
Jul 15 15:24:53.469725 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:53.469688    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-4bhw5" podStartSLOduration=3.378214434 podStartE2EDuration="23.469677876s" totalImagesPullingTime="20.091463442s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 15:24:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:24:53.453499043 +0000 UTC m=+23.799402237" watchObservedRunningTime="2026-07-15 15:24:53.469677876 +0000 UTC m=+23.815581068"
Jul 15 15:24:53.469802 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:53.469746    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-dq4f9" podStartSLOduration=3.320010718 podStartE2EDuration="23.469742437s" totalImagesPullingTime="20.149731719s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 15:24:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:24:53.469469401 +0000 UTC m=+23.815372596" watchObservedRunningTime="2026-07-15 15:24:53.469742437 +0000 UTC m=+23.815645630"
Jul 15 15:24:53.526635 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:53.526611    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:24:53.602624 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:53.602573    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:24:54.223661 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:54.223436    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b7s72"
Jul 15 15:24:54.223831 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:54.223440    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w7zbl"
Jul 15 15:24:54.223831 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:54.223693    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b7s72" podUID="bff44260-d747-4265-af29-596728c30967"
Jul 15 15:24:54.223831 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:54.223802    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w7zbl" podUID="60d786ac-9c8b-48df-8e67-6aa7e976718d"
Jul 15 15:24:54.374449 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:54.374418    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lrbjr" event={"ID":"41596280-81e4-4be2-808b-8b53102dbe5a","Type":"ContainerStarted","Data":"09a9cd74dec8f177d39c670a5331092e03fca020f95c990d3101a9a6f8043cd7"}
Jul 15 15:24:54.405239 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:54.405184    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-lrbjr" podStartSLOduration=4.257874888 podStartE2EDuration="24.40516446s" totalImagesPullingTime="20.147289572s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 15:24:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:24:54.404460697 +0000 UTC m=+24.750363888" watchObservedRunningTime="2026-07-15 15:24:54.40516446 +0000 UTC m=+24.751067653"
Jul 15 15:24:54.516431 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:54.516402    2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 15 15:24:54.524894 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:54.524866    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:24:54.625953 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:54.625926    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:24:55.094411 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:55.094303    2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-15T15:24:54.516420862Z","UUID":"34487c2b-8702-4652-b410-2c9affd80c81","Handler":null,"Name":"","Endpoint":""}
Jul 15 15:24:55.096046 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:55.096004    2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 15 15:24:55.096163 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:55.096071    2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 15 15:24:55.224372 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:55.224260    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rbktn"
Jul 15 15:24:55.224561 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:55.224385    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rbktn" podUID="3988961d-1cd0-4fd2-aa28-80610f3ed94b"
Jul 15 15:24:55.378697 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:55.378664    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5hf8" event={"ID":"4f72bead-ee18-4b6c-b262-7248e623c104","Type":"ContainerStarted","Data":"951cfa0a97d699188cb036168d7ffcfd4c1b946d7648dab026c4f23139e0c71c"}
Jul 15 15:24:55.380781 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:55.380749    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-107.ec2.internal" event={"ID":"b19951ca4f9c82c97fd02d9646bbed61","Type":"ContainerStarted","Data":"a8679b8522c0b4f6b0c8f4f81ce893f93b41f1db0cd47c24f49a882db988dad9"}
Jul 15 15:24:55.395943 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:55.395900    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-107.ec2.internal" podStartSLOduration=24.395880853 podStartE2EDuration="24.395880853s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 15:24:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:24:55.395716635 +0000 UTC m=+25.741619830" watchObservedRunningTime="2026-07-15 15:24:55.395880853 +0000 UTC m=+25.741784049"
Jul 15 15:24:56.223567 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:56.223537    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b7s72"
Jul 15 15:24:56.223742 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:56.223584    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w7zbl"
Jul 15 15:24:56.223742 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:56.223665    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b7s72" podUID="bff44260-d747-4265-af29-596728c30967"
Jul 15 15:24:56.223862 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:56.223801    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w7zbl" podUID="60d786ac-9c8b-48df-8e67-6aa7e976718d"
Jul 15 15:24:56.385052 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:56.384998    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5hf8" event={"ID":"4f72bead-ee18-4b6c-b262-7248e623c104","Type":"ContainerStarted","Data":"584315dae05b4855d99f61541f74c5d965142eba62c90e7fa75e4693721af1d1"}
Jul 15 15:24:56.388289 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:56.388266    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfw7r_55d0e798-7e5a-4f3e-afc2-67dfb308d934/ovn-acl-logging/0.log"
Jul 15 15:24:56.388690 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:56.388663    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bfw7r" event={"ID":"55d0e798-7e5a-4f3e-afc2-67dfb308d934","Type":"ContainerStarted","Data":"bbd6a8ae2bcf0d7c1e8fa122283f36b7239dd63011fed0b215aee992042def23"}
Jul 15 15:24:56.402544 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:56.402501    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5hf8" podStartSLOduration=3.955798667 podStartE2EDuration="26.402485906s" totalImagesPullingTime="22.446687239s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 15:24:30 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:24:56.40214122 +0000 UTC m=+26.748044423" watchObservedRunningTime="2026-07-15 15:24:56.402485906 +0000 UTC m=+26.748389100"
Jul 15 15:24:57.224195 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:57.224161    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rbktn"
Jul 15 15:24:57.224355 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:57.224265    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rbktn" podUID="3988961d-1cd0-4fd2-aa28-80610f3ed94b"
Jul 15 15:24:58.025401 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:58.025188    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:24:58.132716 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:58.132692    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:24:58.161857 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:58.161832    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-bz8r7"
Jul 15 15:24:58.162345 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:58.162331    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-bz8r7"
Jul 15 15:24:58.223724 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:58.223702    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w7zbl"
Jul 15 15:24:58.223806 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:58.223723    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b7s72"
Jul 15 15:24:58.223844 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:58.223799    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w7zbl" podUID="60d786ac-9c8b-48df-8e67-6aa7e976718d"
Jul 15 15:24:58.223952 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:58.223931    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b7s72" podUID="bff44260-d747-4265-af29-596728c30967"
Jul 15 15:24:58.393919 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:58.393863    2564 generic.go:356] "Generic (PLEG): container finished" podID="83ea2fad-6953-4605-bd20-4ca74169f20d" containerID="1fe64243243c4cd0e001e1fef99710c9460d5e71eef52bb13e2cd93461584d47" exitCode=0
Jul 15 15:24:58.394038 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:58.393919    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2s2fn" event={"ID":"83ea2fad-6953-4605-bd20-4ca74169f20d","Type":"ContainerDied","Data":"1fe64243243c4cd0e001e1fef99710c9460d5e71eef52bb13e2cd93461584d47"}
Jul 15 15:24:58.397506 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:58.397491    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfw7r_55d0e798-7e5a-4f3e-afc2-67dfb308d934/ovn-acl-logging/0.log"
Jul 15 15:24:58.397896 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:58.397876    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bfw7r" event={"ID":"55d0e798-7e5a-4f3e-afc2-67dfb308d934","Type":"ContainerStarted","Data":"8d7d08b0afebbb0a5602520e50df78930f46df9ae77c5dc5f7791afa9d1a4b81"}
Jul 15 15:24:58.397968 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:58.397956    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-bz8r7"
Jul 15 15:24:58.398315 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:58.398302    2564 scope.go:117] "RemoveContainer" containerID="b5303f02b374974006a75360b574bc2e23b34316ef955a7d193bdaea6682f2f7"
Jul 15 15:24:58.398510 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:58.398493    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-bz8r7"
Jul 15 15:24:58.514520 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:58.514489    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:24:59.181994 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:59.181934    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:24:59.223450 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:59.223425    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rbktn"
Jul 15 15:24:59.223627 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:24:59.223533    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rbktn" podUID="3988961d-1cd0-4fd2-aa28-80610f3ed94b"
Jul 15 15:24:59.281732 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:59.281696    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:24:59.382311 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:59.382284    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:24:59.403169 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:59.403147    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfw7r_55d0e798-7e5a-4f3e-afc2-67dfb308d934/ovn-acl-logging/0.log"
Jul 15 15:24:59.403492 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:59.403473    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bfw7r" event={"ID":"55d0e798-7e5a-4f3e-afc2-67dfb308d934","Type":"ContainerStarted","Data":"f947ed5b3f1a25c62c57097f6d501eedd76fc9ca22fe4a58eea78cca911572b3"}
Jul 15 15:24:59.403632 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:59.403616    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bfw7r"
Jul 15 15:24:59.403907 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:59.403887    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bfw7r"
Jul 15 15:24:59.404039 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:59.403957    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bfw7r"
Jul 15 15:24:59.420486 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:59.420467    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bfw7r"
Jul 15 15:24:59.420601 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:59.420559    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bfw7r"
Jul 15 15:24:59.437872 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:24:59.437798    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-bfw7r" podStartSLOduration=9.235470482 podStartE2EDuration="29.437784386s" totalImagesPullingTime="20.202313904s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 15:24:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:24:59.4371368 +0000 UTC m=+29.783039992" watchObservedRunningTime="2026-07-15 15:24:59.437784386 +0000 UTC m=+29.783687594"
Jul 15 15:25:00.040630 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:00.040484    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:00.132743 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:00.132717    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-b7s72"]
Jul 15 15:25:00.132918 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:00.132808    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b7s72"
Jul 15 15:25:00.132979 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:25:00.132914    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b7s72" podUID="bff44260-d747-4265-af29-596728c30967"
Jul 15 15:25:00.134905 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:00.134883    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-w7zbl"]
Jul 15 15:25:00.134988 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:00.134972    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w7zbl"
Jul 15 15:25:00.135081 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:25:00.135066    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w7zbl" podUID="60d786ac-9c8b-48df-8e67-6aa7e976718d"
Jul 15 15:25:00.146665 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:00.146640    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rbktn"]
Jul 15 15:25:00.146762 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:00.146721    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rbktn"
Jul 15 15:25:00.146834 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:25:00.146816    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rbktn" podUID="3988961d-1cd0-4fd2-aa28-80610f3ed94b"
Jul 15 15:25:00.371728 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:00.371661    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:00.406927 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:00.406895    2564 generic.go:356] "Generic (PLEG): container finished" podID="83ea2fad-6953-4605-bd20-4ca74169f20d" containerID="f63b71ebe27c1a2dc376d628fd14fa48305b6f2f81396034a4fd064ef7e14e4e" exitCode=0
Jul 15 15:25:00.407072 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:00.406932    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2s2fn" event={"ID":"83ea2fad-6953-4605-bd20-4ca74169f20d","Type":"ContainerDied","Data":"f63b71ebe27c1a2dc376d628fd14fa48305b6f2f81396034a4fd064ef7e14e4e"}
Jul 15 15:25:00.436849 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:00.436830    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:01.998299 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:01.998230    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:02.154918 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:02.154888    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:02.223626 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:02.223597    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b7s72"
Jul 15 15:25:02.223626 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:02.223608    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w7zbl"
Jul 15 15:25:02.223815 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:25:02.223721    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b7s72" podUID="bff44260-d747-4265-af29-596728c30967"
Jul 15 15:25:02.223815 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:25:02.223768    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w7zbl" podUID="60d786ac-9c8b-48df-8e67-6aa7e976718d"
Jul 15 15:25:02.223815 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:02.223798    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rbktn"
Jul 15 15:25:02.223956 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:25:02.223887    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rbktn" podUID="3988961d-1cd0-4fd2-aa28-80610f3ed94b"
Jul 15 15:25:02.252403 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:02.252322    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:02.413315 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:02.413283    2564 generic.go:356] "Generic (PLEG): container finished" podID="83ea2fad-6953-4605-bd20-4ca74169f20d" containerID="c344407aafe23008e8d984a1cc524042eeec4c543ffd2d37d6f8f5ddac8781a7" exitCode=0
Jul 15 15:25:02.413474 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:02.413340    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2s2fn" event={"ID":"83ea2fad-6953-4605-bd20-4ca74169f20d","Type":"ContainerDied","Data":"c344407aafe23008e8d984a1cc524042eeec4c543ffd2d37d6f8f5ddac8781a7"}
Jul 15 15:25:03.869995 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:03.869960    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60d786ac-9c8b-48df-8e67-6aa7e976718d-metrics-certs\") pod \"network-metrics-daemon-w7zbl\" (UID: \"60d786ac-9c8b-48df-8e67-6aa7e976718d\") " pod="openshift-multus/network-metrics-daemon-w7zbl"
Jul 15 15:25:03.870403 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:03.870025    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3988961d-1cd0-4fd2-aa28-80610f3ed94b-original-pull-secret\") pod \"global-pull-secret-syncer-rbktn\" (UID: \"3988961d-1cd0-4fd2-aa28-80610f3ed94b\") " pod="kube-system/global-pull-secret-syncer-rbktn"
Jul 15 15:25:03.870403 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:25:03.870128    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 15:25:03.870403 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:25:03.870164    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 15:25:03.870403 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:25:03.870212    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60d786ac-9c8b-48df-8e67-6aa7e976718d-metrics-certs podName:60d786ac-9c8b-48df-8e67-6aa7e976718d nodeName:}" failed. No retries permitted until 2026-07-15 15:25:35.870191537 +0000 UTC m=+66.216094728 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/60d786ac-9c8b-48df-8e67-6aa7e976718d-metrics-certs") pod "network-metrics-daemon-w7zbl" (UID: "60d786ac-9c8b-48df-8e67-6aa7e976718d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 15:25:03.870403 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:25:03.870228    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3988961d-1cd0-4fd2-aa28-80610f3ed94b-original-pull-secret podName:3988961d-1cd0-4fd2-aa28-80610f3ed94b nodeName:}" failed. No retries permitted until 2026-07-15 15:25:35.870222252 +0000 UTC m=+66.216125423 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3988961d-1cd0-4fd2-aa28-80610f3ed94b-original-pull-secret") pod "global-pull-secret-syncer-rbktn" (UID: "3988961d-1cd0-4fd2-aa28-80610f3ed94b") : object "kube-system"/"original-pull-secret" not registered
Jul 15 15:25:03.970871 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:03.970834    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czw52\" (UniqueName: \"kubernetes.io/projected/bff44260-d747-4265-af29-596728c30967-kube-api-access-czw52\") pod \"network-check-target-b7s72\" (UID: \"bff44260-d747-4265-af29-596728c30967\") " pod="openshift-network-diagnostics/network-check-target-b7s72"
Jul 15 15:25:03.971040 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:25:03.970990    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 15:25:03.971040 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:25:03.971023    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 15:25:03.971040 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:25:03.971036    2564 projected.go:196] Error preparing data for projected volume kube-api-access-czw52 for pod openshift-network-diagnostics/network-check-target-b7s72: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 15:25:03.971190 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:25:03.971089    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bff44260-d747-4265-af29-596728c30967-kube-api-access-czw52 podName:bff44260-d747-4265-af29-596728c30967 nodeName:}" failed. No retries permitted until 2026-07-15 15:25:35.971074512 +0000 UTC m=+66.316977699 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-czw52" (UniqueName: "kubernetes.io/projected/bff44260-d747-4265-af29-596728c30967-kube-api-access-czw52") pod "network-check-target-b7s72" (UID: "bff44260-d747-4265-af29-596728c30967") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 15:25:04.223580 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:04.223508    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w7zbl"
Jul 15 15:25:04.223735 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:04.223508    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rbktn"
Jul 15 15:25:04.223735 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:04.223621    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b7s72"
Jul 15 15:25:04.223735 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:25:04.223659    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w7zbl" podUID="60d786ac-9c8b-48df-8e67-6aa7e976718d"
Jul 15 15:25:04.223735 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:25:04.223721    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b7s72" podUID="bff44260-d747-4265-af29-596728c30967"
Jul 15 15:25:04.223936 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:25:04.223840    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rbktn" podUID="3988961d-1cd0-4fd2-aa28-80610f3ed94b"
Jul 15 15:25:05.500831 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:05.500762    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-107.ec2.internal" event="NodeReady"
Jul 15 15:25:05.501189 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:05.500868    2564 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 15 15:25:05.546503 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:05.546476    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-66bf4fd47d-gkcb2"]
Jul 15 15:25:05.548471 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:05.548452    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66bf4fd47d-gkcb2"
Jul 15 15:25:05.551162 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:05.551144    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 15 15:25:05.551256 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:05.551150    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 15 15:25:05.551306 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:05.551268    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 15 15:25:05.551669 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:05.551653    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xdzpm\""
Jul 15 15:25:05.556393 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:05.556376    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 15 15:25:05.564750 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:05.564722    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-7np6g"]
Jul 15 15:25:05.566523 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:05.566506    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-66bf4fd47d-gkcb2"]
Jul 15 15:25:05.566649 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:05.566585    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7np6g"
Jul 15 15:25:05.568963 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:05.568945    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 15 15:25:05.569079 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:05.568949    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 15 15:25:05.569419 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:05.569402    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-scxjf\""
Jul 15 15:25:05.569584 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:05.569564    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 15 15:25:05.573917 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:05.573895    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-4dk4d"]
Jul 15 15:25:05.576819 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:05.576796    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4dk4d"
Jul 15 15:25:05.577489 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:05.577471    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7np6g"]
Jul 15 15:25:05.579362 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:05.579335    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 15 15:25:05.579988 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:05.579966    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-fj5z9\""
Jul 15 15:25:05.580541 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:05.580525    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 15 15:25:05.587287 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:05.587262    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4dk4d"]
Jul 15 15:25:05.682624 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:05.682597    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7rcm\" (UniqueName: \"kubernetes.io/projected/2c70271a-74b9-4303-8257-f7cd4ef76758-kube-api-access-n7rcm\") pod \"image-registry-66bf4fd47d-gkcb2\" (UID: \"2c70271a-74b9-4303-8257-f7cd4ef76758\") " pod="openshift-image-registry/image-registry-66bf4fd47d-gkcb2"
Jul 15 15:25:05.682763 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:05.682658    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2c70271a-74b9-4303-8257-f7cd4ef76758-ca-trust-extracted\") pod \"image-registry-66bf4fd47d-gkcb2\" (UID: \"2c70271a-74b9-4303-8257-f7cd4ef76758\") " pod="openshift-image-registry/image-registry-66bf4fd47d-gkcb2"
Jul 15 15:25:05.682763 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:05.682701    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f6fd386-c683-4903-8dcb-1a2d19d4697e-cert\") pod \"ingress-canary-7np6g\" (UID: \"0f6fd386-c683-4903-8dcb-1a2d19d4697e\") " pod="openshift-ingress-canary/ingress-canary-7np6g"
Jul 15 15:25:05.682763 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:05.682718    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2c70271a-74b9-4303-8257-f7cd4ef76758-trusted-ca\") pod \"image-registry-66bf4fd47d-gkcb2\" (UID: \"2c70271a-74b9-4303-8257-f7cd4ef76758\") " pod="openshift-image-registry/image-registry-66bf4fd47d-gkcb2"
Jul 15 15:25:05.682763 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:05.682738    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2c70271a-74b9-4303-8257-f7cd4ef76758-bound-sa-token\") pod \"image-registry-66bf4fd47d-gkcb2\" (UID: \"2c70271a-74b9-4303-8257-f7cd4ef76758\") " pod="openshift-image-registry/image-registry-66bf4fd47d-gkcb2"
Jul 15 15:25:05.682973 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:05.682773    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmkmx\" (UniqueName: \"kubernetes.io/projected/0f6fd386-c683-4903-8dcb-1a2d19d4697e-kube-api-access-nmkmx\") pod \"ingress-canary-7np6g\" (UID: \"0f6fd386-c683-4903-8dcb-1a2d19d4697e\") " pod="openshift-ingress-canary/ingress-canary-7np6g"
Jul 15 15:25:05.682973 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:05.682801    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d0a4fbae-6823-41cb-9e55-76a71200d50e-metrics-tls\") pod \"dns-default-4dk4d\" (UID: \"d0a4fbae-6823-41cb-9e55-76a71200d50e\") " pod="openshift-dns/dns-default-4dk4d"
Jul 15 15:25:05.682973 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:05.682821    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0a4fbae-6823-41cb-9e55-76a71200d50e-tmp-dir\") pod \"dns-default-4dk4d\" (UID: \"d0a4fbae-6823-41cb-9e55-76a71200d50e\") " pod="openshift-dns/dns-default-4dk4d"
Jul 15 15:25:05.682973 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:05.682859    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2c70271a-74b9-4303-8257-f7cd4ef76758-image-registry-private-configuration\") pod \"image-registry-66bf4fd47d-gkcb2\" (UID: \"2c70271a-74b9-4303-8257-f7cd4ef76758\") " pod="openshift-image-registry/image-registry-66bf4fd47d-gkcb2"
Jul 15 15:25:05.682973 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:05.682876    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2c70271a-74b9-4303-8257-f7cd4ef76758-registry-certificates\") pod \"image-registry-66bf4fd47d-gkcb2\" (UID: \"2c70271a-74b9-4303-8257-f7cd4ef76758\") " pod="openshift-image-registry/image-registry-66bf4fd47d-gkcb2"
Jul 15 15:25:05.682973 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:05.682897    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2c70271a-74b9-4303-8257-f7cd4ef76758-installation-pull-secrets\") pod \"image-registry-66bf4fd47d-gkcb2\" (UID: \"2c70271a-74b9-4303-8257-f7cd4ef76758\") " pod="openshift-image-registry/image-registry-66bf4fd47d-gkcb2"
Jul 15 15:25:05.682973 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:05.682953    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d0a4fbae-6823-41cb-9e55-76a71200d50e-config-volume\") pod \"dns-default-4dk4d\" (UID: \"d0a4fbae-6823-41cb-9e55-76a71200d50e\") " pod="openshift-dns/dns-default-4dk4d"
Jul 15 15:25:05.683373 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:05.682979    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsdh6\" (UniqueName: \"kubernetes.io/projected/d0a4fbae-6823-41cb-9e55-76a71200d50e-kube-api-access-hsdh6\") pod \"dns-default-4dk4d\" (UID: \"d0a4fbae-6823-41cb-9e55-76a71200d50e\") " pod="openshift-dns/dns-default-4dk4d"
Jul 15 15:25:05.683373 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:05.682998    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c70271a-74b9-4303-8257-f7cd4ef76758-registry-tls\") pod \"image-registry-66bf4fd47d-gkcb2\" (UID: \"2c70271a-74b9-4303-8257-f7cd4ef76758\") " pod="openshift-image-registry/image-registry-66bf4fd47d-gkcb2"
Jul 15 15:25:05.783483 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:05.783394    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2c70271a-74b9-4303-8257-f7cd4ef76758-ca-trust-extracted\") pod \"image-registry-66bf4fd47d-gkcb2\" (UID: \"2c70271a-74b9-4303-8257-f7cd4ef76758\") " pod="openshift-image-registry/image-registry-66bf4fd47d-gkcb2"
Jul 15 15:25:05.783483 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:05.783444    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f6fd386-c683-4903-8dcb-1a2d19d4697e-cert\") pod \"ingress-canary-7np6g\" (UID: \"0f6fd386-c683-4903-8dcb-1a2d19d4697e\") " pod="openshift-ingress-canary/ingress-canary-7np6g"
Jul 15 15:25:05.783693 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:05.783509    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2c70271a-74b9-4303-8257-f7cd4ef76758-trusted-ca\") pod \"image-registry-66bf4fd47d-gkcb2\" (UID: \"2c70271a-74b9-4303-8257-f7cd4ef76758\") " pod="openshift-image-registry/image-registry-66bf4fd47d-gkcb2"
Jul 15 15:25:05.783693 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:05.783556    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2c70271a-74b9-4303-8257-f7cd4ef76758-bound-sa-token\") pod \"image-registry-66bf4fd47d-gkcb2\" (UID: \"2c70271a-74b9-4303-8257-f7cd4ef76758\") " pod="openshift-image-registry/image-registry-66bf4fd47d-gkcb2"
Jul 15 15:25:05.783693 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:05.783586    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmkmx\" (UniqueName: \"kubernetes.io/projected/0f6fd386-c683-4903-8dcb-1a2d19d4697e-kube-api-access-nmkmx\") pod \"ingress-canary-7np6g\" (UID: \"0f6fd386-c683-4903-8dcb-1a2d19d4697e\") " pod="openshift-ingress-canary/ingress-canary-7np6g"
Jul 15 15:25:05.783693 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:05.783612    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d0a4fbae-6823-41cb-9e55-76a71200d50e-metrics-tls\") pod \"dns-default-4dk4d\" (UID: \"d0a4fbae-6823-41cb-9e55-76a71200d50e\") " pod="openshift-dns/dns-default-4dk4d"
Jul 15 15:25:05.783693 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:05.783635    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0a4fbae-6823-41cb-9e55-76a71200d50e-tmp-dir\") pod \"dns-default-4dk4d\" (UID: \"d0a4fbae-6823-41cb-9e55-76a71200d50e\") " pod="openshift-dns/dns-default-4dk4d"
Jul 15 15:25:05.783693 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:05.783686    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2c70271a-74b9-4303-8257-f7cd4ef76758-image-registry-private-configuration\") pod \"image-registry-66bf4fd47d-gkcb2\" (UID: \"2c70271a-74b9-4303-8257-f7cd4ef76758\") " pod="openshift-image-registry/image-registry-66bf4fd47d-gkcb2"
Jul 15 15:25:05.783956 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:05.783712    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2c70271a-74b9-4303-8257-f7cd4ef76758-registry-certificates\") pod \"image-registry-66bf4fd47d-gkcb2\" (UID: \"2c70271a-74b9-4303-8257-f7cd4ef76758\") " pod="openshift-image-registry/image-registry-66bf4fd47d-gkcb2"
Jul 15 15:25:05.783956 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:05.783740    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2c70271a-74b9-4303-8257-f7cd4ef76758-installation-pull-secrets\") pod \"image-registry-66bf4fd47d-gkcb2\" (UID: \"2c70271a-74b9-4303-8257-f7cd4ef76758\") " pod="openshift-image-registry/image-registry-66bf4fd47d-gkcb2"
Jul 15 15:25:05.783956 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:05.783785    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d0a4fbae-6823-41cb-9e55-76a71200d50e-config-volume\") pod \"dns-default-4dk4d\" (UID: \"d0a4fbae-6823-41cb-9e55-76a71200d50e\") " pod="openshift-dns/dns-default-4dk4d"
Jul 15 15:25:05.783956 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:05.783811    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsdh6\" (UniqueName: \"kubernetes.io/projected/d0a4fbae-6823-41cb-9e55-76a71200d50e-kube-api-access-hsdh6\") pod \"dns-default-4dk4d\" (UID: \"d0a4fbae-6823-41cb-9e55-76a71200d50e\") " pod="openshift-dns/dns-default-4dk4d"
Jul 15 15:25:05.783956 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:05.783838    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c70271a-74b9-4303-8257-f7cd4ef76758-registry-tls\") pod \"image-registry-66bf4fd47d-gkcb2\" (UID: \"2c70271a-74b9-4303-8257-f7cd4ef76758\") " pod="openshift-image-registry/image-registry-66bf4fd47d-gkcb2"
Jul 15 15:25:05.783956 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:05.783864    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7rcm\" (UniqueName: \"kubernetes.io/projected/2c70271a-74b9-4303-8257-f7cd4ef76758-kube-api-access-n7rcm\") pod \"image-registry-66bf4fd47d-gkcb2\" (UID: \"2c70271a-74b9-4303-8257-f7cd4ef76758\") " pod="openshift-image-registry/image-registry-66bf4fd47d-gkcb2"
Jul 15 15:25:05.783956 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:05.783945    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2c70271a-74b9-4303-8257-f7cd4ef76758-ca-trust-extracted\") pod \"image-registry-66bf4fd47d-gkcb2\" (UID: \"2c70271a-74b9-4303-8257-f7cd4ef76758\") " pod="openshift-image-registry/image-registry-66bf4fd47d-gkcb2"
Jul 15 15:25:05.784326 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:25:05.784299    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 15:25:05.784395 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:25:05.784379    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0a4fbae-6823-41cb-9e55-76a71200d50e-metrics-tls podName:d0a4fbae-6823-41cb-9e55-76a71200d50e nodeName:}" failed. No retries permitted until 2026-07-15 15:25:06.284358043 +0000 UTC m=+36.630261229 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d0a4fbae-6823-41cb-9e55-76a71200d50e-metrics-tls") pod "dns-default-4dk4d" (UID: "d0a4fbae-6823-41cb-9e55-76a71200d50e") : secret "dns-default-metrics-tls" not found
Jul 15 15:25:05.784483 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:05.784457    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2c70271a-74b9-4303-8257-f7cd4ef76758-registry-certificates\") pod \"image-registry-66bf4fd47d-gkcb2\" (UID: \"2c70271a-74b9-4303-8257-f7cd4ef76758\") " pod="openshift-image-registry/image-registry-66bf4fd47d-gkcb2"
Jul 15 15:25:05.784582 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:25:05.784564    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 15:25:05.784653 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:25:05.784585    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66bf4fd47d-gkcb2: secret "image-registry-tls" not found
Jul 15 15:25:05.784653 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:25:05.784641    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c70271a-74b9-4303-8257-f7cd4ef76758-registry-tls podName:2c70271a-74b9-4303-8257-f7cd4ef76758 nodeName:}" failed. No retries permitted until 2026-07-15 15:25:06.284626226 +0000 UTC m=+36.630529397 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2c70271a-74b9-4303-8257-f7cd4ef76758-registry-tls") pod "image-registry-66bf4fd47d-gkcb2" (UID: "2c70271a-74b9-4303-8257-f7cd4ef76758") : secret "image-registry-tls" not found
Jul 15 15:25:05.784791 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:05.784767    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0a4fbae-6823-41cb-9e55-76a71200d50e-tmp-dir\") pod \"dns-default-4dk4d\" (UID: \"d0a4fbae-6823-41cb-9e55-76a71200d50e\") " pod="openshift-dns/dns-default-4dk4d"
Jul 15 15:25:05.784857 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:05.784788    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d0a4fbae-6823-41cb-9e55-76a71200d50e-config-volume\") pod \"dns-default-4dk4d\" (UID: \"d0a4fbae-6823-41cb-9e55-76a71200d50e\") " pod="openshift-dns/dns-default-4dk4d"
Jul 15 15:25:05.785187 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:05.785165    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2c70271a-74b9-4303-8257-f7cd4ef76758-trusted-ca\") pod \"image-registry-66bf4fd47d-gkcb2\" (UID: \"2c70271a-74b9-4303-8257-f7cd4ef76758\") " pod="openshift-image-registry/image-registry-66bf4fd47d-gkcb2"
Jul 15 15:25:05.788626 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:05.788526    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2c70271a-74b9-4303-8257-f7cd4ef76758-image-registry-private-configuration\") pod \"image-registry-66bf4fd47d-gkcb2\" (UID: \"2c70271a-74b9-4303-8257-f7cd4ef76758\") " pod="openshift-image-registry/image-registry-66bf4fd47d-gkcb2"
Jul 15 15:25:05.788737 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:05.788554    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2c70271a-74b9-4303-8257-f7cd4ef76758-installation-pull-secrets\") pod \"image-registry-66bf4fd47d-gkcb2\" (UID: \"2c70271a-74b9-4303-8257-f7cd4ef76758\") " pod="openshift-image-registry/image-registry-66bf4fd47d-gkcb2"
Jul 15 15:25:05.788737 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:05.788581    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f6fd386-c683-4903-8dcb-1a2d19d4697e-cert\") pod \"ingress-canary-7np6g\" (UID: \"0f6fd386-c683-4903-8dcb-1a2d19d4697e\") " pod="openshift-ingress-canary/ingress-canary-7np6g"
Jul 15 15:25:05.794636 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:05.794598    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmkmx\" (UniqueName: \"kubernetes.io/projected/0f6fd386-c683-4903-8dcb-1a2d19d4697e-kube-api-access-nmkmx\") pod \"ingress-canary-7np6g\" (UID: \"0f6fd386-c683-4903-8dcb-1a2d19d4697e\") " pod="openshift-ingress-canary/ingress-canary-7np6g"
Jul 15 15:25:05.795428 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:05.795402    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2c70271a-74b9-4303-8257-f7cd4ef76758-bound-sa-token\") pod \"image-registry-66bf4fd47d-gkcb2\" (UID: \"2c70271a-74b9-4303-8257-f7cd4ef76758\") " pod="openshift-image-registry/image-registry-66bf4fd47d-gkcb2"
Jul 15 15:25:05.796945 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:05.796916    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsdh6\" (UniqueName: \"kubernetes.io/projected/d0a4fbae-6823-41cb-9e55-76a71200d50e-kube-api-access-hsdh6\") pod \"dns-default-4dk4d\" (UID: \"d0a4fbae-6823-41cb-9e55-76a71200d50e\") " pod="openshift-dns/dns-default-4dk4d"
Jul 15 15:25:05.797249 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:05.797233    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7rcm\" (UniqueName: \"kubernetes.io/projected/2c70271a-74b9-4303-8257-f7cd4ef76758-kube-api-access-n7rcm\") pod \"image-registry-66bf4fd47d-gkcb2\" (UID: \"2c70271a-74b9-4303-8257-f7cd4ef76758\") " pod="openshift-image-registry/image-registry-66bf4fd47d-gkcb2"
Jul 15 15:25:05.878483 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:05.878449    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7np6g"
Jul 15 15:25:05.884665 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:05.884639    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:06.101222 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:06.101133    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:06.227451 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:06.227428    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b7s72"
Jul 15 15:25:06.227608 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:06.227532    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w7zbl"
Jul 15 15:25:06.227689 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:06.227672    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rbktn"
Jul 15 15:25:06.229920 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:06.229902    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 15 15:25:06.230117 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:06.230066    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 15 15:25:06.230259 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:06.230239    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-h9ndf\""
Jul 15 15:25:06.230949 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:06.230932    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 15 15:25:06.231046 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:06.230950    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qs6fl\""
Jul 15 15:25:06.231046 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:06.230952    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 15 15:25:06.287308 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:06.287286    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c70271a-74b9-4303-8257-f7cd4ef76758-registry-tls\") pod \"image-registry-66bf4fd47d-gkcb2\" (UID: \"2c70271a-74b9-4303-8257-f7cd4ef76758\") " pod="openshift-image-registry/image-registry-66bf4fd47d-gkcb2"
Jul 15 15:25:06.287394 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:06.287352    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d0a4fbae-6823-41cb-9e55-76a71200d50e-metrics-tls\") pod \"dns-default-4dk4d\" (UID: \"d0a4fbae-6823-41cb-9e55-76a71200d50e\") " pod="openshift-dns/dns-default-4dk4d"
Jul 15 15:25:06.287449 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:25:06.287439    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 15:25:06.287503 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:25:06.287451    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66bf4fd47d-gkcb2: secret "image-registry-tls" not found
Jul 15 15:25:06.287503 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:25:06.287495    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 15:25:06.287586 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:25:06.287503    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c70271a-74b9-4303-8257-f7cd4ef76758-registry-tls podName:2c70271a-74b9-4303-8257-f7cd4ef76758 nodeName:}" failed. No retries permitted until 2026-07-15 15:25:07.287485194 +0000 UTC m=+37.633388379 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2c70271a-74b9-4303-8257-f7cd4ef76758-registry-tls") pod "image-registry-66bf4fd47d-gkcb2" (UID: "2c70271a-74b9-4303-8257-f7cd4ef76758") : secret "image-registry-tls" not found
Jul 15 15:25:06.287586 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:25:06.287574    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0a4fbae-6823-41cb-9e55-76a71200d50e-metrics-tls podName:d0a4fbae-6823-41cb-9e55-76a71200d50e nodeName:}" failed. No retries permitted until 2026-07-15 15:25:07.287555133 +0000 UTC m=+37.633458317 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d0a4fbae-6823-41cb-9e55-76a71200d50e-metrics-tls") pod "dns-default-4dk4d" (UID: "d0a4fbae-6823-41cb-9e55-76a71200d50e") : secret "dns-default-metrics-tls" not found
Jul 15 15:25:06.319976 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:06.319950    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:06.422959 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:06.422867    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:06.450247 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:06.450204    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-2x8hw"]
Jul 15 15:25:06.452088 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:06.452072    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-2x8hw"
Jul 15 15:25:06.454720 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:06.454700    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 15 15:25:06.454972 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:06.454960    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 15 15:25:06.455184 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:06.455154    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-4gcf9\""
Jul 15 15:25:06.464533 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:06.464513    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-2x8hw"]
Jul 15 15:25:06.522447 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:06.522413    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:06.590064 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:06.590034    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dl7xv\" (UniqueName: \"kubernetes.io/projected/75c12e56-4e63-4bf2-b1e5-9ccbfd9c43e3-kube-api-access-dl7xv\") pod \"migrator-7f59b54f6c-2x8hw\" (UID: \"75c12e56-4e63-4bf2-b1e5-9ccbfd9c43e3\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-2x8hw"
Jul 15 15:25:06.625360 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:06.625327    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:06.691496 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:06.691411    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dl7xv\" (UniqueName: \"kubernetes.io/projected/75c12e56-4e63-4bf2-b1e5-9ccbfd9c43e3-kube-api-access-dl7xv\") pod \"migrator-7f59b54f6c-2x8hw\" (UID: \"75c12e56-4e63-4bf2-b1e5-9ccbfd9c43e3\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-2x8hw"
Jul 15 15:25:06.708222 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:06.708192    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dl7xv\" (UniqueName: \"kubernetes.io/projected/75c12e56-4e63-4bf2-b1e5-9ccbfd9c43e3-kube-api-access-dl7xv\") pod \"migrator-7f59b54f6c-2x8hw\" (UID: \"75c12e56-4e63-4bf2-b1e5-9ccbfd9c43e3\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-2x8hw"
Jul 15 15:25:06.730972 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:06.730939    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-5ttpp"]
Jul 15 15:25:06.733055 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:06.733038    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5ttpp"
Jul 15 15:25:06.735504 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:06.735485    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 15 15:25:06.735504 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:06.735493    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 15 15:25:06.735655 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:06.735593    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 15 15:25:06.735749 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:06.735725    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-92ld7\""
Jul 15 15:25:06.735749 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:06.735730    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 15 15:25:06.745953 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:06.745935    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5ttpp"]
Jul 15 15:25:06.761108 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:06.761085    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-2x8hw"
Jul 15 15:25:06.866315 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:06.866280    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:06.893312 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:06.893270    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6aa4a480-d68b-4d9b-94c3-4e96179cea3b-crio-socket\") pod \"insights-runtime-extractor-5ttpp\" (UID: \"6aa4a480-d68b-4d9b-94c3-4e96179cea3b\") " pod="openshift-insights/insights-runtime-extractor-5ttpp"
Jul 15 15:25:06.893464 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:06.893313    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6aa4a480-d68b-4d9b-94c3-4e96179cea3b-data-volume\") pod \"insights-runtime-extractor-5ttpp\" (UID: \"6aa4a480-d68b-4d9b-94c3-4e96179cea3b\") " pod="openshift-insights/insights-runtime-extractor-5ttpp"
Jul 15 15:25:06.893464 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:06.893406    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6aa4a480-d68b-4d9b-94c3-4e96179cea3b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5ttpp\" (UID: \"6aa4a480-d68b-4d9b-94c3-4e96179cea3b\") " pod="openshift-insights/insights-runtime-extractor-5ttpp"
Jul 15 15:25:06.893464 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:06.893447    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6aa4a480-d68b-4d9b-94c3-4e96179cea3b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5ttpp\" (UID: \"6aa4a480-d68b-4d9b-94c3-4e96179cea3b\") " pod="openshift-insights/insights-runtime-extractor-5ttpp"
Jul 15 15:25:06.893634 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:06.893494    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzqf7\" (UniqueName: \"kubernetes.io/projected/6aa4a480-d68b-4d9b-94c3-4e96179cea3b-kube-api-access-jzqf7\") pod \"insights-runtime-extractor-5ttpp\" (UID: \"6aa4a480-d68b-4d9b-94c3-4e96179cea3b\") " pod="openshift-insights/insights-runtime-extractor-5ttpp"
Jul 15 15:25:06.994915 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:06.994840    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzqf7\" (UniqueName: \"kubernetes.io/projected/6aa4a480-d68b-4d9b-94c3-4e96179cea3b-kube-api-access-jzqf7\") pod \"insights-runtime-extractor-5ttpp\" (UID: \"6aa4a480-d68b-4d9b-94c3-4e96179cea3b\") " pod="openshift-insights/insights-runtime-extractor-5ttpp"
Jul 15 15:25:06.995094 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:06.994917    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6aa4a480-d68b-4d9b-94c3-4e96179cea3b-crio-socket\") pod \"insights-runtime-extractor-5ttpp\" (UID: \"6aa4a480-d68b-4d9b-94c3-4e96179cea3b\") " pod="openshift-insights/insights-runtime-extractor-5ttpp"
Jul 15 15:25:06.995094 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:06.994944    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6aa4a480-d68b-4d9b-94c3-4e96179cea3b-data-volume\") pod \"insights-runtime-extractor-5ttpp\" (UID: \"6aa4a480-d68b-4d9b-94c3-4e96179cea3b\") " pod="openshift-insights/insights-runtime-extractor-5ttpp"
Jul 15 15:25:06.995094 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:06.994989    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6aa4a480-d68b-4d9b-94c3-4e96179cea3b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5ttpp\" (UID: \"6aa4a480-d68b-4d9b-94c3-4e96179cea3b\") " pod="openshift-insights/insights-runtime-extractor-5ttpp"
Jul 15 15:25:06.995094 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:25:06.995081    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 15:25:06.995297 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:06.995128    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6aa4a480-d68b-4d9b-94c3-4e96179cea3b-crio-socket\") pod \"insights-runtime-extractor-5ttpp\" (UID: \"6aa4a480-d68b-4d9b-94c3-4e96179cea3b\") " pod="openshift-insights/insights-runtime-extractor-5ttpp"
Jul 15 15:25:06.995297 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:06.995138    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6aa4a480-d68b-4d9b-94c3-4e96179cea3b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5ttpp\" (UID: \"6aa4a480-d68b-4d9b-94c3-4e96179cea3b\") " pod="openshift-insights/insights-runtime-extractor-5ttpp"
Jul 15 15:25:06.995297 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:25:06.995164    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6aa4a480-d68b-4d9b-94c3-4e96179cea3b-kube-rbac-proxy-cm podName:6aa4a480-d68b-4d9b-94c3-4e96179cea3b nodeName:}" failed. No retries permitted until 2026-07-15 15:25:07.49514335 +0000 UTC m=+37.841046535 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6aa4a480-d68b-4d9b-94c3-4e96179cea3b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5ttpp" (UID: "6aa4a480-d68b-4d9b-94c3-4e96179cea3b") : configmap "kube-rbac-proxy" not found
Jul 15 15:25:06.995297 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:25:06.995233    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 15:25:06.995463 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:25:06.995300    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6aa4a480-d68b-4d9b-94c3-4e96179cea3b-insights-runtime-extractor-tls podName:6aa4a480-d68b-4d9b-94c3-4e96179cea3b nodeName:}" failed. No retries permitted until 2026-07-15 15:25:07.495282357 +0000 UTC m=+37.841185555 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6aa4a480-d68b-4d9b-94c3-4e96179cea3b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5ttpp" (UID: "6aa4a480-d68b-4d9b-94c3-4e96179cea3b") : secret "insights-runtime-extractor-tls" not found
Jul 15 15:25:06.995463 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:06.995343    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6aa4a480-d68b-4d9b-94c3-4e96179cea3b-data-volume\") pod \"insights-runtime-extractor-5ttpp\" (UID: \"6aa4a480-d68b-4d9b-94c3-4e96179cea3b\") " pod="openshift-insights/insights-runtime-extractor-5ttpp"
Jul 15 15:25:07.003572 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:07.003549    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzqf7\" (UniqueName: \"kubernetes.io/projected/6aa4a480-d68b-4d9b-94c3-4e96179cea3b-kube-api-access-jzqf7\") pod \"insights-runtime-extractor-5ttpp\" (UID: \"6aa4a480-d68b-4d9b-94c3-4e96179cea3b\") " pod="openshift-insights/insights-runtime-extractor-5ttpp"
Jul 15 15:25:07.297234 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:07.297209    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c70271a-74b9-4303-8257-f7cd4ef76758-registry-tls\") pod \"image-registry-66bf4fd47d-gkcb2\" (UID: \"2c70271a-74b9-4303-8257-f7cd4ef76758\") " pod="openshift-image-registry/image-registry-66bf4fd47d-gkcb2"
Jul 15 15:25:07.297353 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:07.297296    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d0a4fbae-6823-41cb-9e55-76a71200d50e-metrics-tls\") pod \"dns-default-4dk4d\" (UID: \"d0a4fbae-6823-41cb-9e55-76a71200d50e\") " pod="openshift-dns/dns-default-4dk4d"
Jul 15 15:25:07.297418 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:25:07.297348    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 15:25:07.297418 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:25:07.297365    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66bf4fd47d-gkcb2: secret "image-registry-tls" not found
Jul 15 15:25:07.297418 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:25:07.297386    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 15:25:07.297418 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:25:07.297414    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c70271a-74b9-4303-8257-f7cd4ef76758-registry-tls podName:2c70271a-74b9-4303-8257-f7cd4ef76758 nodeName:}" failed. No retries permitted until 2026-07-15 15:25:09.297397519 +0000 UTC m=+39.643300690 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2c70271a-74b9-4303-8257-f7cd4ef76758-registry-tls") pod "image-registry-66bf4fd47d-gkcb2" (UID: "2c70271a-74b9-4303-8257-f7cd4ef76758") : secret "image-registry-tls" not found
Jul 15 15:25:07.297592 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:25:07.297427    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0a4fbae-6823-41cb-9e55-76a71200d50e-metrics-tls podName:d0a4fbae-6823-41cb-9e55-76a71200d50e nodeName:}" failed. No retries permitted until 2026-07-15 15:25:09.297420927 +0000 UTC m=+39.643324098 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d0a4fbae-6823-41cb-9e55-76a71200d50e-metrics-tls") pod "dns-default-4dk4d" (UID: "d0a4fbae-6823-41cb-9e55-76a71200d50e") : secret "dns-default-metrics-tls" not found
Jul 15 15:25:07.304184 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:07.304158    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7np6g"]
Jul 15 15:25:07.307541 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:07.307374    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-2x8hw"]
Jul 15 15:25:07.307699 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:25:07.307662    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f6fd386_c683_4903_8dcb_1a2d19d4697e.slice/crio-5e5a13cf441bac5e247bb5bd2f2dbd4e3180eee505341ce6ef0235f5d9d40dbe WatchSource:0}: Error finding container 5e5a13cf441bac5e247bb5bd2f2dbd4e3180eee505341ce6ef0235f5d9d40dbe: Status 404 returned error can't find the container with id 5e5a13cf441bac5e247bb5bd2f2dbd4e3180eee505341ce6ef0235f5d9d40dbe
Jul 15 15:25:07.311813 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:25:07.311787    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75c12e56_4e63_4bf2_b1e5_9ccbfd9c43e3.slice/crio-5976ec7d922960e4dac1a30e5d740aad8371d0736ebb0d9d6268397fd22c41c8 WatchSource:0}: Error finding container 5976ec7d922960e4dac1a30e5d740aad8371d0736ebb0d9d6268397fd22c41c8: Status 404 returned error can't find the container with id 5976ec7d922960e4dac1a30e5d740aad8371d0736ebb0d9d6268397fd22c41c8
Jul 15 15:25:07.424939 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:07.424908    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-2x8hw" event={"ID":"75c12e56-4e63-4bf2-b1e5-9ccbfd9c43e3","Type":"ContainerStarted","Data":"5976ec7d922960e4dac1a30e5d740aad8371d0736ebb0d9d6268397fd22c41c8"}
Jul 15 15:25:07.426045 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:07.426019    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7np6g" event={"ID":"0f6fd386-c683-4903-8dcb-1a2d19d4697e","Type":"ContainerStarted","Data":"5e5a13cf441bac5e247bb5bd2f2dbd4e3180eee505341ce6ef0235f5d9d40dbe"}
Jul 15 15:25:07.428693 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:07.428671    2564 generic.go:356] "Generic (PLEG): container finished" podID="83ea2fad-6953-4605-bd20-4ca74169f20d" containerID="e5310aa53aa67c47136cbe29f42947a6a75075eb26097c6f1aa980e4edb09281" exitCode=0
Jul 15 15:25:07.428759 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:07.428726    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2s2fn" event={"ID":"83ea2fad-6953-4605-bd20-4ca74169f20d","Type":"ContainerDied","Data":"e5310aa53aa67c47136cbe29f42947a6a75075eb26097c6f1aa980e4edb09281"}
Jul 15 15:25:07.498334 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:07.498310    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6aa4a480-d68b-4d9b-94c3-4e96179cea3b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5ttpp\" (UID: \"6aa4a480-d68b-4d9b-94c3-4e96179cea3b\") " pod="openshift-insights/insights-runtime-extractor-5ttpp"
Jul 15 15:25:07.498439 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:07.498352    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6aa4a480-d68b-4d9b-94c3-4e96179cea3b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5ttpp\" (UID: \"6aa4a480-d68b-4d9b-94c3-4e96179cea3b\") " pod="openshift-insights/insights-runtime-extractor-5ttpp"
Jul 15 15:25:07.498498 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:25:07.498439    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 15:25:07.498554 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:25:07.498498    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 15:25:07.498554 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:25:07.498507    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6aa4a480-d68b-4d9b-94c3-4e96179cea3b-kube-rbac-proxy-cm podName:6aa4a480-d68b-4d9b-94c3-4e96179cea3b nodeName:}" failed. No retries permitted until 2026-07-15 15:25:08.498484348 +0000 UTC m=+38.844387520 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6aa4a480-d68b-4d9b-94c3-4e96179cea3b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5ttpp" (UID: "6aa4a480-d68b-4d9b-94c3-4e96179cea3b") : configmap "kube-rbac-proxy" not found
Jul 15 15:25:07.498656 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:25:07.498627    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6aa4a480-d68b-4d9b-94c3-4e96179cea3b-insights-runtime-extractor-tls podName:6aa4a480-d68b-4d9b-94c3-4e96179cea3b nodeName:}" failed. No retries permitted until 2026-07-15 15:25:08.498610781 +0000 UTC m=+38.844513958 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6aa4a480-d68b-4d9b-94c3-4e96179cea3b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5ttpp" (UID: "6aa4a480-d68b-4d9b-94c3-4e96179cea3b") : secret "insights-runtime-extractor-tls" not found
Jul 15 15:25:08.109159 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:08.109131    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:08.177665 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:08.177593    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-v2fqr"]
Jul 15 15:25:08.188612 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:08.179550    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-v2fqr"
Jul 15 15:25:08.188612 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:08.183781    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 15 15:25:08.188612 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:08.184069    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 15 15:25:08.188612 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:08.184968    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 15 15:25:08.188612 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:08.185155    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 15 15:25:08.188612 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:08.185355    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-kknkz\""
Jul 15 15:25:08.202180 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:08.202152    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-v2fqr"]
Jul 15 15:25:08.209882 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:08.209857    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:08.297455 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:08.297371    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:08.305541 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:08.305504    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l76x5\" (UniqueName: \"kubernetes.io/projected/96272d37-8eb7-49d1-8392-8a397e2df475-kube-api-access-l76x5\") pod \"service-ca-79f68b9f4f-v2fqr\" (UID: \"96272d37-8eb7-49d1-8392-8a397e2df475\") " pod="openshift-service-ca/service-ca-79f68b9f4f-v2fqr"
Jul 15 15:25:08.305672 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:08.305611    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/96272d37-8eb7-49d1-8392-8a397e2df475-signing-key\") pod \"service-ca-79f68b9f4f-v2fqr\" (UID: \"96272d37-8eb7-49d1-8392-8a397e2df475\") " pod="openshift-service-ca/service-ca-79f68b9f4f-v2fqr"
Jul 15 15:25:08.305672 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:08.305637    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/96272d37-8eb7-49d1-8392-8a397e2df475-signing-cabundle\") pod \"service-ca-79f68b9f4f-v2fqr\" (UID: \"96272d37-8eb7-49d1-8392-8a397e2df475\") " pod="openshift-service-ca/service-ca-79f68b9f4f-v2fqr"
Jul 15 15:25:08.406770 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:08.406420    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l76x5\" (UniqueName: \"kubernetes.io/projected/96272d37-8eb7-49d1-8392-8a397e2df475-kube-api-access-l76x5\") pod \"service-ca-79f68b9f4f-v2fqr\" (UID: \"96272d37-8eb7-49d1-8392-8a397e2df475\") " pod="openshift-service-ca/service-ca-79f68b9f4f-v2fqr"
Jul 15 15:25:08.407214 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:08.406994    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/96272d37-8eb7-49d1-8392-8a397e2df475-signing-key\") pod \"service-ca-79f68b9f4f-v2fqr\" (UID: \"96272d37-8eb7-49d1-8392-8a397e2df475\") " pod="openshift-service-ca/service-ca-79f68b9f4f-v2fqr"
Jul 15 15:25:08.407214 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:08.407057    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/96272d37-8eb7-49d1-8392-8a397e2df475-signing-cabundle\") pod \"service-ca-79f68b9f4f-v2fqr\" (UID: \"96272d37-8eb7-49d1-8392-8a397e2df475\") " pod="openshift-service-ca/service-ca-79f68b9f4f-v2fqr"
Jul 15 15:25:08.407972 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:08.407932    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/96272d37-8eb7-49d1-8392-8a397e2df475-signing-cabundle\") pod \"service-ca-79f68b9f4f-v2fqr\" (UID: \"96272d37-8eb7-49d1-8392-8a397e2df475\") " pod="openshift-service-ca/service-ca-79f68b9f4f-v2fqr"
Jul 15 15:25:08.411991 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:08.411969    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/96272d37-8eb7-49d1-8392-8a397e2df475-signing-key\") pod \"service-ca-79f68b9f4f-v2fqr\" (UID: \"96272d37-8eb7-49d1-8392-8a397e2df475\") " pod="openshift-service-ca/service-ca-79f68b9f4f-v2fqr"
Jul 15 15:25:08.416909 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:08.416886    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l76x5\" (UniqueName: \"kubernetes.io/projected/96272d37-8eb7-49d1-8392-8a397e2df475-kube-api-access-l76x5\") pod \"service-ca-79f68b9f4f-v2fqr\" (UID: \"96272d37-8eb7-49d1-8392-8a397e2df475\") " pod="openshift-service-ca/service-ca-79f68b9f4f-v2fqr"
Jul 15 15:25:08.434718 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:08.434691    2564 generic.go:356] "Generic (PLEG): container finished" podID="83ea2fad-6953-4605-bd20-4ca74169f20d" containerID="e5eba8770393ac02f846e558e336dd9c535b0054cb38be6c4ca3b42c8c1b9c78" exitCode=0
Jul 15 15:25:08.434787 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:08.434752    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2s2fn" event={"ID":"83ea2fad-6953-4605-bd20-4ca74169f20d","Type":"ContainerDied","Data":"e5eba8770393ac02f846e558e336dd9c535b0054cb38be6c4ca3b42c8c1b9c78"}
Jul 15 15:25:08.508416 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:08.508386    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6aa4a480-d68b-4d9b-94c3-4e96179cea3b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5ttpp\" (UID: \"6aa4a480-d68b-4d9b-94c3-4e96179cea3b\") " pod="openshift-insights/insights-runtime-extractor-5ttpp"
Jul 15 15:25:08.508559 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:08.508441    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6aa4a480-d68b-4d9b-94c3-4e96179cea3b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5ttpp\" (UID: \"6aa4a480-d68b-4d9b-94c3-4e96179cea3b\") " pod="openshift-insights/insights-runtime-extractor-5ttpp"
Jul 15 15:25:08.508629 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:25:08.508561    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 15:25:08.508629 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:25:08.508618    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6aa4a480-d68b-4d9b-94c3-4e96179cea3b-insights-runtime-extractor-tls podName:6aa4a480-d68b-4d9b-94c3-4e96179cea3b nodeName:}" failed. No retries permitted until 2026-07-15 15:25:10.508600769 +0000 UTC m=+40.854503957 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6aa4a480-d68b-4d9b-94c3-4e96179cea3b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5ttpp" (UID: "6aa4a480-d68b-4d9b-94c3-4e96179cea3b") : secret "insights-runtime-extractor-tls" not found
Jul 15 15:25:08.509047 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:25:08.509026    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 15:25:08.509111 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:25:08.509093    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6aa4a480-d68b-4d9b-94c3-4e96179cea3b-kube-rbac-proxy-cm podName:6aa4a480-d68b-4d9b-94c3-4e96179cea3b nodeName:}" failed. No retries permitted until 2026-07-15 15:25:10.50907577 +0000 UTC m=+40.854978941 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6aa4a480-d68b-4d9b-94c3-4e96179cea3b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5ttpp" (UID: "6aa4a480-d68b-4d9b-94c3-4e96179cea3b") : configmap "kube-rbac-proxy" not found
Jul 15 15:25:08.510865 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:08.510838    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-v2fqr"
Jul 15 15:25:08.664204 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:08.664126    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-v2fqr"]
Jul 15 15:25:08.668726 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:25:08.668698    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96272d37_8eb7_49d1_8392_8a397e2df475.slice/crio-6ef15560318f46ac8db2d2d474c4b764fe55e0b690135428c95c264b351d9896 WatchSource:0}: Error finding container 6ef15560318f46ac8db2d2d474c4b764fe55e0b690135428c95c264b351d9896: Status 404 returned error can't find the container with id 6ef15560318f46ac8db2d2d474c4b764fe55e0b690135428c95c264b351d9896
Jul 15 15:25:08.915170 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:08.915092    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4bhw5_52587e3b-cd74-43d1-86aa-29a127627f90/dns-node-resolver/0.log"
Jul 15 15:25:09.316465 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:09.316225    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c70271a-74b9-4303-8257-f7cd4ef76758-registry-tls\") pod \"image-registry-66bf4fd47d-gkcb2\" (UID: \"2c70271a-74b9-4303-8257-f7cd4ef76758\") " pod="openshift-image-registry/image-registry-66bf4fd47d-gkcb2"
Jul 15 15:25:09.316924 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:25:09.316398    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 15:25:09.316924 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:25:09.316556    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66bf4fd47d-gkcb2: secret "image-registry-tls" not found
Jul 15 15:25:09.316924 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:09.316559    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d0a4fbae-6823-41cb-9e55-76a71200d50e-metrics-tls\") pod \"dns-default-4dk4d\" (UID: \"d0a4fbae-6823-41cb-9e55-76a71200d50e\") " pod="openshift-dns/dns-default-4dk4d"
Jul 15 15:25:09.316924 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:25:09.316644    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c70271a-74b9-4303-8257-f7cd4ef76758-registry-tls podName:2c70271a-74b9-4303-8257-f7cd4ef76758 nodeName:}" failed. No retries permitted until 2026-07-15 15:25:13.3166199 +0000 UTC m=+43.662523085 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2c70271a-74b9-4303-8257-f7cd4ef76758-registry-tls") pod "image-registry-66bf4fd47d-gkcb2" (UID: "2c70271a-74b9-4303-8257-f7cd4ef76758") : secret "image-registry-tls" not found
Jul 15 15:25:09.316924 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:25:09.316685    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 15:25:09.316924 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:25:09.316734    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0a4fbae-6823-41cb-9e55-76a71200d50e-metrics-tls podName:d0a4fbae-6823-41cb-9e55-76a71200d50e nodeName:}" failed. No retries permitted until 2026-07-15 15:25:13.316718448 +0000 UTC m=+43.662621626 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d0a4fbae-6823-41cb-9e55-76a71200d50e-metrics-tls") pod "dns-default-4dk4d" (UID: "d0a4fbae-6823-41cb-9e55-76a71200d50e") : secret "dns-default-metrics-tls" not found
Jul 15 15:25:09.440510 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:09.440413    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-2x8hw" event={"ID":"75c12e56-4e63-4bf2-b1e5-9ccbfd9c43e3","Type":"ContainerStarted","Data":"222c38d53fda56a0ff51e50058d93fc79cd296c90752d3c53ca986e88c9854c6"}
Jul 15 15:25:09.440669 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:09.440535    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-2x8hw" event={"ID":"75c12e56-4e63-4bf2-b1e5-9ccbfd9c43e3","Type":"ContainerStarted","Data":"e4a562272a5daa85ba3c8bfae25b6ce62e0b06d113f3c0c62c394a6abe74d709"}
Jul 15 15:25:09.445167 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:09.445003    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2s2fn" event={"ID":"83ea2fad-6953-4605-bd20-4ca74169f20d","Type":"ContainerStarted","Data":"c220c6c7a4f4027c57ad61bab897fc6b73970e93d1d395f22e06e338a0972823"}
Jul 15 15:25:09.448673 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:09.448407    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-v2fqr" event={"ID":"96272d37-8eb7-49d1-8392-8a397e2df475","Type":"ContainerStarted","Data":"6ef15560318f46ac8db2d2d474c4b764fe55e0b690135428c95c264b351d9896"}
Jul 15 15:25:09.457544 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:09.457477    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-2x8hw" podStartSLOduration=1.7119063410000002 podStartE2EDuration="3.457456522s" totalImagesPullingTime="1.745550181s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:25:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:25:09.457131913 +0000 UTC m=+39.803035113" watchObservedRunningTime="2026-07-15 15:25:09.457456522 +0000 UTC m=+39.803359716"
Jul 15 15:25:09.482402 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:09.482339    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-2s2fn" podStartSLOduration=8.159255088 podStartE2EDuration="39.482321947s" totalImagesPullingTime="31.323066859s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 15:24:30 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:25:09.480799308 +0000 UTC m=+39.826702541" watchObservedRunningTime="2026-07-15 15:25:09.482321947 +0000 UTC m=+39.828225130"
Jul 15 15:25:09.915443 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:09.915360    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dq4f9_bd4f0795-8b44-4ea5-9a78-6c790d60ab3d/node-ca/0.log"
Jul 15 15:25:10.526836 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:10.526801    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6aa4a480-d68b-4d9b-94c3-4e96179cea3b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5ttpp\" (UID: \"6aa4a480-d68b-4d9b-94c3-4e96179cea3b\") " pod="openshift-insights/insights-runtime-extractor-5ttpp"
Jul 15 15:25:10.527408 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:10.526847    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6aa4a480-d68b-4d9b-94c3-4e96179cea3b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5ttpp\" (UID: \"6aa4a480-d68b-4d9b-94c3-4e96179cea3b\") " pod="openshift-insights/insights-runtime-extractor-5ttpp"
Jul 15 15:25:10.527408 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:25:10.526947    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 15:25:10.527408 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:25:10.527026    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6aa4a480-d68b-4d9b-94c3-4e96179cea3b-kube-rbac-proxy-cm podName:6aa4a480-d68b-4d9b-94c3-4e96179cea3b nodeName:}" failed. No retries permitted until 2026-07-15 15:25:14.526994833 +0000 UTC m=+44.872898004 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6aa4a480-d68b-4d9b-94c3-4e96179cea3b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5ttpp" (UID: "6aa4a480-d68b-4d9b-94c3-4e96179cea3b") : configmap "kube-rbac-proxy" not found
Jul 15 15:25:10.527408 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:25:10.527057    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 15:25:10.527408 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:25:10.527114    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6aa4a480-d68b-4d9b-94c3-4e96179cea3b-insights-runtime-extractor-tls podName:6aa4a480-d68b-4d9b-94c3-4e96179cea3b nodeName:}" failed. No retries permitted until 2026-07-15 15:25:14.527098186 +0000 UTC m=+44.873001356 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6aa4a480-d68b-4d9b-94c3-4e96179cea3b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5ttpp" (UID: "6aa4a480-d68b-4d9b-94c3-4e96179cea3b") : secret "insights-runtime-extractor-tls" not found
Jul 15 15:25:10.771560 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:10.771529    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:10.852457 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:10.852366    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:11.119400 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:11.119377    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-2x8hw_75c12e56-4e63-4bf2-b1e5-9ccbfd9c43e3/migrator/0.log"
Jul 15 15:25:11.315438 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:11.315410    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-2x8hw_75c12e56-4e63-4bf2-b1e5-9ccbfd9c43e3/graceful-termination/0.log"
Jul 15 15:25:11.453788 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:11.453765    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7np6g" event={"ID":"0f6fd386-c683-4903-8dcb-1a2d19d4697e","Type":"ContainerStarted","Data":"c7fcf4a693b47fca86f99727f990ab95bbb2933d7e7d3ce324c9a154cf55abd8"}
Jul 15 15:25:11.470769 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:11.470727    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-7np6g" podStartSLOduration=2.7147964890000003 podStartE2EDuration="6.470714951s" totalImagesPullingTime="3.755918462s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:25:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:25:11.470238553 +0000 UTC m=+41.816141756" watchObservedRunningTime="2026-07-15 15:25:11.470714951 +0000 UTC m=+41.816618176"
Jul 15 15:25:12.457612 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:12.457576    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-v2fqr" event={"ID":"96272d37-8eb7-49d1-8392-8a397e2df475","Type":"ContainerStarted","Data":"2b6fe94d267b2f71b04be25a8e47b2a9fbbfdd9ef784716064ad05bc74eb0a36"}
Jul 15 15:25:13.121069 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:13.121040    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:13.222993 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:13.222958    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:13.347190 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:13.347161    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c70271a-74b9-4303-8257-f7cd4ef76758-registry-tls\") pod \"image-registry-66bf4fd47d-gkcb2\" (UID: \"2c70271a-74b9-4303-8257-f7cd4ef76758\") " pod="openshift-image-registry/image-registry-66bf4fd47d-gkcb2"
Jul 15 15:25:13.347377 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:13.347260    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d0a4fbae-6823-41cb-9e55-76a71200d50e-metrics-tls\") pod \"dns-default-4dk4d\" (UID: \"d0a4fbae-6823-41cb-9e55-76a71200d50e\") " pod="openshift-dns/dns-default-4dk4d"
Jul 15 15:25:13.347377 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:25:13.347352    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 15:25:13.347377 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:25:13.347366    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 15:25:13.347377 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:25:13.347373    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66bf4fd47d-gkcb2: secret "image-registry-tls" not found
Jul 15 15:25:13.347558 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:25:13.347430    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0a4fbae-6823-41cb-9e55-76a71200d50e-metrics-tls podName:d0a4fbae-6823-41cb-9e55-76a71200d50e nodeName:}" failed. No retries permitted until 2026-07-15 15:25:21.347411642 +0000 UTC m=+51.693314834 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d0a4fbae-6823-41cb-9e55-76a71200d50e-metrics-tls") pod "dns-default-4dk4d" (UID: "d0a4fbae-6823-41cb-9e55-76a71200d50e") : secret "dns-default-metrics-tls" not found
Jul 15 15:25:13.347558 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:25:13.347490    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c70271a-74b9-4303-8257-f7cd4ef76758-registry-tls podName:2c70271a-74b9-4303-8257-f7cd4ef76758 nodeName:}" failed. No retries permitted until 2026-07-15 15:25:21.347463039 +0000 UTC m=+51.693366224 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2c70271a-74b9-4303-8257-f7cd4ef76758-registry-tls") pod "image-registry-66bf4fd47d-gkcb2" (UID: "2c70271a-74b9-4303-8257-f7cd4ef76758") : secret "image-registry-tls" not found
Jul 15 15:25:13.427782 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:13.427693    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:13.547578 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:13.547544    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:13.644882 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:13.644854    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:13.814241 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:13.814212    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:14.557997 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:14.557963    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6aa4a480-d68b-4d9b-94c3-4e96179cea3b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5ttpp\" (UID: \"6aa4a480-d68b-4d9b-94c3-4e96179cea3b\") " pod="openshift-insights/insights-runtime-extractor-5ttpp"
Jul 15 15:25:14.558403 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:14.558090    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6aa4a480-d68b-4d9b-94c3-4e96179cea3b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5ttpp\" (UID: \"6aa4a480-d68b-4d9b-94c3-4e96179cea3b\") " pod="openshift-insights/insights-runtime-extractor-5ttpp"
Jul 15 15:25:14.558403 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:25:14.558131    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 15:25:14.558403 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:25:14.558172    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 15:25:14.558403 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:25:14.558204    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6aa4a480-d68b-4d9b-94c3-4e96179cea3b-insights-runtime-extractor-tls podName:6aa4a480-d68b-4d9b-94c3-4e96179cea3b nodeName:}" failed. No retries permitted until 2026-07-15 15:25:22.558184054 +0000 UTC m=+52.904087231 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6aa4a480-d68b-4d9b-94c3-4e96179cea3b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5ttpp" (UID: "6aa4a480-d68b-4d9b-94c3-4e96179cea3b") : secret "insights-runtime-extractor-tls" not found
Jul 15 15:25:14.558403 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:25:14.558224    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6aa4a480-d68b-4d9b-94c3-4e96179cea3b-kube-rbac-proxy-cm podName:6aa4a480-d68b-4d9b-94c3-4e96179cea3b nodeName:}" failed. No retries permitted until 2026-07-15 15:25:22.558213781 +0000 UTC m=+52.904116957 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6aa4a480-d68b-4d9b-94c3-4e96179cea3b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5ttpp" (UID: "6aa4a480-d68b-4d9b-94c3-4e96179cea3b") : configmap "kube-rbac-proxy" not found
Jul 15 15:25:14.804151 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:14.804119    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:15.039526 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:15.039500    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:15.202492 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:15.202466    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:15.401606 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:15.401547    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:15.573373 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:15.573324    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:15.650230 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:15.650199    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:17.008746 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:17.008711    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:17.081149 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:17.081117    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:17.206590 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:17.206558    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:17.448882 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:17.448857    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:17.520696 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:17.520673    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:18.601131 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:18.601101    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:20.008043 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:20.007997    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:20.068357 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:20.068330    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:20.402934 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:20.402906    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:20.802119 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:20.802089    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:21.008119 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:21.008073    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:21.204319 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:21.204251    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:21.413573 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:21.413546    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d0a4fbae-6823-41cb-9e55-76a71200d50e-metrics-tls\") pod \"dns-default-4dk4d\" (UID: \"d0a4fbae-6823-41cb-9e55-76a71200d50e\") " pod="openshift-dns/dns-default-4dk4d"
Jul 15 15:25:21.413716 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:21.413602    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c70271a-74b9-4303-8257-f7cd4ef76758-registry-tls\") pod \"image-registry-66bf4fd47d-gkcb2\" (UID: \"2c70271a-74b9-4303-8257-f7cd4ef76758\") " pod="openshift-image-registry/image-registry-66bf4fd47d-gkcb2"
Jul 15 15:25:21.417295 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:21.417267    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d0a4fbae-6823-41cb-9e55-76a71200d50e-metrics-tls\") pod \"dns-default-4dk4d\" (UID: \"d0a4fbae-6823-41cb-9e55-76a71200d50e\") " pod="openshift-dns/dns-default-4dk4d"
Jul 15 15:25:21.417406 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:21.417321    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c70271a-74b9-4303-8257-f7cd4ef76758-registry-tls\") pod \"image-registry-66bf4fd47d-gkcb2\" (UID: \"2c70271a-74b9-4303-8257-f7cd4ef76758\") " pod="openshift-image-registry/image-registry-66bf4fd47d-gkcb2"
Jul 15 15:25:21.458392 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:21.458337    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66bf4fd47d-gkcb2"
Jul 15 15:25:21.486809 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:21.486788    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4dk4d"
Jul 15 15:25:21.602941 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:21.602885    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-v2fqr" podStartSLOduration=10.900178903 podStartE2EDuration="13.602864461s" totalImagesPullingTime="2.702685558s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:25:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:25:12.477536573 +0000 UTC m=+42.823439766" watchObservedRunningTime="2026-07-15 15:25:21.602864461 +0000 UTC m=+51.948767649"
Jul 15 15:25:21.603787 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:21.603738    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-66bf4fd47d-gkcb2"]
Jul 15 15:25:21.604295 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:21.604275    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:21.606191 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:25:21.606161    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c70271a_74b9_4303_8257_f7cd4ef76758.slice/crio-b9f4f0d716b3ade272295a40526eaab5a7ec2b8f8445cd18ba46850a81d6f3f4 WatchSource:0}: Error finding container b9f4f0d716b3ade272295a40526eaab5a7ec2b8f8445cd18ba46850a81d6f3f4: Status 404 returned error can't find the container with id b9f4f0d716b3ade272295a40526eaab5a7ec2b8f8445cd18ba46850a81d6f3f4
Jul 15 15:25:21.644318 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:21.644291    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4dk4d"]
Jul 15 15:25:21.647599 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:25:21.647574    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0a4fbae_6823_41cb_9e55_76a71200d50e.slice/crio-cb8bf7d3e4deb8851c25ebfdb34dad0ac4c62877bf1eed79a0ece5f7798e3852 WatchSource:0}: Error finding container cb8bf7d3e4deb8851c25ebfdb34dad0ac4c62877bf1eed79a0ece5f7798e3852: Status 404 returned error can't find the container with id cb8bf7d3e4deb8851c25ebfdb34dad0ac4c62877bf1eed79a0ece5f7798e3852
Jul 15 15:25:22.208485 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:22.208458    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:22.280569 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:22.280541    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:22.482257 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:22.482189    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-66bf4fd47d-gkcb2" event={"ID":"2c70271a-74b9-4303-8257-f7cd4ef76758","Type":"ContainerStarted","Data":"594fe86d3d5d70df524a8843714df411b1b9a73f79b14c59e8e680429966f0af"}
Jul 15 15:25:22.482257 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:22.482232    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-66bf4fd47d-gkcb2" event={"ID":"2c70271a-74b9-4303-8257-f7cd4ef76758","Type":"ContainerStarted","Data":"b9f4f0d716b3ade272295a40526eaab5a7ec2b8f8445cd18ba46850a81d6f3f4"}
Jul 15 15:25:22.482494 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:22.482299    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-66bf4fd47d-gkcb2"
Jul 15 15:25:22.483356 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:22.483334    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4dk4d" event={"ID":"d0a4fbae-6823-41cb-9e55-76a71200d50e","Type":"ContainerStarted","Data":"cb8bf7d3e4deb8851c25ebfdb34dad0ac4c62877bf1eed79a0ece5f7798e3852"}
Jul 15 15:25:22.507727 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:22.507678    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-66bf4fd47d-gkcb2" podStartSLOduration=23.507665522 podStartE2EDuration="23.507665522s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:24:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:25:22.506433089 +0000 UTC m=+52.852336348" watchObservedRunningTime="2026-07-15 15:25:22.507665522 +0000 UTC m=+52.853568719"
Jul 15 15:25:22.598196 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:22.598170    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:22.625328 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:22.625304    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6aa4a480-d68b-4d9b-94c3-4e96179cea3b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5ttpp\" (UID: \"6aa4a480-d68b-4d9b-94c3-4e96179cea3b\") " pod="openshift-insights/insights-runtime-extractor-5ttpp"
Jul 15 15:25:22.625453 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:22.625343    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6aa4a480-d68b-4d9b-94c3-4e96179cea3b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5ttpp\" (UID: \"6aa4a480-d68b-4d9b-94c3-4e96179cea3b\") " pod="openshift-insights/insights-runtime-extractor-5ttpp"
Jul 15 15:25:22.625453 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:25:22.625441    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 15:25:22.625573 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:25:22.625500    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6aa4a480-d68b-4d9b-94c3-4e96179cea3b-insights-runtime-extractor-tls podName:6aa4a480-d68b-4d9b-94c3-4e96179cea3b nodeName:}" failed. No retries permitted until 2026-07-15 15:25:38.625482518 +0000 UTC m=+68.971385689 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6aa4a480-d68b-4d9b-94c3-4e96179cea3b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5ttpp" (UID: "6aa4a480-d68b-4d9b-94c3-4e96179cea3b") : secret "insights-runtime-extractor-tls" not found
Jul 15 15:25:22.625880 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:22.625854    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6aa4a480-d68b-4d9b-94c3-4e96179cea3b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5ttpp\" (UID: \"6aa4a480-d68b-4d9b-94c3-4e96179cea3b\") " pod="openshift-insights/insights-runtime-extractor-5ttpp"
Jul 15 15:25:22.831258 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:22.831224    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:22.928971 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:22.928944    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:23.029596 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:23.029564    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:23.299029 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:23.298982    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:23.550815 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:23.550730    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:23.651368 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:23.651342    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:23.800274 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:23.800247    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:23.902412 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:23.902329    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:24.002394 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:24.002358    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:24.316826 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:24.316790    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:24.466477 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:24.466402    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:24.491421 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:24.491393    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4dk4d" event={"ID":"d0a4fbae-6823-41cb-9e55-76a71200d50e","Type":"ContainerStarted","Data":"8ba6441f3d02c53ca33ae95d35032fca87d2f8331db01bdfb12a15a40c2089a6"}
Jul 15 15:25:24.491563 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:24.491440    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4dk4d" event={"ID":"d0a4fbae-6823-41cb-9e55-76a71200d50e","Type":"ContainerStarted","Data":"de656b3a4cd4a2ccfd9ba192eaf0c5cd8180ecbf5db235fd400f355da45c3b09"}
Jul 15 15:25:24.491563 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:24.491512    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-4dk4d"
Jul 15 15:25:24.511823 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:24.511774    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-4dk4d" podStartSLOduration=17.176421681 podStartE2EDuration="19.511759634s" totalImagesPullingTime="2.335337953s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:25:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:25:24.510964121 +0000 UTC m=+54.856867309" watchObservedRunningTime="2026-07-15 15:25:24.511759634 +0000 UTC m=+54.857662875"
Jul 15 15:25:24.711726 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:24.711666    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:25.132027 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:25.131978    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:25.204223 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:25.204194    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:27.642790 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:27.642761    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:27.717449 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:27.717423    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:28.921826 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:28.921797    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b474f86d6-7vz7n"]
Jul 15 15:25:28.924555 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:28.924539    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b474f86d6-7vz7n"
Jul 15 15:25:28.929590 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:28.929551    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bfc8b8658-q5ts9"]
Jul 15 15:25:28.929727 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:28.929677    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 15 15:25:28.931144 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:28.931121    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 15 15:25:28.931460 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:28.931444    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bfc8b8658-q5ts9"
Jul 15 15:25:28.931849 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:28.931829    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 15 15:25:28.933982 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:28.933964    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 15 15:25:28.937758 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:28.937740    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-dzzdd\""
Jul 15 15:25:28.937852 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:28.937773    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 15 15:25:28.951196 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:28.951178    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fd64f99d-8nnft"]
Jul 15 15:25:28.953324 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:28.953308    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fd64f99d-8nnft"
Jul 15 15:25:28.953563 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:28.953512    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b474f86d6-7vz7n"]
Jul 15 15:25:28.954524 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:28.954506    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bfc8b8658-q5ts9"]
Jul 15 15:25:28.957651 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:28.957633    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 15 15:25:28.957807 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:28.957790    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 15 15:25:28.958214 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:28.958200    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 15 15:25:28.958311 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:28.958226    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 15 15:25:28.973311 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:28.973293    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2zb2\" (UniqueName: \"kubernetes.io/projected/c5b3f815-d100-4194-bef6-dc8df4ea9e6f-kube-api-access-b2zb2\") pod \"klusterlet-addon-workmgr-6b474f86d6-7vz7n\" (UID: \"c5b3f815-d100-4194-bef6-dc8df4ea9e6f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b474f86d6-7vz7n"
Jul 15 15:25:28.973393 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:28.973339    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/c5b3f815-d100-4194-bef6-dc8df4ea9e6f-klusterlet-config\") pod \"klusterlet-addon-workmgr-6b474f86d6-7vz7n\" (UID: \"c5b3f815-d100-4194-bef6-dc8df4ea9e6f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b474f86d6-7vz7n"
Jul 15 15:25:28.973393 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:28.973366    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c5b3f815-d100-4194-bef6-dc8df4ea9e6f-tmp\") pod \"klusterlet-addon-workmgr-6b474f86d6-7vz7n\" (UID: \"c5b3f815-d100-4194-bef6-dc8df4ea9e6f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b474f86d6-7vz7n"
Jul 15 15:25:28.980315 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:28.980293    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fd64f99d-8nnft"]
Jul 15 15:25:29.009672 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:29.007613    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-66bf4fd47d-gkcb2"]
Jul 15 15:25:29.074457 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:29.074427    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c5b3f815-d100-4194-bef6-dc8df4ea9e6f-tmp\") pod \"klusterlet-addon-workmgr-6b474f86d6-7vz7n\" (UID: \"c5b3f815-d100-4194-bef6-dc8df4ea9e6f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b474f86d6-7vz7n"
Jul 15 15:25:29.074695 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:29.074473    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e398d571-db5b-4ced-ad71-deb845e80ca8-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-fd64f99d-8nnft\" (UID: \"e398d571-db5b-4ced-ad71-deb845e80ca8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fd64f99d-8nnft"
Jul 15 15:25:29.074695 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:29.074499    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e398d571-db5b-4ced-ad71-deb845e80ca8-additional-service-ca\") pod \"cluster-proxy-proxy-agent-fd64f99d-8nnft\" (UID: \"e398d571-db5b-4ced-ad71-deb845e80ca8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fd64f99d-8nnft"
Jul 15 15:25:29.074695 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:29.074527    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2zb2\" (UniqueName: \"kubernetes.io/projected/c5b3f815-d100-4194-bef6-dc8df4ea9e6f-kube-api-access-b2zb2\") pod \"klusterlet-addon-workmgr-6b474f86d6-7vz7n\" (UID: \"c5b3f815-d100-4194-bef6-dc8df4ea9e6f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b474f86d6-7vz7n"
Jul 15 15:25:29.074695 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:29.074569    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e398d571-db5b-4ced-ad71-deb845e80ca8-ca\") pod \"cluster-proxy-proxy-agent-fd64f99d-8nnft\" (UID: \"e398d571-db5b-4ced-ad71-deb845e80ca8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fd64f99d-8nnft"
Jul 15 15:25:29.074695 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:29.074601    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7bsn\" (UniqueName: \"kubernetes.io/projected/ee447ec3-745f-4b06-b0d9-be17249fee78-kube-api-access-p7bsn\") pod \"managed-serviceaccount-addon-agent-7bfc8b8658-q5ts9\" (UID: \"ee447ec3-745f-4b06-b0d9-be17249fee78\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bfc8b8658-q5ts9"
Jul 15 15:25:29.074695 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:29.074675    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ee447ec3-745f-4b06-b0d9-be17249fee78-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7bfc8b8658-q5ts9\" (UID: \"ee447ec3-745f-4b06-b0d9-be17249fee78\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bfc8b8658-q5ts9"
Jul 15 15:25:29.074965 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:29.074752    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/c5b3f815-d100-4194-bef6-dc8df4ea9e6f-klusterlet-config\") pod \"klusterlet-addon-workmgr-6b474f86d6-7vz7n\" (UID: \"c5b3f815-d100-4194-bef6-dc8df4ea9e6f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b474f86d6-7vz7n"
Jul 15 15:25:29.074965 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:29.074808    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e398d571-db5b-4ced-ad71-deb845e80ca8-hub\") pod \"cluster-proxy-proxy-agent-fd64f99d-8nnft\" (UID: \"e398d571-db5b-4ced-ad71-deb845e80ca8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fd64f99d-8nnft"
Jul 15 15:25:29.074965 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:29.074836    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e398d571-db5b-4ced-ad71-deb845e80ca8-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-fd64f99d-8nnft\" (UID: \"e398d571-db5b-4ced-ad71-deb845e80ca8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fd64f99d-8nnft"
Jul 15 15:25:29.074965 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:29.074867    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2xlw\" (UniqueName: \"kubernetes.io/projected/e398d571-db5b-4ced-ad71-deb845e80ca8-kube-api-access-h2xlw\") pod \"cluster-proxy-proxy-agent-fd64f99d-8nnft\" (UID: \"e398d571-db5b-4ced-ad71-deb845e80ca8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fd64f99d-8nnft"
Jul 15 15:25:29.074965 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:29.074931    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c5b3f815-d100-4194-bef6-dc8df4ea9e6f-tmp\") pod \"klusterlet-addon-workmgr-6b474f86d6-7vz7n\" (UID: \"c5b3f815-d100-4194-bef6-dc8df4ea9e6f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b474f86d6-7vz7n"
Jul 15 15:25:29.076966 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:29.076942    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/c5b3f815-d100-4194-bef6-dc8df4ea9e6f-klusterlet-config\") pod \"klusterlet-addon-workmgr-6b474f86d6-7vz7n\" (UID: \"c5b3f815-d100-4194-bef6-dc8df4ea9e6f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b474f86d6-7vz7n"
Jul 15 15:25:29.087960 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:29.087936    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:29.091963 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:29.091947    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2zb2\" (UniqueName: \"kubernetes.io/projected/c5b3f815-d100-4194-bef6-dc8df4ea9e6f-kube-api-access-b2zb2\") pod \"klusterlet-addon-workmgr-6b474f86d6-7vz7n\" (UID: \"c5b3f815-d100-4194-bef6-dc8df4ea9e6f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b474f86d6-7vz7n"
Jul 15 15:25:29.175388 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:29.175336    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e398d571-db5b-4ced-ad71-deb845e80ca8-hub\") pod \"cluster-proxy-proxy-agent-fd64f99d-8nnft\" (UID: \"e398d571-db5b-4ced-ad71-deb845e80ca8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fd64f99d-8nnft"
Jul 15 15:25:29.175388 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:29.175361    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e398d571-db5b-4ced-ad71-deb845e80ca8-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-fd64f99d-8nnft\" (UID: \"e398d571-db5b-4ced-ad71-deb845e80ca8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fd64f99d-8nnft"
Jul 15 15:25:29.175388 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:29.175379    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2xlw\" (UniqueName: \"kubernetes.io/projected/e398d571-db5b-4ced-ad71-deb845e80ca8-kube-api-access-h2xlw\") pod \"cluster-proxy-proxy-agent-fd64f99d-8nnft\" (UID: \"e398d571-db5b-4ced-ad71-deb845e80ca8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fd64f99d-8nnft"
Jul 15 15:25:29.175535 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:29.175513    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e398d571-db5b-4ced-ad71-deb845e80ca8-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-fd64f99d-8nnft\" (UID: \"e398d571-db5b-4ced-ad71-deb845e80ca8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fd64f99d-8nnft"
Jul 15 15:25:29.175571 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:29.175557    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e398d571-db5b-4ced-ad71-deb845e80ca8-additional-service-ca\") pod \"cluster-proxy-proxy-agent-fd64f99d-8nnft\" (UID: \"e398d571-db5b-4ced-ad71-deb845e80ca8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fd64f99d-8nnft"
Jul 15 15:25:29.175649 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:29.175618    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e398d571-db5b-4ced-ad71-deb845e80ca8-ca\") pod \"cluster-proxy-proxy-agent-fd64f99d-8nnft\" (UID: \"e398d571-db5b-4ced-ad71-deb845e80ca8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fd64f99d-8nnft"
Jul 15 15:25:29.175757 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:29.175657    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7bsn\" (UniqueName: \"kubernetes.io/projected/ee447ec3-745f-4b06-b0d9-be17249fee78-kube-api-access-p7bsn\") pod \"managed-serviceaccount-addon-agent-7bfc8b8658-q5ts9\" (UID: \"ee447ec3-745f-4b06-b0d9-be17249fee78\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bfc8b8658-q5ts9"
Jul 15 15:25:29.175757 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:29.175691    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ee447ec3-745f-4b06-b0d9-be17249fee78-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7bfc8b8658-q5ts9\" (UID: \"ee447ec3-745f-4b06-b0d9-be17249fee78\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bfc8b8658-q5ts9"
Jul 15 15:25:29.176385 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:29.176358    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e398d571-db5b-4ced-ad71-deb845e80ca8-additional-service-ca\") pod \"cluster-proxy-proxy-agent-fd64f99d-8nnft\" (UID: \"e398d571-db5b-4ced-ad71-deb845e80ca8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fd64f99d-8nnft"
Jul 15 15:25:29.177872 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:29.177826    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e398d571-db5b-4ced-ad71-deb845e80ca8-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-fd64f99d-8nnft\" (UID: \"e398d571-db5b-4ced-ad71-deb845e80ca8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fd64f99d-8nnft"
Jul 15 15:25:29.177990 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:29.177967    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e398d571-db5b-4ced-ad71-deb845e80ca8-ca\") pod \"cluster-proxy-proxy-agent-fd64f99d-8nnft\" (UID: \"e398d571-db5b-4ced-ad71-deb845e80ca8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fd64f99d-8nnft"
Jul 15 15:25:29.178082 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:29.177971    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e398d571-db5b-4ced-ad71-deb845e80ca8-hub\") pod \"cluster-proxy-proxy-agent-fd64f99d-8nnft\" (UID: \"e398d571-db5b-4ced-ad71-deb845e80ca8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fd64f99d-8nnft"
Jul 15 15:25:29.178147 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:29.178095    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e398d571-db5b-4ced-ad71-deb845e80ca8-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-fd64f99d-8nnft\" (UID: \"e398d571-db5b-4ced-ad71-deb845e80ca8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fd64f99d-8nnft"
Jul 15 15:25:29.178379 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:29.178360    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ee447ec3-745f-4b06-b0d9-be17249fee78-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7bfc8b8658-q5ts9\" (UID: \"ee447ec3-745f-4b06-b0d9-be17249fee78\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bfc8b8658-q5ts9"
Jul 15 15:25:29.186588 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:29.186566    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7bsn\" (UniqueName: \"kubernetes.io/projected/ee447ec3-745f-4b06-b0d9-be17249fee78-kube-api-access-p7bsn\") pod \"managed-serviceaccount-addon-agent-7bfc8b8658-q5ts9\" (UID: \"ee447ec3-745f-4b06-b0d9-be17249fee78\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bfc8b8658-q5ts9"
Jul 15 15:25:29.187063 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:29.187047    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2xlw\" (UniqueName: \"kubernetes.io/projected/e398d571-db5b-4ced-ad71-deb845e80ca8-kube-api-access-h2xlw\") pod \"cluster-proxy-proxy-agent-fd64f99d-8nnft\" (UID: \"e398d571-db5b-4ced-ad71-deb845e80ca8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fd64f99d-8nnft"
Jul 15 15:25:29.202289 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:29.202265    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:29.233188 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:29.233172    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b474f86d6-7vz7n"
Jul 15 15:25:29.249227 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:29.249208    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bfc8b8658-q5ts9"
Jul 15 15:25:29.262198 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:29.262176    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fd64f99d-8nnft"
Jul 15 15:25:29.370121 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:29.370093    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b474f86d6-7vz7n"]
Jul 15 15:25:29.371840 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:25:29.371814    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5b3f815_d100_4194_bef6_dc8df4ea9e6f.slice/crio-265e99b48a6d02b09cea79198f68bac8c43095d0afb3947d036bdb6dda7278c2 WatchSource:0}: Error finding container 265e99b48a6d02b09cea79198f68bac8c43095d0afb3947d036bdb6dda7278c2: Status 404 returned error can't find the container with id 265e99b48a6d02b09cea79198f68bac8c43095d0afb3947d036bdb6dda7278c2
Jul 15 15:25:29.399229 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:29.399208    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bfc8b8658-q5ts9"]
Jul 15 15:25:29.401483 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:25:29.401460    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podee447ec3_745f_4b06_b0d9_be17249fee78.slice/crio-b7f97783fb7e0c6567181a9f520818e14b01ee94c41d7af0d67e6747cdd0bee6 WatchSource:0}: Error finding container b7f97783fb7e0c6567181a9f520818e14b01ee94c41d7af0d67e6747cdd0bee6: Status 404 returned error can't find the container with id b7f97783fb7e0c6567181a9f520818e14b01ee94c41d7af0d67e6747cdd0bee6
Jul 15 15:25:29.420262 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:29.420166    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fd64f99d-8nnft"]
Jul 15 15:25:29.422274 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:25:29.422257    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode398d571_db5b_4ced_ad71_deb845e80ca8.slice/crio-06053d23dd499ae809fbb838c9f3c0e97be637f9b4a628426dd9f664c290c585 WatchSource:0}: Error finding container 06053d23dd499ae809fbb838c9f3c0e97be637f9b4a628426dd9f664c290c585: Status 404 returned error can't find the container with id 06053d23dd499ae809fbb838c9f3c0e97be637f9b4a628426dd9f664c290c585
Jul 15 15:25:29.507943 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:29.507886    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b474f86d6-7vz7n" event={"ID":"c5b3f815-d100-4194-bef6-dc8df4ea9e6f","Type":"ContainerStarted","Data":"265e99b48a6d02b09cea79198f68bac8c43095d0afb3947d036bdb6dda7278c2"}
Jul 15 15:25:29.508938 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:29.508919    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fd64f99d-8nnft" event={"ID":"e398d571-db5b-4ced-ad71-deb845e80ca8","Type":"ContainerStarted","Data":"06053d23dd499ae809fbb838c9f3c0e97be637f9b4a628426dd9f664c290c585"}
Jul 15 15:25:29.509932 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:29.509912    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bfc8b8658-q5ts9" event={"ID":"ee447ec3-745f-4b06-b0d9-be17249fee78","Type":"ContainerStarted","Data":"b7f97783fb7e0c6567181a9f520818e14b01ee94c41d7af0d67e6747cdd0bee6"}
Jul 15 15:25:30.631651 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:30.631600    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:30.698961 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:30.698909    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:31.427879 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:31.427800    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bfw7r"
Jul 15 15:25:31.652685 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:31.652650    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:31.752479 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:31.752380    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:33.375453 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:33.375399    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:33.437595 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:33.437569    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:34.210786 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:34.210752    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:34.388244 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:34.388179    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:34.496742 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:34.496675    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-4dk4d"
Jul 15 15:25:34.710671 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:34.710603    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:35.534683 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:35.534644    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b474f86d6-7vz7n" event={"ID":"c5b3f815-d100-4194-bef6-dc8df4ea9e6f","Type":"ContainerStarted","Data":"b5754ed35b436c46698a0225574e7036e2589e5be3ef77e651849e2b8406455c"}
Jul 15 15:25:35.535148 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:35.534834    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b474f86d6-7vz7n"
Jul 15 15:25:35.536108 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:35.536086    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b474f86d6-7vz7n"
Jul 15 15:25:35.537197 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:35.537176    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fd64f99d-8nnft" event={"ID":"e398d571-db5b-4ced-ad71-deb845e80ca8","Type":"ContainerStarted","Data":"44dea953cf604ee269158c0e54ebf2c264e430a9873e4c0dbdc0b1a797ea7cc1"}
Jul 15 15:25:35.537308 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:35.537206    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fd64f99d-8nnft" event={"ID":"e398d571-db5b-4ced-ad71-deb845e80ca8","Type":"ContainerStarted","Data":"29a97052c51525b3f63b52228cb27d444ba9c0d2f2eac3d166c698e72d4ea637"}
Jul 15 15:25:35.537308 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:35.537219    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fd64f99d-8nnft" event={"ID":"e398d571-db5b-4ced-ad71-deb845e80ca8","Type":"ContainerStarted","Data":"95d0e07df53c0705c242fbf6d9afea9e0ebdd3e133320b7976a69db8effb372d"}
Jul 15 15:25:35.538547 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:35.538526    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bfc8b8658-q5ts9" event={"ID":"ee447ec3-745f-4b06-b0d9-be17249fee78","Type":"ContainerStarted","Data":"dcf82a5ebc23aa4c47cd2e4d7acf4ae8bf3ae255c004befd4214dcb8e439d9c5"}
Jul 15 15:25:35.555340 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:35.555300    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b474f86d6-7vz7n" podStartSLOduration=1.977861543 podStartE2EDuration="7.555287755s" totalImagesPullingTime="5.577426212s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:25:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:25:35.554348301 +0000 UTC m=+65.900251517" watchObservedRunningTime="2026-07-15 15:25:35.555287755 +0000 UTC m=+65.901190948"
Jul 15 15:25:35.570299 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:35.570261    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bfc8b8658-q5ts9" podStartSLOduration=2.018004053 podStartE2EDuration="7.570250209s" totalImagesPullingTime="5.552246156s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:25:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:25:35.569466507 +0000 UTC m=+65.915369700" watchObservedRunningTime="2026-07-15 15:25:35.570250209 +0000 UTC m=+65.916153402"
Jul 15 15:25:35.588769 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:35.588733    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fd64f99d-8nnft" podStartSLOduration=2.043594207 podStartE2EDuration="7.588721494s" totalImagesPullingTime="5.545127287s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:25:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:25:35.588335335 +0000 UTC m=+65.934238531" watchObservedRunningTime="2026-07-15 15:25:35.588721494 +0000 UTC m=+65.934624686"
Jul 15 15:25:35.930230 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:35.930161    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3988961d-1cd0-4fd2-aa28-80610f3ed94b-original-pull-secret\") pod \"global-pull-secret-syncer-rbktn\" (UID: \"3988961d-1cd0-4fd2-aa28-80610f3ed94b\") " pod="kube-system/global-pull-secret-syncer-rbktn"
Jul 15 15:25:35.930356 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:35.930226    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60d786ac-9c8b-48df-8e67-6aa7e976718d-metrics-certs\") pod \"network-metrics-daemon-w7zbl\" (UID: \"60d786ac-9c8b-48df-8e67-6aa7e976718d\") " pod="openshift-multus/network-metrics-daemon-w7zbl"
Jul 15 15:25:35.933115 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:35.933095    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 15 15:25:35.933188 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:35.933133    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 15 15:25:35.942687 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:35.942661    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3988961d-1cd0-4fd2-aa28-80610f3ed94b-original-pull-secret\") pod \"global-pull-secret-syncer-rbktn\" (UID: \"3988961d-1cd0-4fd2-aa28-80610f3ed94b\") " pod="kube-system/global-pull-secret-syncer-rbktn"
Jul 15 15:25:35.942777 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:35.942691    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60d786ac-9c8b-48df-8e67-6aa7e976718d-metrics-certs\") pod \"network-metrics-daemon-w7zbl\" (UID: \"60d786ac-9c8b-48df-8e67-6aa7e976718d\") " pod="openshift-multus/network-metrics-daemon-w7zbl"
Jul 15 15:25:35.946794 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:35.946778    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qs6fl\""
Jul 15 15:25:35.950872 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:35.950854    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rbktn"
Jul 15 15:25:35.955685 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:35.955669    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w7zbl"
Jul 15 15:25:36.030941 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:36.030860    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czw52\" (UniqueName: \"kubernetes.io/projected/bff44260-d747-4265-af29-596728c30967-kube-api-access-czw52\") pod \"network-check-target-b7s72\" (UID: \"bff44260-d747-4265-af29-596728c30967\") " pod="openshift-network-diagnostics/network-check-target-b7s72"
Jul 15 15:25:36.033881 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:36.033860    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 15 15:25:36.044346 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:36.044327    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 15 15:25:36.055132 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:36.055107    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-czw52\" (UniqueName: \"kubernetes.io/projected/bff44260-d747-4265-af29-596728c30967-kube-api-access-czw52\") pod \"network-check-target-b7s72\" (UID: \"bff44260-d747-4265-af29-596728c30967\") " pod="openshift-network-diagnostics/network-check-target-b7s72"
Jul 15 15:25:36.082225 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:36.082198    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rbktn"]
Jul 15 15:25:36.085077 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:25:36.085051    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3988961d_1cd0_4fd2_aa28_80610f3ed94b.slice/crio-57e19085c28e0ca6975b7ce233a71055422f3a541f636ccc661dc9fe736d543e WatchSource:0}: Error finding container 57e19085c28e0ca6975b7ce233a71055422f3a541f636ccc661dc9fe736d543e: Status 404 returned error can't find the container with id 57e19085c28e0ca6975b7ce233a71055422f3a541f636ccc661dc9fe736d543e
Jul 15 15:25:36.099106 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:36.099082    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-w7zbl"]
Jul 15 15:25:36.101379 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:25:36.101354    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60d786ac_9c8b_48df_8e67_6aa7e976718d.slice/crio-17eb05730ed064df12fe9c34c2992240c39c0bf37a4b69fa466c345be4fce110 WatchSource:0}: Error finding container 17eb05730ed064df12fe9c34c2992240c39c0bf37a4b69fa466c345be4fce110: Status 404 returned error can't find the container with id 17eb05730ed064df12fe9c34c2992240c39c0bf37a4b69fa466c345be4fce110
Jul 15 15:25:36.240844 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:36.240792    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-h9ndf\""
Jul 15 15:25:36.248833 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:36.248814    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b7s72"
Jul 15 15:25:36.365796 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:36.365770    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-b7s72"]
Jul 15 15:25:36.369872 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:25:36.369847    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbff44260_d747_4265_af29_596728c30967.slice/crio-5f31793754abb908099a51ce328e81cb7c819942e6156b121c48d83a12a27d85 WatchSource:0}: Error finding container 5f31793754abb908099a51ce328e81cb7c819942e6156b121c48d83a12a27d85: Status 404 returned error can't find the container with id 5f31793754abb908099a51ce328e81cb7c819942e6156b121c48d83a12a27d85
Jul 15 15:25:36.544410 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:36.544355    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-w7zbl" event={"ID":"60d786ac-9c8b-48df-8e67-6aa7e976718d","Type":"ContainerStarted","Data":"17eb05730ed064df12fe9c34c2992240c39c0bf37a4b69fa466c345be4fce110"}
Jul 15 15:25:36.545819 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:36.545792    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-b7s72" event={"ID":"bff44260-d747-4265-af29-596728c30967","Type":"ContainerStarted","Data":"5f31793754abb908099a51ce328e81cb7c819942e6156b121c48d83a12a27d85"}
Jul 15 15:25:36.547296 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:36.547218    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rbktn" event={"ID":"3988961d-1cd0-4fd2-aa28-80610f3ed94b","Type":"ContainerStarted","Data":"57e19085c28e0ca6975b7ce233a71055422f3a541f636ccc661dc9fe736d543e"}
Jul 15 15:25:37.089606 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:37.089576    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:37.156120 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:37.156094    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:37.554106 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:37.554065    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-w7zbl" event={"ID":"60d786ac-9c8b-48df-8e67-6aa7e976718d","Type":"ContainerStarted","Data":"19e8e38de33c8526ddd14c9b4ac0a23af48081e846015d11c175061e0eac2103"}
Jul 15 15:25:37.554578 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:37.554126    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-w7zbl" event={"ID":"60d786ac-9c8b-48df-8e67-6aa7e976718d","Type":"ContainerStarted","Data":"1fca4091a8b8ffd63e677165e2a47cfe48fee5341fc6fe98aaa8891429cb7dab"}
Jul 15 15:25:37.574917 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:37.574863    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-w7zbl" podStartSLOduration=66.668859726 podStartE2EDuration="1m7.574842703s" totalImagesPullingTime="905.982977ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:24:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:25:37.572720888 +0000 UTC m=+67.918624079" watchObservedRunningTime="2026-07-15 15:25:37.574842703 +0000 UTC m=+67.920745897"
Jul 15 15:25:37.679509 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:37.679479    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:37.747906 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:37.747876    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:38.649965 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:38.649927    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6aa4a480-d68b-4d9b-94c3-4e96179cea3b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5ttpp\" (UID: \"6aa4a480-d68b-4d9b-94c3-4e96179cea3b\") " pod="openshift-insights/insights-runtime-extractor-5ttpp"
Jul 15 15:25:38.653570 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:38.653544    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6aa4a480-d68b-4d9b-94c3-4e96179cea3b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5ttpp\" (UID: \"6aa4a480-d68b-4d9b-94c3-4e96179cea3b\") " pod="openshift-insights/insights-runtime-extractor-5ttpp"
Jul 15 15:25:38.845998 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:38.845967    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-92ld7\""
Jul 15 15:25:38.854312 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:38.854292    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5ttpp"
Jul 15 15:25:39.015145 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:39.015108    2564 patch_prober.go:28] interesting pod/image-registry-66bf4fd47d-gkcb2 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 15 15:25:39.015296 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:39.015181    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-66bf4fd47d-gkcb2" podUID="2c70271a-74b9-4303-8257-f7cd4ef76758" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 15:25:39.426058 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:39.425970    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:39.496896 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:39.496835    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:39.770146 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:39.770110    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:40.140534 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:40.140459    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:40.208252 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:40.208197    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:41.095792 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:41.095757    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:41.194713 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:41.194682    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:41.840355 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:41.840331    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5ttpp"]
Jul 15 15:25:41.842851 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:25:41.842829    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6aa4a480_d68b_4d9b_94c3_4e96179cea3b.slice/crio-12c1736143ccfcc332c817280f14f6db756115764d7843b175d516e46b40f479 WatchSource:0}: Error finding container 12c1736143ccfcc332c817280f14f6db756115764d7843b175d516e46b40f479: Status 404 returned error can't find the container with id 12c1736143ccfcc332c817280f14f6db756115764d7843b175d516e46b40f479
Jul 15 15:25:42.486322 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:42.486284    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:42.573748 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:42.573710    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rbktn" event={"ID":"3988961d-1cd0-4fd2-aa28-80610f3ed94b","Type":"ContainerStarted","Data":"a54e1100f8068de7df95ba757b75b183e838320e89181f08a999c23b2eebc443"}
Jul 15 15:25:42.575584 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:42.575560    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-b7s72" event={"ID":"bff44260-d747-4265-af29-596728c30967","Type":"ContainerStarted","Data":"e51013a09f307e20c2120588c30864dd37517aadc0c71d15d1db4285682ab1c0"}
Jul 15 15:25:42.575725 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:42.575628    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-b7s72"
Jul 15 15:25:42.576865 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:42.576838    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5ttpp" event={"ID":"6aa4a480-d68b-4d9b-94c3-4e96179cea3b","Type":"ContainerStarted","Data":"12c1736143ccfcc332c817280f14f6db756115764d7843b175d516e46b40f479"}
Jul 15 15:25:42.589559 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:42.589455    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-rbktn" podStartSLOduration=66.976625392 podStartE2EDuration="1m12.589436727s" totalImagesPullingTime="5.612811335s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 15:24:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:25:42.588566618 +0000 UTC m=+72.934469813" watchObservedRunningTime="2026-07-15 15:25:42.589436727 +0000 UTC m=+72.935339920"
Jul 15 15:25:42.604091 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:42.604053    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-b7s72" podStartSLOduration=67.288662379 podStartE2EDuration="1m12.604039274s" totalImagesPullingTime="5.315376895s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:24:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:25:42.603660024 +0000 UTC m=+72.949563222" watchObservedRunningTime="2026-07-15 15:25:42.604039274 +0000 UTC m=+72.949942464"
Jul 15 15:25:43.649643 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:43.649607    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:43.749854 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:43.749822    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:44.652830 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:44.652799    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:44.789191 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:44.789158    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:44.985790 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:44.985713    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:45.034659 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:45.034319    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-gljcq"]
Jul 15 15:25:45.048098 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:45.048070    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gljcq"
Jul 15 15:25:45.051122 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:45.050903    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 15 15:25:45.051122 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:45.050928    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 15 15:25:45.052393 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:45.052078    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-vstdl\""
Jul 15 15:25:45.052393 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:45.052224    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 15 15:25:45.052393 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:45.052266    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 15 15:25:45.052632 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:45.052462    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 15 15:25:45.053387 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:45.053253    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 15 15:25:45.119147 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:45.119119    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:45.199192 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:45.199161    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3b9c1313-c5b7-418b-87d3-f49279a40c79-node-exporter-wtmp\") pod \"node-exporter-gljcq\" (UID: \"3b9c1313-c5b7-418b-87d3-f49279a40c79\") " pod="openshift-monitoring/node-exporter-gljcq"
Jul 15 15:25:45.199404 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:45.199206    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3b9c1313-c5b7-418b-87d3-f49279a40c79-node-exporter-textfile\") pod \"node-exporter-gljcq\" (UID: \"3b9c1313-c5b7-418b-87d3-f49279a40c79\") " pod="openshift-monitoring/node-exporter-gljcq"
Jul 15 15:25:45.199404 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:45.199236    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b9c1313-c5b7-418b-87d3-f49279a40c79-metrics-client-ca\") pod \"node-exporter-gljcq\" (UID: \"3b9c1313-c5b7-418b-87d3-f49279a40c79\") " pod="openshift-monitoring/node-exporter-gljcq"
Jul 15 15:25:45.199404 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:45.199268    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3b9c1313-c5b7-418b-87d3-f49279a40c79-root\") pod \"node-exporter-gljcq\" (UID: \"3b9c1313-c5b7-418b-87d3-f49279a40c79\") " pod="openshift-monitoring/node-exporter-gljcq"
Jul 15 15:25:45.199404 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:45.199372    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3b9c1313-c5b7-418b-87d3-f49279a40c79-node-exporter-accelerators-collector-config\") pod \"node-exporter-gljcq\" (UID: \"3b9c1313-c5b7-418b-87d3-f49279a40c79\") " pod="openshift-monitoring/node-exporter-gljcq"
Jul 15 15:25:45.199621 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:45.199409    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjzcd\" (UniqueName: \"kubernetes.io/projected/3b9c1313-c5b7-418b-87d3-f49279a40c79-kube-api-access-pjzcd\") pod \"node-exporter-gljcq\" (UID: \"3b9c1313-c5b7-418b-87d3-f49279a40c79\") " pod="openshift-monitoring/node-exporter-gljcq"
Jul 15 15:25:45.199621 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:45.199446    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3b9c1313-c5b7-418b-87d3-f49279a40c79-node-exporter-tls\") pod \"node-exporter-gljcq\" (UID: \"3b9c1313-c5b7-418b-87d3-f49279a40c79\") " pod="openshift-monitoring/node-exporter-gljcq"
Jul 15 15:25:45.199621 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:45.199490    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3b9c1313-c5b7-418b-87d3-f49279a40c79-sys\") pod \"node-exporter-gljcq\" (UID: \"3b9c1313-c5b7-418b-87d3-f49279a40c79\") " pod="openshift-monitoring/node-exporter-gljcq"
Jul 15 15:25:45.199621 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:45.199520    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3b9c1313-c5b7-418b-87d3-f49279a40c79-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gljcq\" (UID: \"3b9c1313-c5b7-418b-87d3-f49279a40c79\") " pod="openshift-monitoring/node-exporter-gljcq"
Jul 15 15:25:45.232191 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:45.232139    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:45.300490 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:45.300458    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3b9c1313-c5b7-418b-87d3-f49279a40c79-root\") pod \"node-exporter-gljcq\" (UID: \"3b9c1313-c5b7-418b-87d3-f49279a40c79\") " pod="openshift-monitoring/node-exporter-gljcq"
Jul 15 15:25:45.300661 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:45.300529    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3b9c1313-c5b7-418b-87d3-f49279a40c79-node-exporter-accelerators-collector-config\") pod \"node-exporter-gljcq\" (UID: \"3b9c1313-c5b7-418b-87d3-f49279a40c79\") " pod="openshift-monitoring/node-exporter-gljcq"
Jul 15 15:25:45.300661 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:45.300541    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3b9c1313-c5b7-418b-87d3-f49279a40c79-root\") pod \"node-exporter-gljcq\" (UID: \"3b9c1313-c5b7-418b-87d3-f49279a40c79\") " pod="openshift-monitoring/node-exporter-gljcq"
Jul 15 15:25:45.300661 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:45.300555    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjzcd\" (UniqueName: \"kubernetes.io/projected/3b9c1313-c5b7-418b-87d3-f49279a40c79-kube-api-access-pjzcd\") pod \"node-exporter-gljcq\" (UID: \"3b9c1313-c5b7-418b-87d3-f49279a40c79\") " pod="openshift-monitoring/node-exporter-gljcq"
Jul 15 15:25:45.300661 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:45.300631    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3b9c1313-c5b7-418b-87d3-f49279a40c79-node-exporter-tls\") pod \"node-exporter-gljcq\" (UID: \"3b9c1313-c5b7-418b-87d3-f49279a40c79\") " pod="openshift-monitoring/node-exporter-gljcq"
Jul 15 15:25:45.300878 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:45.300679    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3b9c1313-c5b7-418b-87d3-f49279a40c79-sys\") pod \"node-exporter-gljcq\" (UID: \"3b9c1313-c5b7-418b-87d3-f49279a40c79\") " pod="openshift-monitoring/node-exporter-gljcq"
Jul 15 15:25:45.300878 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:45.300708    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3b9c1313-c5b7-418b-87d3-f49279a40c79-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gljcq\" (UID: \"3b9c1313-c5b7-418b-87d3-f49279a40c79\") " pod="openshift-monitoring/node-exporter-gljcq"
Jul 15 15:25:45.300878 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:45.300818    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3b9c1313-c5b7-418b-87d3-f49279a40c79-node-exporter-wtmp\") pod \"node-exporter-gljcq\" (UID: \"3b9c1313-c5b7-418b-87d3-f49279a40c79\") " pod="openshift-monitoring/node-exporter-gljcq"
Jul 15 15:25:45.300878 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:45.300858    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3b9c1313-c5b7-418b-87d3-f49279a40c79-node-exporter-textfile\") pod \"node-exporter-gljcq\" (UID: \"3b9c1313-c5b7-418b-87d3-f49279a40c79\") " pod="openshift-monitoring/node-exporter-gljcq"
Jul 15 15:25:45.301107 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:45.300888    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b9c1313-c5b7-418b-87d3-f49279a40c79-metrics-client-ca\") pod \"node-exporter-gljcq\" (UID: \"3b9c1313-c5b7-418b-87d3-f49279a40c79\") " pod="openshift-monitoring/node-exporter-gljcq"
Jul 15 15:25:45.301107 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:45.300900    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3b9c1313-c5b7-418b-87d3-f49279a40c79-sys\") pod \"node-exporter-gljcq\" (UID: \"3b9c1313-c5b7-418b-87d3-f49279a40c79\") " pod="openshift-monitoring/node-exporter-gljcq"
Jul 15 15:25:45.301208 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:45.301152    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3b9c1313-c5b7-418b-87d3-f49279a40c79-node-exporter-accelerators-collector-config\") pod \"node-exporter-gljcq\" (UID: \"3b9c1313-c5b7-418b-87d3-f49279a40c79\") " pod="openshift-monitoring/node-exporter-gljcq"
Jul 15 15:25:45.301264 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:45.301211    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3b9c1313-c5b7-418b-87d3-f49279a40c79-node-exporter-textfile\") pod \"node-exporter-gljcq\" (UID: \"3b9c1313-c5b7-418b-87d3-f49279a40c79\") " pod="openshift-monitoring/node-exporter-gljcq"
Jul 15 15:25:45.301264 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:25:45.301242    2564 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 15 15:25:45.301383 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:25:45.301369    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b9c1313-c5b7-418b-87d3-f49279a40c79-node-exporter-tls podName:3b9c1313-c5b7-418b-87d3-f49279a40c79 nodeName:}" failed. No retries permitted until 2026-07-15 15:25:45.801349098 +0000 UTC m=+76.147252279 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/3b9c1313-c5b7-418b-87d3-f49279a40c79-node-exporter-tls") pod "node-exporter-gljcq" (UID: "3b9c1313-c5b7-418b-87d3-f49279a40c79") : secret "node-exporter-tls" not found
Jul 15 15:25:45.301442 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:45.301406    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3b9c1313-c5b7-418b-87d3-f49279a40c79-node-exporter-wtmp\") pod \"node-exporter-gljcq\" (UID: \"3b9c1313-c5b7-418b-87d3-f49279a40c79\") " pod="openshift-monitoring/node-exporter-gljcq"
Jul 15 15:25:45.301689 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:45.301664    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b9c1313-c5b7-418b-87d3-f49279a40c79-metrics-client-ca\") pod \"node-exporter-gljcq\" (UID: \"3b9c1313-c5b7-418b-87d3-f49279a40c79\") " pod="openshift-monitoring/node-exporter-gljcq"
Jul 15 15:25:45.303783 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:45.303760    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3b9c1313-c5b7-418b-87d3-f49279a40c79-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gljcq\" (UID: \"3b9c1313-c5b7-418b-87d3-f49279a40c79\") " pod="openshift-monitoring/node-exporter-gljcq"
Jul 15 15:25:45.336247 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:45.336221    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjzcd\" (UniqueName: \"kubernetes.io/projected/3b9c1313-c5b7-418b-87d3-f49279a40c79-kube-api-access-pjzcd\") pod \"node-exporter-gljcq\" (UID: \"3b9c1313-c5b7-418b-87d3-f49279a40c79\") " pod="openshift-monitoring/node-exporter-gljcq"
Jul 15 15:25:45.442636 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:45.442600    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:45.555608 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:45.555509    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:45.706968 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:45.706934    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:45.806236 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:45.806151    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3b9c1313-c5b7-418b-87d3-f49279a40c79-node-exporter-tls\") pod \"node-exporter-gljcq\" (UID: \"3b9c1313-c5b7-418b-87d3-f49279a40c79\") " pod="openshift-monitoring/node-exporter-gljcq"
Jul 15 15:25:45.808441 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:45.808407    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3b9c1313-c5b7-418b-87d3-f49279a40c79-node-exporter-tls\") pod \"node-exporter-gljcq\" (UID: \"3b9c1313-c5b7-418b-87d3-f49279a40c79\") " pod="openshift-monitoring/node-exporter-gljcq"
Jul 15 15:25:45.821709 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:45.821678    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:45.962342 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:45.962311    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gljcq"
Jul 15 15:25:45.975851 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:45.975824    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:46.076769 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:46.076697    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:46.385603 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:46.385529    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:46.473200 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:46.473168    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:46.650497 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:25:46.650469    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b9c1313_c5b7_418b_87d3_f49279a40c79.slice/crio-351b88c456c59c94bfc2a5f7185ca226589b6ce708052c79df70ee94710f126d WatchSource:0}: Error finding container 351b88c456c59c94bfc2a5f7185ca226589b6ce708052c79df70ee94710f126d: Status 404 returned error can't find the container with id 351b88c456c59c94bfc2a5f7185ca226589b6ce708052c79df70ee94710f126d
Jul 15 15:25:47.332748 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:47.332714    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:47.433357 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:47.433325    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:47.598134 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:47.598054    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5ttpp" event={"ID":"6aa4a480-d68b-4d9b-94c3-4e96179cea3b","Type":"ContainerStarted","Data":"af03209da711b9a9c0f236cb6de63615e0b039db64b40a30a7890a5f83de85d2"}
Jul 15 15:25:47.599408 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:47.599385    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gljcq" event={"ID":"3b9c1313-c5b7-418b-87d3-f49279a40c79","Type":"ContainerStarted","Data":"351b88c456c59c94bfc2a5f7185ca226589b6ce708052c79df70ee94710f126d"}
Jul 15 15:25:47.952067 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:47.951976    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:49.013432 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:49.013399    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-66bf4fd47d-gkcb2"
Jul 15 15:25:49.854911 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:49.854873    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:49.978215 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:49.978187    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:50.073895 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:50.073852    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:50.203539 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:50.203470    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:50.276913 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:50.276879    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:50.612782 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:50.612756    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5ttpp" event={"ID":"6aa4a480-d68b-4d9b-94c3-4e96179cea3b","Type":"ContainerStarted","Data":"ef480db9705f795f4ec16fb5ceb7fdf24efa10c3ff0f3f536e4ca8d886898f8a"}
Jul 15 15:25:50.614182 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:50.614161    2564 generic.go:356] "Generic (PLEG): container finished" podID="3b9c1313-c5b7-418b-87d3-f49279a40c79" containerID="f9d236c6811a5093e1dc67c84ed32feac1927d50060dc62f2978e3e38f668ad1" exitCode=0
Jul 15 15:25:50.614270 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:50.614212    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gljcq" event={"ID":"3b9c1313-c5b7-418b-87d3-f49279a40c79","Type":"ContainerDied","Data":"f9d236c6811a5093e1dc67c84ed32feac1927d50060dc62f2978e3e38f668ad1"}
Jul 15 15:25:51.336236 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:51.336205    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:51.621126 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:51.621041    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gljcq" event={"ID":"3b9c1313-c5b7-418b-87d3-f49279a40c79","Type":"ContainerStarted","Data":"62afc33625aa2587071e96e72bbdaa73ca6d77fa992a22901aa278744c9ec47d"}
Jul 15 15:25:51.621126 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:51.621103    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gljcq" event={"ID":"3b9c1313-c5b7-418b-87d3-f49279a40c79","Type":"ContainerStarted","Data":"219bb4c54b0d59c3dc9b48e0ca839705cfbc959b2c9de5b2587105834188de26"}
Jul 15 15:25:51.644361 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:51.644298    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-gljcq" podStartSLOduration=2.831391871 podStartE2EDuration="6.644280776s" totalImagesPullingTime="3.747300147s" totalInitContainerRuntime="65.588758ms" isStatefulPod=true podCreationTimestamp="2026-07-15 15:25:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:25:51.642774732 +0000 UTC m=+81.988677926" watchObservedRunningTime="2026-07-15 15:25:51.644280776 +0000 UTC m=+81.990183970"
Jul 15 15:25:52.195238 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:52.195118    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:52.294867 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:52.294831    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:52.648415 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:52.648361    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:52.749499 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:52.749463    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:52.848844 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:52.848809    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:54.028518 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:54.028476    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-66bf4fd47d-gkcb2" podUID="2c70271a-74b9-4303-8257-f7cd4ef76758" containerName="registry" containerID="cri-o://594fe86d3d5d70df524a8843714df411b1b9a73f79b14c59e8e680429966f0af" gracePeriod=30
Jul 15 15:25:54.267629 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:54.267599    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66bf4fd47d-gkcb2"
Jul 15 15:25:54.370034 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:54.369985    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2c70271a-74b9-4303-8257-f7cd4ef76758-bound-sa-token\") pod \"2c70271a-74b9-4303-8257-f7cd4ef76758\" (UID: \"2c70271a-74b9-4303-8257-f7cd4ef76758\") "
Jul 15 15:25:54.370138 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:54.370055    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n7rcm\" (UniqueName: \"kubernetes.io/projected/2c70271a-74b9-4303-8257-f7cd4ef76758-kube-api-access-n7rcm\") pod \"2c70271a-74b9-4303-8257-f7cd4ef76758\" (UID: \"2c70271a-74b9-4303-8257-f7cd4ef76758\") "
Jul 15 15:25:54.370138 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:54.370098    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2c70271a-74b9-4303-8257-f7cd4ef76758-installation-pull-secrets\") pod \"2c70271a-74b9-4303-8257-f7cd4ef76758\" (UID: \"2c70271a-74b9-4303-8257-f7cd4ef76758\") "
Jul 15 15:25:54.370138 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:54.370120    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2c70271a-74b9-4303-8257-f7cd4ef76758-registry-certificates\") pod \"2c70271a-74b9-4303-8257-f7cd4ef76758\" (UID: \"2c70271a-74b9-4303-8257-f7cd4ef76758\") "
Jul 15 15:25:54.370138 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:54.370137    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2c70271a-74b9-4303-8257-f7cd4ef76758-trusted-ca\") pod \"2c70271a-74b9-4303-8257-f7cd4ef76758\" (UID: \"2c70271a-74b9-4303-8257-f7cd4ef76758\") "
Jul 15 15:25:54.370311 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:54.370179    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c70271a-74b9-4303-8257-f7cd4ef76758-registry-tls\") pod \"2c70271a-74b9-4303-8257-f7cd4ef76758\" (UID: \"2c70271a-74b9-4303-8257-f7cd4ef76758\") "
Jul 15 15:25:54.370311 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:54.370206    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2c70271a-74b9-4303-8257-f7cd4ef76758-image-registry-private-configuration\") pod \"2c70271a-74b9-4303-8257-f7cd4ef76758\" (UID: \"2c70271a-74b9-4303-8257-f7cd4ef76758\") "
Jul 15 15:25:54.370311 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:54.370225    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2c70271a-74b9-4303-8257-f7cd4ef76758-ca-trust-extracted\") pod \"2c70271a-74b9-4303-8257-f7cd4ef76758\" (UID: \"2c70271a-74b9-4303-8257-f7cd4ef76758\") "
Jul 15 15:25:54.370585 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:54.370554    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c70271a-74b9-4303-8257-f7cd4ef76758-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "2c70271a-74b9-4303-8257-f7cd4ef76758" (UID: "2c70271a-74b9-4303-8257-f7cd4ef76758"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 15:25:54.370911 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:54.370884    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c70271a-74b9-4303-8257-f7cd4ef76758-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "2c70271a-74b9-4303-8257-f7cd4ef76758" (UID: "2c70271a-74b9-4303-8257-f7cd4ef76758"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 15:25:54.372649 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:54.372527    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c70271a-74b9-4303-8257-f7cd4ef76758-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "2c70271a-74b9-4303-8257-f7cd4ef76758" (UID: "2c70271a-74b9-4303-8257-f7cd4ef76758"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:25:54.372649 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:54.372631    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c70271a-74b9-4303-8257-f7cd4ef76758-kube-api-access-n7rcm" (OuterVolumeSpecName: "kube-api-access-n7rcm") pod "2c70271a-74b9-4303-8257-f7cd4ef76758" (UID: "2c70271a-74b9-4303-8257-f7cd4ef76758"). InnerVolumeSpecName "kube-api-access-n7rcm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:25:54.372801 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:54.372673    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c70271a-74b9-4303-8257-f7cd4ef76758-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "2c70271a-74b9-4303-8257-f7cd4ef76758" (UID: "2c70271a-74b9-4303-8257-f7cd4ef76758"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 15:25:54.372801 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:54.372693    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c70271a-74b9-4303-8257-f7cd4ef76758-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "2c70271a-74b9-4303-8257-f7cd4ef76758" (UID: "2c70271a-74b9-4303-8257-f7cd4ef76758"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:25:54.372923 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:54.372905    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c70271a-74b9-4303-8257-f7cd4ef76758-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "2c70271a-74b9-4303-8257-f7cd4ef76758" (UID: "2c70271a-74b9-4303-8257-f7cd4ef76758"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 15:25:54.378347 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:54.378325    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c70271a-74b9-4303-8257-f7cd4ef76758-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "2c70271a-74b9-4303-8257-f7cd4ef76758" (UID: "2c70271a-74b9-4303-8257-f7cd4ef76758"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:25:54.471677 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:54.471632    2564 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2c70271a-74b9-4303-8257-f7cd4ef76758-image-registry-private-configuration\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 15:25:54.471677 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:54.471650    2564 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2c70271a-74b9-4303-8257-f7cd4ef76758-ca-trust-extracted\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 15:25:54.471677 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:54.471661    2564 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2c70271a-74b9-4303-8257-f7cd4ef76758-bound-sa-token\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 15:25:54.471677 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:54.471669    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n7rcm\" (UniqueName: \"kubernetes.io/projected/2c70271a-74b9-4303-8257-f7cd4ef76758-kube-api-access-n7rcm\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 15:25:54.471677 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:54.471679    2564 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2c70271a-74b9-4303-8257-f7cd4ef76758-installation-pull-secrets\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 15:25:54.471880 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:54.471688    2564 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2c70271a-74b9-4303-8257-f7cd4ef76758-registry-certificates\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 15:25:54.471880 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:54.471697    2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2c70271a-74b9-4303-8257-f7cd4ef76758-trusted-ca\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 15:25:54.471880 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:54.471705    2564 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c70271a-74b9-4303-8257-f7cd4ef76758-registry-tls\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 15:25:54.632576 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:54.632549    2564 generic.go:356] "Generic (PLEG): container finished" podID="2c70271a-74b9-4303-8257-f7cd4ef76758" containerID="594fe86d3d5d70df524a8843714df411b1b9a73f79b14c59e8e680429966f0af" exitCode=0
Jul 15 15:25:54.632660 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:54.632595    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66bf4fd47d-gkcb2"
Jul 15 15:25:54.632660 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:54.632637    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-66bf4fd47d-gkcb2" event={"ID":"2c70271a-74b9-4303-8257-f7cd4ef76758","Type":"ContainerDied","Data":"594fe86d3d5d70df524a8843714df411b1b9a73f79b14c59e8e680429966f0af"}
Jul 15 15:25:54.632743 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:54.632689    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-66bf4fd47d-gkcb2" event={"ID":"2c70271a-74b9-4303-8257-f7cd4ef76758","Type":"ContainerDied","Data":"b9f4f0d716b3ade272295a40526eaab5a7ec2b8f8445cd18ba46850a81d6f3f4"}
Jul 15 15:25:54.632785 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:54.632716    2564 scope.go:117] "RemoveContainer" containerID="594fe86d3d5d70df524a8843714df411b1b9a73f79b14c59e8e680429966f0af"
Jul 15 15:25:54.635056 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:54.635030    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5ttpp" event={"ID":"6aa4a480-d68b-4d9b-94c3-4e96179cea3b","Type":"ContainerStarted","Data":"76fbe4ea3566d3955704338226ff7088c47594d1ea34cdfe666bc22cfbfe6ffb"}
Jul 15 15:25:54.641739 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:54.641573    2564 scope.go:117] "RemoveContainer" containerID="594fe86d3d5d70df524a8843714df411b1b9a73f79b14c59e8e680429966f0af"
Jul 15 15:25:54.641928 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:25:54.641893    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"594fe86d3d5d70df524a8843714df411b1b9a73f79b14c59e8e680429966f0af\": container with ID starting with 594fe86d3d5d70df524a8843714df411b1b9a73f79b14c59e8e680429966f0af not found: ID does not exist" containerID="594fe86d3d5d70df524a8843714df411b1b9a73f79b14c59e8e680429966f0af"
Jul 15 15:25:54.642000 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:54.641932    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"594fe86d3d5d70df524a8843714df411b1b9a73f79b14c59e8e680429966f0af"} err="failed to get container status \"594fe86d3d5d70df524a8843714df411b1b9a73f79b14c59e8e680429966f0af\": rpc error: code = NotFound desc = could not find container \"594fe86d3d5d70df524a8843714df411b1b9a73f79b14c59e8e680429966f0af\": container with ID starting with 594fe86d3d5d70df524a8843714df411b1b9a73f79b14c59e8e680429966f0af not found: ID does not exist"
Jul 15 15:25:54.656878 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:54.656837    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-5ttpp" podStartSLOduration=36.789849245 podStartE2EDuration="48.656825363s" totalImagesPullingTime="11.866976118s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 15:25:06 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:25:54.656137596 +0000 UTC m=+85.002040801" watchObservedRunningTime="2026-07-15 15:25:54.656825363 +0000 UTC m=+85.002728583"
Jul 15 15:25:54.672356 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:54.672329    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-66bf4fd47d-gkcb2"]
Jul 15 15:25:54.676138 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:54.676118    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-66bf4fd47d-gkcb2"]
Jul 15 15:25:56.186154 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:56.186120    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:56.228366 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:56.228337    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c70271a-74b9-4303-8257-f7cd4ef76758" path="/var/lib/kubelet/pods/2c70271a-74b9-4303-8257-f7cd4ef76758/volumes"
Jul 15 15:25:57.642065 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:57.642035    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:25:57.714789 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:25:57.714763    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:26:02.394489 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:26:02.394458    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:26:02.496763 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:26:02.496731    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:26:02.560149 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:26:02.560118    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:26:03.156175 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:26:03.156146    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:26:03.227603 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:26:03.227575    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:26:12.639807 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:26:12.639767    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:26:12.704049 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:26:12.704004    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:26:13.582681 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:26:13.582648    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-b7s72"
Jul 15 15:26:16.454141 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:26:16.454108    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:26:16.557161 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:26:16.557134    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:26:16.654361 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:26:16.654336    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:26:32.720285 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:26:32.720251    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:26:32.805255 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:26:32.805221    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:27:04.547994 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:27:04.547957    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:27:04.974561 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:27:04.974478    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:27:15.427057 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:27:15.427005    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:27:15.509802 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:27:15.509768    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:27:26.849593 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:27:26.849507    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:27:26.956834 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:27:26.956805    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:28:07.649491 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:28:07.649453    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:28:07.753280 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:28:07.753249    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:28:20.036295 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:28:20.036264    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:28:20.124901 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:28:20.124874    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:28:21.811287 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:28:21.811260    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:28:23.209875 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:28:23.209843    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:28:23.365293 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:28:23.365263    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:28:32.106390 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:28:32.106357    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:28:32.255026 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:28:32.254982    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:28:34.188064 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:28:34.188032    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:28:34.840762 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:28:34.840733    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:28:43.209228 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:28:43.209193    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:28:43.307543 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:28:43.307515    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:29:30.006346 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:29:30.006319    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfw7r_55d0e798-7e5a-4f3e-afc2-67dfb308d934/ovn-acl-logging/0.log"
Jul 15 15:29:30.008971 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:29:30.008953    2564 kubelet.go:1648] "Image garbage collection succeeded"
Jul 15 15:29:30.012121 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:29:30.012099    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfw7r_55d0e798-7e5a-4f3e-afc2-67dfb308d934/ovn-acl-logging/0.log"
Jul 15 15:29:33.468101 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:29:33.468059    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:29:35.713498 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:29:35.713463    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:29:55.976459 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:29:55.976420    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:29:56.263713 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:29:56.263629    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:29:58.866475 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:29:58.866440    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:29:58.931085 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:29:58.931044    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:30:00.727730 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:30:00.727680    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:30:00.873934 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:30:00.873898    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:30:01.120738 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:30:01.120706    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:30:01.294965 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:30:01.294930    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:30:03.343749 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:30:03.343719    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:30:03.674944 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:30:03.674865    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:30:06.393175 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:30:06.393146    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:30:06.496897 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:30:06.496867    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:30:09.297395 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:30:09.297360    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:30:09.396227 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:30:09.396195    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:30:11.668233 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:30:11.668197    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:30:14.158618 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:30:14.158585    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:30:14.284978 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:30:14.284943    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:30:20.214723 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:30:20.214666    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:30:20.316686 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:30:20.316655    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:30:22.315642 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:30:22.315555    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:30:37.933664 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:30:37.933619    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:30:38.026141 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:30:38.026107    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:30:38.627059 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:30:38.627028    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:30:38.950561 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:30:38.950480    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:30:39.058312 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:30:39.058276    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:30:39.073313 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:30:39.073284    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-997df6bcb-m729w"]
Jul 15 15:30:39.073551 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:30:39.073540    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c70271a-74b9-4303-8257-f7cd4ef76758" containerName="registry"
Jul 15 15:30:39.073591 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:30:39.073553    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c70271a-74b9-4303-8257-f7cd4ef76758" containerName="registry"
Jul 15 15:30:39.073632 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:30:39.073622    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c70271a-74b9-4303-8257-f7cd4ef76758" containerName="registry"
Jul 15 15:30:39.075870 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:30:39.075855    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-997df6bcb-m729w"
Jul 15 15:30:39.078868 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:30:39.078844    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 15 15:30:39.079248 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:30:39.079237    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 15 15:30:39.079424 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:30:39.079409    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 15 15:30:39.079544 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:30:39.079528    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 15 15:30:39.079636 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:30:39.079621    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-r5ptn\""
Jul 15 15:30:39.098463 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:30:39.098431    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-997df6bcb-m729w"]
Jul 15 15:30:39.235596 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:30:39.235516    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:30:39.241860 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:30:39.241840    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fb86e760-6359-4782-951e-efdd754f92eb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-997df6bcb-m729w\" (UID: \"fb86e760-6359-4782-951e-efdd754f92eb\") " pod="opendatahub/opendatahub-operator-controller-manager-997df6bcb-m729w"
Jul 15 15:30:39.241934 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:30:39.241870    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fb86e760-6359-4782-951e-efdd754f92eb-webhook-cert\") pod \"opendatahub-operator-controller-manager-997df6bcb-m729w\" (UID: \"fb86e760-6359-4782-951e-efdd754f92eb\") " pod="opendatahub/opendatahub-operator-controller-manager-997df6bcb-m729w"
Jul 15 15:30:39.241975 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:30:39.241936    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvqsh\" (UniqueName: \"kubernetes.io/projected/fb86e760-6359-4782-951e-efdd754f92eb-kube-api-access-zvqsh\") pod \"opendatahub-operator-controller-manager-997df6bcb-m729w\" (UID: \"fb86e760-6359-4782-951e-efdd754f92eb\") " pod="opendatahub/opendatahub-operator-controller-manager-997df6bcb-m729w"
Jul 15 15:30:39.241975 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:30:39.241968    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fb86e760-6359-4782-951e-efdd754f92eb-tmp\") pod \"opendatahub-operator-controller-manager-997df6bcb-m729w\" (UID: \"fb86e760-6359-4782-951e-efdd754f92eb\") " pod="opendatahub/opendatahub-operator-controller-manager-997df6bcb-m729w"
Jul 15 15:30:39.242061 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:30:39.242034    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fb86e760-6359-4782-951e-efdd754f92eb-manifests\") pod \"opendatahub-operator-controller-manager-997df6bcb-m729w\" (UID: \"fb86e760-6359-4782-951e-efdd754f92eb\") " pod="opendatahub/opendatahub-operator-controller-manager-997df6bcb-m729w"
Jul 15 15:30:39.343155 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:30:39.343121    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fb86e760-6359-4782-951e-efdd754f92eb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-997df6bcb-m729w\" (UID: \"fb86e760-6359-4782-951e-efdd754f92eb\") " pod="opendatahub/opendatahub-operator-controller-manager-997df6bcb-m729w"
Jul 15 15:30:39.343155 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:30:39.343157    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fb86e760-6359-4782-951e-efdd754f92eb-webhook-cert\") pod \"opendatahub-operator-controller-manager-997df6bcb-m729w\" (UID: \"fb86e760-6359-4782-951e-efdd754f92eb\") " pod="opendatahub/opendatahub-operator-controller-manager-997df6bcb-m729w"
Jul 15 15:30:39.343413 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:30:39.343186    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvqsh\" (UniqueName: \"kubernetes.io/projected/fb86e760-6359-4782-951e-efdd754f92eb-kube-api-access-zvqsh\") pod \"opendatahub-operator-controller-manager-997df6bcb-m729w\" (UID: \"fb86e760-6359-4782-951e-efdd754f92eb\") " pod="opendatahub/opendatahub-operator-controller-manager-997df6bcb-m729w"
Jul 15 15:30:39.343413 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:30:39.343204    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fb86e760-6359-4782-951e-efdd754f92eb-tmp\") pod \"opendatahub-operator-controller-manager-997df6bcb-m729w\" (UID: \"fb86e760-6359-4782-951e-efdd754f92eb\") " pod="opendatahub/opendatahub-operator-controller-manager-997df6bcb-m729w"
Jul 15 15:30:39.343413 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:30:39.343245    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fb86e760-6359-4782-951e-efdd754f92eb-manifests\") pod \"opendatahub-operator-controller-manager-997df6bcb-m729w\" (UID: \"fb86e760-6359-4782-951e-efdd754f92eb\") " pod="opendatahub/opendatahub-operator-controller-manager-997df6bcb-m729w"
Jul 15 15:30:39.343698 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:30:39.343669    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fb86e760-6359-4782-951e-efdd754f92eb-manifests\") pod \"opendatahub-operator-controller-manager-997df6bcb-m729w\" (UID: \"fb86e760-6359-4782-951e-efdd754f92eb\") " pod="opendatahub/opendatahub-operator-controller-manager-997df6bcb-m729w"
Jul 15 15:30:39.345421 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:30:39.345400    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fb86e760-6359-4782-951e-efdd754f92eb-tmp\") pod \"opendatahub-operator-controller-manager-997df6bcb-m729w\" (UID: \"fb86e760-6359-4782-951e-efdd754f92eb\") " pod="opendatahub/opendatahub-operator-controller-manager-997df6bcb-m729w"
Jul 15 15:30:39.345712 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:30:39.345691    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fb86e760-6359-4782-951e-efdd754f92eb-webhook-cert\") pod \"opendatahub-operator-controller-manager-997df6bcb-m729w\" (UID: \"fb86e760-6359-4782-951e-efdd754f92eb\") " pod="opendatahub/opendatahub-operator-controller-manager-997df6bcb-m729w"
Jul 15 15:30:39.345753 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:30:39.345710    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fb86e760-6359-4782-951e-efdd754f92eb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-997df6bcb-m729w\" (UID: \"fb86e760-6359-4782-951e-efdd754f92eb\") " pod="opendatahub/opendatahub-operator-controller-manager-997df6bcb-m729w"
Jul 15 15:30:39.347987 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:30:39.347967    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:30:39.367540 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:30:39.367516    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvqsh\" (UniqueName: \"kubernetes.io/projected/fb86e760-6359-4782-951e-efdd754f92eb-kube-api-access-zvqsh\") pod \"opendatahub-operator-controller-manager-997df6bcb-m729w\" (UID: \"fb86e760-6359-4782-951e-efdd754f92eb\") " pod="opendatahub/opendatahub-operator-controller-manager-997df6bcb-m729w"
Jul 15 15:30:39.385410 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:30:39.385387    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-997df6bcb-m729w"
Jul 15 15:30:39.518736 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:30:39.518702    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-997df6bcb-m729w"]
Jul 15 15:30:39.521747 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:30:39.521716    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb86e760_6359_4782_951e_efdd754f92eb.slice/crio-ca1e596ca23fc0c71d77824cb3a70b040feb7d112cfae852741945518686e7a0 WatchSource:0}: Error finding container ca1e596ca23fc0c71d77824cb3a70b040feb7d112cfae852741945518686e7a0: Status 404 returned error can't find the container with id ca1e596ca23fc0c71d77824cb3a70b040feb7d112cfae852741945518686e7a0
Jul 15 15:30:39.523493 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:30:39.523478    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 15:30:39.549480 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:30:39.549444    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-997df6bcb-m729w" event={"ID":"fb86e760-6359-4782-951e-efdd754f92eb","Type":"ContainerStarted","Data":"ca1e596ca23fc0c71d77824cb3a70b040feb7d112cfae852741945518686e7a0"}
Jul 15 15:30:39.922190 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:30:39.922095    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:30:40.020959 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:30:40.020921    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:30:43.566926 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:30:43.566886    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-997df6bcb-m729w" event={"ID":"fb86e760-6359-4782-951e-efdd754f92eb","Type":"ContainerStarted","Data":"0d819e07fb6d4a6b30e63418db4638c4d742b3d75e948c74c240c879cf598729"}
Jul 15 15:30:43.780139 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:30:43.780114    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:30:43.885966 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:30:43.885903    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:30:44.571881 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:30:44.571851    2564 generic.go:356] "Generic (PLEG): container finished" podID="fb86e760-6359-4782-951e-efdd754f92eb" containerID="0d819e07fb6d4a6b30e63418db4638c4d742b3d75e948c74c240c879cf598729" exitCode=0
Jul 15 15:30:44.572278 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:30:44.571945    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-997df6bcb-m729w" event={"ID":"fb86e760-6359-4782-951e-efdd754f92eb","Type":"ContainerDied","Data":"0d819e07fb6d4a6b30e63418db4638c4d742b3d75e948c74c240c879cf598729"}
Jul 15 15:30:45.577132 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:30:45.577097    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-997df6bcb-m729w" event={"ID":"fb86e760-6359-4782-951e-efdd754f92eb","Type":"ContainerStarted","Data":"c50a0038eb2c663f7d8930769ac2e295a791e3ff7a9b74c36e34da0eb08f4214"}
Jul 15 15:30:45.577522 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:30:45.577216    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-997df6bcb-m729w"
Jul 15 15:30:45.601728 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:30:45.601688    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-997df6bcb-m729w" podStartSLOduration=2.128502212 podStartE2EDuration="6.601673412s" totalImagesPullingTime="3.412962668s" totalInitContainerRuntime="1.060208532s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:30:39 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:30:45.600183473 +0000 UTC m=+375.946086679" watchObservedRunningTime="2026-07-15 15:30:45.601673412 +0000 UTC m=+375.947576606"
Jul 15 15:30:56.582110 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:30:56.582083    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-997df6bcb-m729w"
Jul 15 15:30:59.279602 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:30:59.279570    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:30:59.531384 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:30:59.531313    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:31:00.133149 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:00.133114    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:31:00.236118 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:00.236091    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-c788dcdb-5mzwg"]
Jul 15 15:31:00.244088 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:00.244069    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-c788dcdb-5mzwg"
Jul 15 15:31:00.247437 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:00.247410    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 15 15:31:00.248596 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:00.248573    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-8k27p\""
Jul 15 15:31:00.248703 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:00.248595    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 15 15:31:00.248703 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:00.248640    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 15 15:31:00.248703 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:00.248588    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 15 15:31:00.267123 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:00.267102    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-c788dcdb-5mzwg"]
Jul 15 15:31:00.282288 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:00.282263    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/be9de479-25d3-477b-ae77-1efaa1107bb4-tmp\") pod \"kube-auth-proxy-c788dcdb-5mzwg\" (UID: \"be9de479-25d3-477b-ae77-1efaa1107bb4\") " pod="openshift-ingress/kube-auth-proxy-c788dcdb-5mzwg"
Jul 15 15:31:00.282578 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:00.282316    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/be9de479-25d3-477b-ae77-1efaa1107bb4-tls-certs\") pod \"kube-auth-proxy-c788dcdb-5mzwg\" (UID: \"be9de479-25d3-477b-ae77-1efaa1107bb4\") " pod="openshift-ingress/kube-auth-proxy-c788dcdb-5mzwg"
Jul 15 15:31:00.282578 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:00.282347    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbxrx\" (UniqueName: \"kubernetes.io/projected/be9de479-25d3-477b-ae77-1efaa1107bb4-kube-api-access-cbxrx\") pod \"kube-auth-proxy-c788dcdb-5mzwg\" (UID: \"be9de479-25d3-477b-ae77-1efaa1107bb4\") " pod="openshift-ingress/kube-auth-proxy-c788dcdb-5mzwg"
Jul 15 15:31:00.294323 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:00.294293    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:31:00.383599 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:00.383542    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/be9de479-25d3-477b-ae77-1efaa1107bb4-tmp\") pod \"kube-auth-proxy-c788dcdb-5mzwg\" (UID: \"be9de479-25d3-477b-ae77-1efaa1107bb4\") " pod="openshift-ingress/kube-auth-proxy-c788dcdb-5mzwg"
Jul 15 15:31:00.383599 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:00.383592    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/be9de479-25d3-477b-ae77-1efaa1107bb4-tls-certs\") pod \"kube-auth-proxy-c788dcdb-5mzwg\" (UID: \"be9de479-25d3-477b-ae77-1efaa1107bb4\") " pod="openshift-ingress/kube-auth-proxy-c788dcdb-5mzwg"
Jul 15 15:31:00.383746 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:00.383621    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbxrx\" (UniqueName: \"kubernetes.io/projected/be9de479-25d3-477b-ae77-1efaa1107bb4-kube-api-access-cbxrx\") pod \"kube-auth-proxy-c788dcdb-5mzwg\" (UID: \"be9de479-25d3-477b-ae77-1efaa1107bb4\") " pod="openshift-ingress/kube-auth-proxy-c788dcdb-5mzwg"
Jul 15 15:31:00.385838 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:00.385814    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/be9de479-25d3-477b-ae77-1efaa1107bb4-tmp\") pod \"kube-auth-proxy-c788dcdb-5mzwg\" (UID: \"be9de479-25d3-477b-ae77-1efaa1107bb4\") " pod="openshift-ingress/kube-auth-proxy-c788dcdb-5mzwg"
Jul 15 15:31:00.386068 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:00.386051    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/be9de479-25d3-477b-ae77-1efaa1107bb4-tls-certs\") pod \"kube-auth-proxy-c788dcdb-5mzwg\" (UID: \"be9de479-25d3-477b-ae77-1efaa1107bb4\") " pod="openshift-ingress/kube-auth-proxy-c788dcdb-5mzwg"
Jul 15 15:31:00.401363 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:00.401341    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbxrx\" (UniqueName: \"kubernetes.io/projected/be9de479-25d3-477b-ae77-1efaa1107bb4-kube-api-access-cbxrx\") pod \"kube-auth-proxy-c788dcdb-5mzwg\" (UID: \"be9de479-25d3-477b-ae77-1efaa1107bb4\") " pod="openshift-ingress/kube-auth-proxy-c788dcdb-5mzwg"
Jul 15 15:31:00.431941 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:00.431908    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:31:00.530495 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:00.530469    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:31:00.552919 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:00.552895    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-c788dcdb-5mzwg"
Jul 15 15:31:00.688638 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:00.688605    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-c788dcdb-5mzwg"]
Jul 15 15:31:00.691600 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:31:00.691573    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe9de479_25d3_477b_ae77_1efaa1107bb4.slice/crio-22299ebb74d5b321e041aa80beed10984a67ec784b867b004a7c135ed8ae70d9 WatchSource:0}: Error finding container 22299ebb74d5b321e041aa80beed10984a67ec784b867b004a7c135ed8ae70d9: Status 404 returned error can't find the container with id 22299ebb74d5b321e041aa80beed10984a67ec784b867b004a7c135ed8ae70d9
Jul 15 15:31:00.939518 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:00.939443    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:31:01.064417 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:01.064387    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-q8bzp"]
Jul 15 15:31:01.068599 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:01.068582    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-q8bzp"
Jul 15 15:31:01.071576 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:01.071554    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 15 15:31:01.071808 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:01.071789    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-2qn6p\""
Jul 15 15:31:01.079594 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:01.079574    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-q8bzp"]
Jul 15 15:31:01.081513 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:01.081488    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:31:01.088730 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:01.088707    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59zhg\" (UniqueName: \"kubernetes.io/projected/7e8984c0-7e1a-4afd-94f0-6cdd0be45a72-kube-api-access-59zhg\") pod \"model-serving-api-54d89bd5fc-q8bzp\" (UID: \"7e8984c0-7e1a-4afd-94f0-6cdd0be45a72\") " pod="opendatahub/model-serving-api-54d89bd5fc-q8bzp"
Jul 15 15:31:01.088813 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:01.088770    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e8984c0-7e1a-4afd-94f0-6cdd0be45a72-tls-certs\") pod \"model-serving-api-54d89bd5fc-q8bzp\" (UID: \"7e8984c0-7e1a-4afd-94f0-6cdd0be45a72\") " pod="opendatahub/model-serving-api-54d89bd5fc-q8bzp"
Jul 15 15:31:01.189289 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:01.189259    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e8984c0-7e1a-4afd-94f0-6cdd0be45a72-tls-certs\") pod \"model-serving-api-54d89bd5fc-q8bzp\" (UID: \"7e8984c0-7e1a-4afd-94f0-6cdd0be45a72\") " pod="opendatahub/model-serving-api-54d89bd5fc-q8bzp"
Jul 15 15:31:01.189411 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:01.189309    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59zhg\" (UniqueName: \"kubernetes.io/projected/7e8984c0-7e1a-4afd-94f0-6cdd0be45a72-kube-api-access-59zhg\") pod \"model-serving-api-54d89bd5fc-q8bzp\" (UID: \"7e8984c0-7e1a-4afd-94f0-6cdd0be45a72\") " pod="opendatahub/model-serving-api-54d89bd5fc-q8bzp"
Jul 15 15:31:01.189473 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:31:01.189426    2564 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 15 15:31:01.189559 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:31:01.189500    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e8984c0-7e1a-4afd-94f0-6cdd0be45a72-tls-certs podName:7e8984c0-7e1a-4afd-94f0-6cdd0be45a72 nodeName:}" failed. No retries permitted until 2026-07-15 15:31:01.689478167 +0000 UTC m=+392.035381351 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/7e8984c0-7e1a-4afd-94f0-6cdd0be45a72-tls-certs") pod "model-serving-api-54d89bd5fc-q8bzp" (UID: "7e8984c0-7e1a-4afd-94f0-6cdd0be45a72") : secret "model-serving-api-tls" not found
Jul 15 15:31:01.216806 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:01.216782    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59zhg\" (UniqueName: \"kubernetes.io/projected/7e8984c0-7e1a-4afd-94f0-6cdd0be45a72-kube-api-access-59zhg\") pod \"model-serving-api-54d89bd5fc-q8bzp\" (UID: \"7e8984c0-7e1a-4afd-94f0-6cdd0be45a72\") " pod="opendatahub/model-serving-api-54d89bd5fc-q8bzp"
Jul 15 15:31:01.506684 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:01.506596    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:31:01.631661 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:01.631621    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-c788dcdb-5mzwg" event={"ID":"be9de479-25d3-477b-ae77-1efaa1107bb4","Type":"ContainerStarted","Data":"22299ebb74d5b321e041aa80beed10984a67ec784b867b004a7c135ed8ae70d9"}
Jul 15 15:31:01.693426 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:01.693397    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e8984c0-7e1a-4afd-94f0-6cdd0be45a72-tls-certs\") pod \"model-serving-api-54d89bd5fc-q8bzp\" (UID: \"7e8984c0-7e1a-4afd-94f0-6cdd0be45a72\") " pod="opendatahub/model-serving-api-54d89bd5fc-q8bzp"
Jul 15 15:31:01.696134 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:01.696109    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e8984c0-7e1a-4afd-94f0-6cdd0be45a72-tls-certs\") pod \"model-serving-api-54d89bd5fc-q8bzp\" (UID: \"7e8984c0-7e1a-4afd-94f0-6cdd0be45a72\") " pod="opendatahub/model-serving-api-54d89bd5fc-q8bzp"
Jul 15 15:31:01.855724 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:01.855690    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:31:01.856130 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:01.856107    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-hvtlr"]
Jul 15 15:31:01.859274 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:01.859259    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvtlr"
Jul 15 15:31:01.861830 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:01.861812    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 15 15:31:01.861830 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:01.861823    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 15 15:31:01.861995 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:01.861812    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 15 15:31:01.862223 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:01.862204    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-qjvh4\""
Jul 15 15:31:01.862656 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:01.862639    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 15 15:31:01.880158 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:01.880135    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-hvtlr"]
Jul 15 15:31:01.895658 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:01.895573    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b-istio-token\") pod \"istiod-openshift-gateway-7574459656-hvtlr\" (UID: \"e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvtlr"
Jul 15 15:31:01.895658 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:01.895659    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nw78z\" (UniqueName: \"kubernetes.io/projected/e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b-kube-api-access-nw78z\") pod \"istiod-openshift-gateway-7574459656-hvtlr\" (UID: \"e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvtlr"
Jul 15 15:31:01.896288 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:01.895717    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b-cacerts\") pod \"istiod-openshift-gateway-7574459656-hvtlr\" (UID: \"e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvtlr"
Jul 15 15:31:01.896288 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:01.895799    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-hvtlr\" (UID: \"e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvtlr"
Jul 15 15:31:01.896288 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:01.895866    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b-local-certs\") pod \"istiod-openshift-gateway-7574459656-hvtlr\" (UID: \"e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvtlr"
Jul 15 15:31:01.896288 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:01.895901    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-hvtlr\" (UID: \"e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvtlr"
Jul 15 15:31:01.896288 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:01.895943    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-hvtlr\" (UID: \"e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvtlr"
Jul 15 15:31:01.941326 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:01.941287    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:31:01.979118 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:01.979083    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-q8bzp"
Jul 15 15:31:01.996499 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:01.996473    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b-istio-token\") pod \"istiod-openshift-gateway-7574459656-hvtlr\" (UID: \"e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvtlr"
Jul 15 15:31:01.996616 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:01.996512    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nw78z\" (UniqueName: \"kubernetes.io/projected/e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b-kube-api-access-nw78z\") pod \"istiod-openshift-gateway-7574459656-hvtlr\" (UID: \"e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvtlr"
Jul 15 15:31:01.996676 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:01.996661    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b-cacerts\") pod \"istiod-openshift-gateway-7574459656-hvtlr\" (UID: \"e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvtlr"
Jul 15 15:31:01.996961 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:01.996943    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-hvtlr\" (UID: \"e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvtlr"
Jul 15 15:31:01.997063 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:01.996980    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b-local-certs\") pod \"istiod-openshift-gateway-7574459656-hvtlr\" (UID: \"e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvtlr"
Jul 15 15:31:01.997063 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:01.997034    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-hvtlr\" (UID: \"e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvtlr"
Jul 15 15:31:01.997228 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:01.997068    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-hvtlr\" (UID: \"e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvtlr"
Jul 15 15:31:01.998621 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:01.998590    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-hvtlr\" (UID: \"e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvtlr"
Jul 15 15:31:01.999828 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:01.999802    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b-cacerts\") pod \"istiod-openshift-gateway-7574459656-hvtlr\" (UID: \"e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvtlr"
Jul 15 15:31:01.999951 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:01.999894    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-hvtlr\" (UID: \"e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvtlr"
Jul 15 15:31:02.000003 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:01.999982    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-hvtlr\" (UID: \"e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvtlr"
Jul 15 15:31:02.000182 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:02.000161    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b-local-certs\") pod \"istiod-openshift-gateway-7574459656-hvtlr\" (UID: \"e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvtlr"
Jul 15 15:31:02.005547 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:02.005522    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nw78z\" (UniqueName: \"kubernetes.io/projected/e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b-kube-api-access-nw78z\") pod \"istiod-openshift-gateway-7574459656-hvtlr\" (UID: \"e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvtlr"
Jul 15 15:31:02.006477 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:02.006447    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b-istio-token\") pod \"istiod-openshift-gateway-7574459656-hvtlr\" (UID: \"e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvtlr"
Jul 15 15:31:02.114955 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:02.114878    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-q8bzp"]
Jul 15 15:31:02.117639 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:31:02.117609    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e8984c0_7e1a_4afd_94f0_6cdd0be45a72.slice/crio-bad809372b528e8326b17f0114924765268983d26fac4a292f4cd00799ff6a58 WatchSource:0}: Error finding container bad809372b528e8326b17f0114924765268983d26fac4a292f4cd00799ff6a58: Status 404 returned error can't find the container with id bad809372b528e8326b17f0114924765268983d26fac4a292f4cd00799ff6a58
Jul 15 15:31:02.168469 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:02.168432    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvtlr"
Jul 15 15:31:02.299778 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:02.299755    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-hvtlr"]
Jul 15 15:31:02.302129 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:31:02.302106    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0fcee8e_7ed6_4f9e_8e92_b3aa6de0247b.slice/crio-190d8173a8d2f9f1628c973fd53ca9bbe307f30524d50324a879be38ee56bc08 WatchSource:0}: Error finding container 190d8173a8d2f9f1628c973fd53ca9bbe307f30524d50324a879be38ee56bc08: Status 404 returned error can't find the container with id 190d8173a8d2f9f1628c973fd53ca9bbe307f30524d50324a879be38ee56bc08
Jul 15 15:31:02.637365 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:02.637329    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvtlr" event={"ID":"e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b","Type":"ContainerStarted","Data":"190d8173a8d2f9f1628c973fd53ca9bbe307f30524d50324a879be38ee56bc08"}
Jul 15 15:31:02.638655 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:02.638626    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-q8bzp" event={"ID":"7e8984c0-7e1a-4afd-94f0-6cdd0be45a72","Type":"ContainerStarted","Data":"bad809372b528e8326b17f0114924765268983d26fac4a292f4cd00799ff6a58"}
Jul 15 15:31:03.125130 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:03.125094    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:31:05.401479 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:05.401426    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 15:31:05.401739 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:05.401505    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 15:31:05.653081 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:05.652971    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-c788dcdb-5mzwg" event={"ID":"be9de479-25d3-477b-ae77-1efaa1107bb4","Type":"ContainerStarted","Data":"e395abd38a85e62930603453af34a01afc73374d62427b6fa699e3128e3b78fa"}
Jul 15 15:31:05.654585 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:05.654553    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvtlr" event={"ID":"e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b","Type":"ContainerStarted","Data":"5868e042b9e581024637f0c4a33da77aa344db888eb3ad04eb203d3419c49b5f"}
Jul 15 15:31:05.654726 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:05.654677    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvtlr"
Jul 15 15:31:05.655940 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:05.655921    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-q8bzp" event={"ID":"7e8984c0-7e1a-4afd-94f0-6cdd0be45a72","Type":"ContainerStarted","Data":"d57a3d4835603f3e1a79588a99f7a071cb8e3afb7d3a615e42a7379aebf90d5d"}
Jul 15 15:31:05.656058 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:05.655970    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-q8bzp"
Jul 15 15:31:05.670390 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:05.670337    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-c788dcdb-5mzwg" podStartSLOduration=0.965476264 podStartE2EDuration="5.670320324s" totalImagesPullingTime="4.70484406s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:31:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:31:05.670073844 +0000 UTC m=+396.015977041" watchObservedRunningTime="2026-07-15 15:31:05.670320324 +0000 UTC m=+396.016223517"
Jul 15 15:31:05.688830 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:05.688768    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-q8bzp" podStartSLOduration=1.405970783 podStartE2EDuration="4.688751675s" totalImagesPullingTime="3.282780892s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:31:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:31:05.687686672 +0000 UTC m=+396.033589859" watchObservedRunningTime="2026-07-15 15:31:05.688751675 +0000 UTC m=+396.034654868"
Jul 15 15:31:06.279627 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:06.279587    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:31:06.378897 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:06.378865    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:31:06.661203 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:06.661125    2564 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-hvtlr container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 15 15:31:06.661203 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:06.661180    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvtlr" podUID="e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 15:31:07.136262 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:07.136228    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:31:07.245873 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:07.245846    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:31:07.409798 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:07.409726    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:31:09.661127 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:09.661095    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvtlr"
Jul 15 15:31:09.704994 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:09.704914    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvtlr" podStartSLOduration=5.607796362 podStartE2EDuration="8.704897393s" totalImagesPullingTime="3.097101031s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:31:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:31:05.715464445 +0000 UTC m=+396.061367633" watchObservedRunningTime="2026-07-15 15:31:09.704897393 +0000 UTC m=+400.050800586"
Jul 15 15:31:10.460958 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:10.460919    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:31:10.513682 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:10.513652    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-zxthv"]
Jul 15 15:31:10.517211 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:10.517194    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zxthv"
Jul 15 15:31:10.527134 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:10.527117    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 15 15:31:10.527473 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:10.527458    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-c9jq6\""
Jul 15 15:31:10.550259 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:10.550227    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-zxthv"]
Jul 15 15:31:10.572452 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:10.572429    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2q4tf\" (UniqueName: \"kubernetes.io/projected/4453b8ac-b9f4-41ed-8e3f-bba488ac06b2-kube-api-access-2q4tf\") pod \"kserve-controller-manager-d6f4b65b8-zxthv\" (UID: \"4453b8ac-b9f4-41ed-8e3f-bba488ac06b2\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zxthv"
Jul 15 15:31:10.572543 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:10.572494    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4453b8ac-b9f4-41ed-8e3f-bba488ac06b2-cert\") pod \"kserve-controller-manager-d6f4b65b8-zxthv\" (UID: \"4453b8ac-b9f4-41ed-8e3f-bba488ac06b2\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zxthv"
Jul 15 15:31:10.614687 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:10.614659    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:31:10.673363 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:10.673336    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2q4tf\" (UniqueName: \"kubernetes.io/projected/4453b8ac-b9f4-41ed-8e3f-bba488ac06b2-kube-api-access-2q4tf\") pod \"kserve-controller-manager-d6f4b65b8-zxthv\" (UID: \"4453b8ac-b9f4-41ed-8e3f-bba488ac06b2\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zxthv"
Jul 15 15:31:10.673791 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:10.673382    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4453b8ac-b9f4-41ed-8e3f-bba488ac06b2-cert\") pod \"kserve-controller-manager-d6f4b65b8-zxthv\" (UID: \"4453b8ac-b9f4-41ed-8e3f-bba488ac06b2\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zxthv"
Jul 15 15:31:10.673791 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:31:10.673509    2564 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 15 15:31:10.673791 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:31:10.673566    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4453b8ac-b9f4-41ed-8e3f-bba488ac06b2-cert podName:4453b8ac-b9f4-41ed-8e3f-bba488ac06b2 nodeName:}" failed. No retries permitted until 2026-07-15 15:31:11.173545036 +0000 UTC m=+401.519448206 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/4453b8ac-b9f4-41ed-8e3f-bba488ac06b2-cert") pod "kserve-controller-manager-d6f4b65b8-zxthv" (UID: "4453b8ac-b9f4-41ed-8e3f-bba488ac06b2") : secret "kserve-webhook-server-cert" not found
Jul 15 15:31:10.684129 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:10.684102    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2q4tf\" (UniqueName: \"kubernetes.io/projected/4453b8ac-b9f4-41ed-8e3f-bba488ac06b2-kube-api-access-2q4tf\") pod \"kserve-controller-manager-d6f4b65b8-zxthv\" (UID: \"4453b8ac-b9f4-41ed-8e3f-bba488ac06b2\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zxthv"
Jul 15 15:31:10.850887 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:10.850857    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:31:10.992829 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:10.992805    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:31:11.176483 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:11.176397    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4453b8ac-b9f4-41ed-8e3f-bba488ac06b2-cert\") pod \"kserve-controller-manager-d6f4b65b8-zxthv\" (UID: \"4453b8ac-b9f4-41ed-8e3f-bba488ac06b2\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zxthv"
Jul 15 15:31:11.178743 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:11.178725    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4453b8ac-b9f4-41ed-8e3f-bba488ac06b2-cert\") pod \"kserve-controller-manager-d6f4b65b8-zxthv\" (UID: \"4453b8ac-b9f4-41ed-8e3f-bba488ac06b2\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zxthv"
Jul 15 15:31:11.428996 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:11.428932    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zxthv"
Jul 15 15:31:11.576402 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:11.576374    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-zxthv"]
Jul 15 15:31:11.579334 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:31:11.579310    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4453b8ac_b9f4_41ed_8e3f_bba488ac06b2.slice/crio-98c414d97007c9f954bf92d5f4c99aeaba9d9fca65b8f7dbb77182ea40bef128 WatchSource:0}: Error finding container 98c414d97007c9f954bf92d5f4c99aeaba9d9fca65b8f7dbb77182ea40bef128: Status 404 returned error can't find the container with id 98c414d97007c9f954bf92d5f4c99aeaba9d9fca65b8f7dbb77182ea40bef128
Jul 15 15:31:11.678769 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:11.678736    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zxthv" event={"ID":"4453b8ac-b9f4-41ed-8e3f-bba488ac06b2","Type":"ContainerStarted","Data":"98c414d97007c9f954bf92d5f4c99aeaba9d9fca65b8f7dbb77182ea40bef128"}
Jul 15 15:31:11.742182 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:11.742128    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:31:11.841909 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:11.841873    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:31:12.736259 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:12.736225    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-hvtlr"]
Jul 15 15:31:12.736677 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:12.736425    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvtlr" podUID="e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b" containerName="discovery" containerID="cri-o://5868e042b9e581024637f0c4a33da77aa344db888eb3ad04eb203d3419c49b5f" gracePeriod=30
Jul 15 15:31:12.990724 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:12.990665    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvtlr"
Jul 15 15:31:13.088472 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:13.088412    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b-istio-csr-ca-configmap\") pod \"e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b\" (UID: \"e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b\") "
Jul 15 15:31:13.088619 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:13.088494    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b-cacerts\") pod \"e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b\" (UID: \"e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b\") "
Jul 15 15:31:13.088619 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:13.088535    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nw78z\" (UniqueName: \"kubernetes.io/projected/e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b-kube-api-access-nw78z\") pod \"e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b\" (UID: \"e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b\") "
Jul 15 15:31:13.088619 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:13.088594    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b-local-certs\") pod \"e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b\" (UID: \"e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b\") "
Jul 15 15:31:13.088763 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:13.088635    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b-istio-token\") pod \"e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b\" (UID: \"e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b\") "
Jul 15 15:31:13.088763 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:13.088659    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b-istio-csr-dns-cert\") pod \"e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b\" (UID: \"e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b\") "
Jul 15 15:31:13.088763 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:13.088717    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b-istio-kubeconfig\") pod \"e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b\" (UID: \"e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b\") "
Jul 15 15:31:13.088906 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:13.088888    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b" (UID: "e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 15:31:13.088964 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:13.088951    2564 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b-istio-csr-ca-configmap\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 15:31:13.091466 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:13.091438    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b-cacerts" (OuterVolumeSpecName: "cacerts") pod "e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b" (UID: "e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 15:31:13.091767 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:13.091728    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b-local-certs" (OuterVolumeSpecName: "local-certs") pod "e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b" (UID: "e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:31:13.091869 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:13.091839    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b" (UID: "e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 15:31:13.091955 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:13.091860    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b" (UID: "e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 15:31:13.091955 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:13.091916    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b-istio-token" (OuterVolumeSpecName: "istio-token") pod "e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b" (UID: "e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:31:13.092075 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:13.092049    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b-kube-api-access-nw78z" (OuterVolumeSpecName: "kube-api-access-nw78z") pod "e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b" (UID: "e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b"). InnerVolumeSpecName "kube-api-access-nw78z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:31:13.189750 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:13.189716    2564 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b-local-certs\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 15:31:13.189750 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:13.189743    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b-istio-token\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 15:31:13.189750 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:13.189753    2564 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b-istio-csr-dns-cert\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 15:31:13.189973 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:13.189761    2564 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b-istio-kubeconfig\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 15:31:13.189973 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:13.189770    2564 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b-cacerts\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 15:31:13.189973 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:13.189778    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nw78z\" (UniqueName: \"kubernetes.io/projected/e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b-kube-api-access-nw78z\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 15:31:13.688089 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:13.688050    2564 generic.go:356] "Generic (PLEG): container finished" podID="e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b" containerID="5868e042b9e581024637f0c4a33da77aa344db888eb3ad04eb203d3419c49b5f" exitCode=0
Jul 15 15:31:13.688265 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:13.688098    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvtlr"
Jul 15 15:31:13.688265 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:13.688124    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvtlr" event={"ID":"e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b","Type":"ContainerDied","Data":"5868e042b9e581024637f0c4a33da77aa344db888eb3ad04eb203d3419c49b5f"}
Jul 15 15:31:13.688265 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:13.688167    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvtlr" event={"ID":"e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b","Type":"ContainerDied","Data":"190d8173a8d2f9f1628c973fd53ca9bbe307f30524d50324a879be38ee56bc08"}
Jul 15 15:31:13.688265 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:13.688192    2564 scope.go:117] "RemoveContainer" containerID="5868e042b9e581024637f0c4a33da77aa344db888eb3ad04eb203d3419c49b5f"
Jul 15 15:31:13.713578 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:13.713551    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-hvtlr"]
Jul 15 15:31:13.720888 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:13.720866    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-hvtlr"]
Jul 15 15:31:14.175886 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:14.175730    2564 scope.go:117] "RemoveContainer" containerID="5868e042b9e581024637f0c4a33da77aa344db888eb3ad04eb203d3419c49b5f"
Jul 15 15:31:14.176168 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:31:14.176073    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5868e042b9e581024637f0c4a33da77aa344db888eb3ad04eb203d3419c49b5f\": container with ID starting with 5868e042b9e581024637f0c4a33da77aa344db888eb3ad04eb203d3419c49b5f not found: ID does not exist" containerID="5868e042b9e581024637f0c4a33da77aa344db888eb3ad04eb203d3419c49b5f"
Jul 15 15:31:14.176168 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:14.176108    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5868e042b9e581024637f0c4a33da77aa344db888eb3ad04eb203d3419c49b5f"} err="failed to get container status \"5868e042b9e581024637f0c4a33da77aa344db888eb3ad04eb203d3419c49b5f\": rpc error: code = NotFound desc = could not find container \"5868e042b9e581024637f0c4a33da77aa344db888eb3ad04eb203d3419c49b5f\": container with ID starting with 5868e042b9e581024637f0c4a33da77aa344db888eb3ad04eb203d3419c49b5f not found: ID does not exist"
Jul 15 15:31:14.228320 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:14.228298    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b" path="/var/lib/kubelet/pods/e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b/volumes"
Jul 15 15:31:14.496927 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:14.496852    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:31:14.602470 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:14.602436    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:31:14.695139 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:14.695109    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zxthv" event={"ID":"4453b8ac-b9f4-41ed-8e3f-bba488ac06b2","Type":"ContainerStarted","Data":"ba3d97b15fe4750d7036d8c2be08c3cc9a0ea885f46cb464a044ef25c4893134"}
Jul 15 15:31:14.695272 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:14.695231    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zxthv"
Jul 15 15:31:14.716728 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:14.716683    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zxthv" podStartSLOduration=2.076326647 podStartE2EDuration="4.716668436s" totalImagesPullingTime="2.640341789s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:31:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:31:14.715276379 +0000 UTC m=+405.061179572" watchObservedRunningTime="2026-07-15 15:31:14.716668436 +0000 UTC m=+405.062571628"
Jul 15 15:31:16.663787 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:16.663748    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-q8bzp"
Jul 15 15:31:39.014226 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:39.014182    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:31:40.057795 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:40.057756    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:31:45.704071 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:31:45.704032    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zxthv"
Jul 15 15:32:00.715356 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:00.715271    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:32:00.800985 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:00.800948    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:32:00.835427 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:00.835395    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-26v5q"]
Jul 15 15:32:00.835671 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:00.835659    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b" containerName="discovery"
Jul 15 15:32:00.835713 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:00.835672    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b" containerName="discovery"
Jul 15 15:32:00.835750 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:00.835713    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0fcee8e-7ed6-4f9e-8e92-b3aa6de0247b" containerName="discovery"
Jul 15 15:32:00.837359 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:00.837341    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-26v5q"
Jul 15 15:32:00.840089 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:00.840066    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 15 15:32:00.841210 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:00.841190    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-hnz6p\""
Jul 15 15:32:00.841311 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:00.841229    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 15 15:32:00.852679 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:00.852650    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-26v5q"]
Jul 15 15:32:00.922974 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:00.922941    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:32:00.925084 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:00.925066    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsqgn\" (UniqueName: \"kubernetes.io/projected/d62006d1-9ce3-4c30-a19c-151ccacb5953-kube-api-access-xsqgn\") pod \"kuadrant-operator-catalog-26v5q\" (UID: \"d62006d1-9ce3-4c30-a19c-151ccacb5953\") " pod="kuadrant-system/kuadrant-operator-catalog-26v5q"
Jul 15 15:32:01.026097 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:01.026071    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xsqgn\" (UniqueName: \"kubernetes.io/projected/d62006d1-9ce3-4c30-a19c-151ccacb5953-kube-api-access-xsqgn\") pod \"kuadrant-operator-catalog-26v5q\" (UID: \"d62006d1-9ce3-4c30-a19c-151ccacb5953\") " pod="kuadrant-system/kuadrant-operator-catalog-26v5q"
Jul 15 15:32:01.035767 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:01.035738    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsqgn\" (UniqueName: \"kubernetes.io/projected/d62006d1-9ce3-4c30-a19c-151ccacb5953-kube-api-access-xsqgn\") pod \"kuadrant-operator-catalog-26v5q\" (UID: \"d62006d1-9ce3-4c30-a19c-151ccacb5953\") " pod="kuadrant-system/kuadrant-operator-catalog-26v5q"
Jul 15 15:32:01.148059 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:01.148019    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-26v5q"
Jul 15 15:32:01.193106 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:01.193072    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-26v5q"]
Jul 15 15:32:01.279668 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:01.279522    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-26v5q"]
Jul 15 15:32:01.281835 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:32:01.281813    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd62006d1_9ce3_4c30_a19c_151ccacb5953.slice/crio-9a760446a9a096e9cba5bc74b9c5d61afd3e30ec871cdbc0fb456f6e831b33f8 WatchSource:0}: Error finding container 9a760446a9a096e9cba5bc74b9c5d61afd3e30ec871cdbc0fb456f6e831b33f8: Status 404 returned error can't find the container with id 9a760446a9a096e9cba5bc74b9c5d61afd3e30ec871cdbc0fb456f6e831b33f8
Jul 15 15:32:01.422802 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:01.422768    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-54xvn"]
Jul 15 15:32:01.425049 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:01.425033    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-54xvn"
Jul 15 15:32:01.454869 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:01.454845    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-54xvn"]
Jul 15 15:32:01.529893 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:01.529808    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46gb5\" (UniqueName: \"kubernetes.io/projected/4a202ae9-c06f-4d43-b2ec-95506cc0fc12-kube-api-access-46gb5\") pod \"kuadrant-operator-catalog-54xvn\" (UID: \"4a202ae9-c06f-4d43-b2ec-95506cc0fc12\") " pod="kuadrant-system/kuadrant-operator-catalog-54xvn"
Jul 15 15:32:01.630988 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:01.630949    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46gb5\" (UniqueName: \"kubernetes.io/projected/4a202ae9-c06f-4d43-b2ec-95506cc0fc12-kube-api-access-46gb5\") pod \"kuadrant-operator-catalog-54xvn\" (UID: \"4a202ae9-c06f-4d43-b2ec-95506cc0fc12\") " pod="kuadrant-system/kuadrant-operator-catalog-54xvn"
Jul 15 15:32:01.639478 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:01.639456    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-46gb5\" (UniqueName: \"kubernetes.io/projected/4a202ae9-c06f-4d43-b2ec-95506cc0fc12-kube-api-access-46gb5\") pod \"kuadrant-operator-catalog-54xvn\" (UID: \"4a202ae9-c06f-4d43-b2ec-95506cc0fc12\") " pod="kuadrant-system/kuadrant-operator-catalog-54xvn"
Jul 15 15:32:01.657832 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:01.657798    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:32:01.734274 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:01.734248    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-54xvn"
Jul 15 15:32:01.844270 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:01.844233    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:32:01.863837 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:01.863804    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-26v5q" event={"ID":"d62006d1-9ce3-4c30-a19c-151ccacb5953","Type":"ContainerStarted","Data":"9a760446a9a096e9cba5bc74b9c5d61afd3e30ec871cdbc0fb456f6e831b33f8"}
Jul 15 15:32:01.872389 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:01.872273    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-54xvn"]
Jul 15 15:32:01.900341 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:32:01.900310    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a202ae9_c06f_4d43_b2ec_95506cc0fc12.slice/crio-d3d4964c1b11b2fd2eff8883655904255bd67663b31b691b69582b9bfc728a43 WatchSource:0}: Error finding container d3d4964c1b11b2fd2eff8883655904255bd67663b31b691b69582b9bfc728a43: Status 404 returned error can't find the container with id d3d4964c1b11b2fd2eff8883655904255bd67663b31b691b69582b9bfc728a43
Jul 15 15:32:02.869864 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:02.869828    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-54xvn" event={"ID":"4a202ae9-c06f-4d43-b2ec-95506cc0fc12","Type":"ContainerStarted","Data":"d3d4964c1b11b2fd2eff8883655904255bd67663b31b691b69582b9bfc728a43"}
Jul 15 15:32:03.875168 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:03.875132    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-54xvn" event={"ID":"4a202ae9-c06f-4d43-b2ec-95506cc0fc12","Type":"ContainerStarted","Data":"eb259ed029dc9af39394b4674a0bda1c8f643274a4056d73430d786f240dbb06"}
Jul 15 15:32:03.876538 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:03.876516    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-26v5q" event={"ID":"d62006d1-9ce3-4c30-a19c-151ccacb5953","Type":"ContainerStarted","Data":"0d6546e3254634fb74ac6143ce3b76e5cd468b67d46f7351c0a2439166b859a8"}
Jul 15 15:32:03.876660 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:03.876569    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-26v5q" podUID="d62006d1-9ce3-4c30-a19c-151ccacb5953" containerName="registry-server" containerID="cri-o://0d6546e3254634fb74ac6143ce3b76e5cd468b67d46f7351c0a2439166b859a8" gracePeriod=2
Jul 15 15:32:03.894340 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:03.894302    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-54xvn" podStartSLOduration=1.496004073 podStartE2EDuration="2.894288264s" totalImagesPullingTime="1.398284191s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:32:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:32:03.893139437 +0000 UTC m=+454.239042644" watchObservedRunningTime="2026-07-15 15:32:03.894288264 +0000 UTC m=+454.240191435"
Jul 15 15:32:03.908826 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:03.908788    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-26v5q" podStartSLOduration=1.49257759 podStartE2EDuration="3.908774962s" totalImagesPullingTime="2.416197372s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:32:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:32:03.90834021 +0000 UTC m=+454.254243416" watchObservedRunningTime="2026-07-15 15:32:03.908774962 +0000 UTC m=+454.254678155"
Jul 15 15:32:04.113708 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:04.113677    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-26v5q"
Jul 15 15:32:04.251632 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:04.251556    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xsqgn\" (UniqueName: \"kubernetes.io/projected/d62006d1-9ce3-4c30-a19c-151ccacb5953-kube-api-access-xsqgn\") pod \"d62006d1-9ce3-4c30-a19c-151ccacb5953\" (UID: \"d62006d1-9ce3-4c30-a19c-151ccacb5953\") "
Jul 15 15:32:04.253691 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:04.253668    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d62006d1-9ce3-4c30-a19c-151ccacb5953-kube-api-access-xsqgn" (OuterVolumeSpecName: "kube-api-access-xsqgn") pod "d62006d1-9ce3-4c30-a19c-151ccacb5953" (UID: "d62006d1-9ce3-4c30-a19c-151ccacb5953"). InnerVolumeSpecName "kube-api-access-xsqgn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:32:04.352719 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:04.352679    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xsqgn\" (UniqueName: \"kubernetes.io/projected/d62006d1-9ce3-4c30-a19c-151ccacb5953-kube-api-access-xsqgn\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 15:32:04.881654 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:04.881618    2564 generic.go:356] "Generic (PLEG): container finished" podID="d62006d1-9ce3-4c30-a19c-151ccacb5953" containerID="0d6546e3254634fb74ac6143ce3b76e5cd468b67d46f7351c0a2439166b859a8" exitCode=0
Jul 15 15:32:04.882136 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:04.881669    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-26v5q"
Jul 15 15:32:04.882136 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:04.881701    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-26v5q" event={"ID":"d62006d1-9ce3-4c30-a19c-151ccacb5953","Type":"ContainerDied","Data":"0d6546e3254634fb74ac6143ce3b76e5cd468b67d46f7351c0a2439166b859a8"}
Jul 15 15:32:04.882136 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:04.881765    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-26v5q" event={"ID":"d62006d1-9ce3-4c30-a19c-151ccacb5953","Type":"ContainerDied","Data":"9a760446a9a096e9cba5bc74b9c5d61afd3e30ec871cdbc0fb456f6e831b33f8"}
Jul 15 15:32:04.882136 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:04.881784    2564 scope.go:117] "RemoveContainer" containerID="0d6546e3254634fb74ac6143ce3b76e5cd468b67d46f7351c0a2439166b859a8"
Jul 15 15:32:04.890445 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:04.890427    2564 scope.go:117] "RemoveContainer" containerID="0d6546e3254634fb74ac6143ce3b76e5cd468b67d46f7351c0a2439166b859a8"
Jul 15 15:32:04.890694 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:32:04.890678    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d6546e3254634fb74ac6143ce3b76e5cd468b67d46f7351c0a2439166b859a8\": container with ID starting with 0d6546e3254634fb74ac6143ce3b76e5cd468b67d46f7351c0a2439166b859a8 not found: ID does not exist" containerID="0d6546e3254634fb74ac6143ce3b76e5cd468b67d46f7351c0a2439166b859a8"
Jul 15 15:32:04.890741 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:04.890704    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d6546e3254634fb74ac6143ce3b76e5cd468b67d46f7351c0a2439166b859a8"} err="failed to get container status \"0d6546e3254634fb74ac6143ce3b76e5cd468b67d46f7351c0a2439166b859a8\": rpc error: code = NotFound desc = could not find container \"0d6546e3254634fb74ac6143ce3b76e5cd468b67d46f7351c0a2439166b859a8\": container with ID starting with 0d6546e3254634fb74ac6143ce3b76e5cd468b67d46f7351c0a2439166b859a8 not found: ID does not exist"
Jul 15 15:32:04.902179 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:04.902159    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-26v5q"]
Jul 15 15:32:04.906485 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:04.906464    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-26v5q"]
Jul 15 15:32:06.228215 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:06.228183    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d62006d1-9ce3-4c30-a19c-151ccacb5953" path="/var/lib/kubelet/pods/d62006d1-9ce3-4c30-a19c-151ccacb5953/volumes"
Jul 15 15:32:11.735203 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:11.735161    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-54xvn"
Jul 15 15:32:11.735619 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:11.735220    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-54xvn"
Jul 15 15:32:11.756709 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:11.756678    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-54xvn"
Jul 15 15:32:11.928959 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:11.928937    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-54xvn"
Jul 15 15:32:23.459421 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:23.459390    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:32:29.697714 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:29.697679    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:32:32.317700 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:32.317668    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jjrfq"]
Jul 15 15:32:32.318118 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:32.317936    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d62006d1-9ce3-4c30-a19c-151ccacb5953" containerName="registry-server"
Jul 15 15:32:32.318118 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:32.317947    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d62006d1-9ce3-4c30-a19c-151ccacb5953" containerName="registry-server"
Jul 15 15:32:32.318118 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:32.317988    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d62006d1-9ce3-4c30-a19c-151ccacb5953" containerName="registry-server"
Jul 15 15:32:32.323581 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:32.323562    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jjrfq"
Jul 15 15:32:32.328898 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:32.328877    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-5xwcg\""
Jul 15 15:32:32.344218 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:32.344199    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jjrfq"]
Jul 15 15:32:32.362197 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:32.362164    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nk5b\" (UniqueName: \"kubernetes.io/projected/501e3f31-5bd0-4244-984e-75d247afff12-kube-api-access-6nk5b\") pod \"limitador-operator-controller-manager-859d7b78bd-jjrfq\" (UID: \"501e3f31-5bd0-4244-984e-75d247afff12\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jjrfq"
Jul 15 15:32:32.462480 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:32.462452    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nk5b\" (UniqueName: \"kubernetes.io/projected/501e3f31-5bd0-4244-984e-75d247afff12-kube-api-access-6nk5b\") pod \"limitador-operator-controller-manager-859d7b78bd-jjrfq\" (UID: \"501e3f31-5bd0-4244-984e-75d247afff12\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jjrfq"
Jul 15 15:32:32.472883 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:32.472855    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nk5b\" (UniqueName: \"kubernetes.io/projected/501e3f31-5bd0-4244-984e-75d247afff12-kube-api-access-6nk5b\") pod \"limitador-operator-controller-manager-859d7b78bd-jjrfq\" (UID: \"501e3f31-5bd0-4244-984e-75d247afff12\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jjrfq"
Jul 15 15:32:32.632549 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:32.632500    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jjrfq"
Jul 15 15:32:32.762039 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:32.761653    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jjrfq"]
Jul 15 15:32:32.767398 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:32:32.767371    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod501e3f31_5bd0_4244_984e_75d247afff12.slice/crio-9f85475c7a2d586d40a1510f4869a1028bf00e36c13f9b96408ac5ce981448d8 WatchSource:0}: Error finding container 9f85475c7a2d586d40a1510f4869a1028bf00e36c13f9b96408ac5ce981448d8: Status 404 returned error can't find the container with id 9f85475c7a2d586d40a1510f4869a1028bf00e36c13f9b96408ac5ce981448d8
Jul 15 15:32:32.982232 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:32.982147    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jjrfq" event={"ID":"501e3f31-5bd0-4244-984e-75d247afff12","Type":"ContainerStarted","Data":"9f85475c7a2d586d40a1510f4869a1028bf00e36c13f9b96408ac5ce981448d8"}
Jul 15 15:32:33.070683 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:33.070652    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:32:33.873432 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:33.873388    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:32:34.246281 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:34.246207    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:32:34.348307 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:34.348274    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:32:34.447071 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:34.447044    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:32:34.991439 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:34.991402    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jjrfq" event={"ID":"501e3f31-5bd0-4244-984e-75d247afff12","Type":"ContainerStarted","Data":"7862fc795b43a05fb02697f12927bee72dd4094c86720a36f960892a807f2e1a"}
Jul 15 15:32:34.991912 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:34.991536    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jjrfq"
Jul 15 15:32:35.010589 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:35.010546    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jjrfq" podStartSLOduration=1.362689071 podStartE2EDuration="3.010532952s" totalImagesPullingTime="1.647843881s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:32:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:32:35.009664147 +0000 UTC m=+485.355567336" watchObservedRunningTime="2026-07-15 15:32:35.010532952 +0000 UTC m=+485.356436144"
Jul 15 15:32:36.351416 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:36.351378    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-bt4wd"]
Jul 15 15:32:36.354751 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:36.354734    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-bt4wd"
Jul 15 15:32:36.357311 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:36.357293    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-lzltq\""
Jul 15 15:32:36.366133 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:36.366113    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-bt4wd"]
Jul 15 15:32:36.390087 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:36.390062    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hq42q\" (UniqueName: \"kubernetes.io/projected/0c64aca6-02b3-4b3a-8b89-a56236f723e3-kube-api-access-hq42q\") pod \"authorino-operator-75cc8d5cb7-bt4wd\" (UID: \"0c64aca6-02b3-4b3a-8b89-a56236f723e3\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-bt4wd"
Jul 15 15:32:36.490466 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:36.490442    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hq42q\" (UniqueName: \"kubernetes.io/projected/0c64aca6-02b3-4b3a-8b89-a56236f723e3-kube-api-access-hq42q\") pod \"authorino-operator-75cc8d5cb7-bt4wd\" (UID: \"0c64aca6-02b3-4b3a-8b89-a56236f723e3\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-bt4wd"
Jul 15 15:32:36.507373 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:36.507351    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hq42q\" (UniqueName: \"kubernetes.io/projected/0c64aca6-02b3-4b3a-8b89-a56236f723e3-kube-api-access-hq42q\") pod \"authorino-operator-75cc8d5cb7-bt4wd\" (UID: \"0c64aca6-02b3-4b3a-8b89-a56236f723e3\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-bt4wd"
Jul 15 15:32:36.663988 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:36.663935    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-bt4wd"
Jul 15 15:32:36.789983 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:36.789962    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-bt4wd"]
Jul 15 15:32:36.792265 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:32:36.792239    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c64aca6_02b3_4b3a_8b89_a56236f723e3.slice/crio-0a70f54c7efc5497c48b7f01d0847d5988acdcf971658eda3614e1bdde7b3741 WatchSource:0}: Error finding container 0a70f54c7efc5497c48b7f01d0847d5988acdcf971658eda3614e1bdde7b3741: Status 404 returned error can't find the container with id 0a70f54c7efc5497c48b7f01d0847d5988acdcf971658eda3614e1bdde7b3741
Jul 15 15:32:36.918915 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:36.918845    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:32:37.002240 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:37.002209    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-bt4wd" event={"ID":"0c64aca6-02b3-4b3a-8b89-a56236f723e3","Type":"ContainerStarted","Data":"0a70f54c7efc5497c48b7f01d0847d5988acdcf971658eda3614e1bdde7b3741"}
Jul 15 15:32:37.015824 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:37.015800    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:32:37.170149 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:37.170083    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:32:39.011375 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:39.011294    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-bt4wd" event={"ID":"0c64aca6-02b3-4b3a-8b89-a56236f723e3","Type":"ContainerStarted","Data":"3be21695a427340cd1fd5929d3905687798ce19a33ad04bfae888eab0e4ba840"}
Jul 15 15:32:39.011721 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:39.011429    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-bt4wd"
Jul 15 15:32:39.033370 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:39.033325    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-bt4wd" podStartSLOduration=1.112257356 podStartE2EDuration="3.033313489s" totalImagesPullingTime="1.921056133s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:32:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:32:39.031748915 +0000 UTC m=+489.377652235" watchObservedRunningTime="2026-07-15 15:32:39.033313489 +0000 UTC m=+489.379216683"
Jul 15 15:32:39.558995 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:39.558965    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:32:41.318801 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:41.318769    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:32:41.329548 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:41.329517    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pjvsc"]
Jul 15 15:32:41.332805 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:41.332790    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pjvsc"
Jul 15 15:32:41.336259 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:41.336239    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-nsmdv\""
Jul 15 15:32:41.347023 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:41.346992    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pjvsc"]
Jul 15 15:32:41.417639 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:41.417616    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6ad7d974-c32e-435e-ae63-d60ca7bebdd8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pjvsc\" (UID: \"6ad7d974-c32e-435e-ae63-d60ca7bebdd8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pjvsc"
Jul 15 15:32:41.417752 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:41.417648    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9fg4\" (UniqueName: \"kubernetes.io/projected/6ad7d974-c32e-435e-ae63-d60ca7bebdd8-kube-api-access-f9fg4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pjvsc\" (UID: \"6ad7d974-c32e-435e-ae63-d60ca7bebdd8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pjvsc"
Jul 15 15:32:41.518361 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:41.518334    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6ad7d974-c32e-435e-ae63-d60ca7bebdd8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pjvsc\" (UID: \"6ad7d974-c32e-435e-ae63-d60ca7bebdd8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pjvsc"
Jul 15 15:32:41.518478 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:41.518367    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9fg4\" (UniqueName: \"kubernetes.io/projected/6ad7d974-c32e-435e-ae63-d60ca7bebdd8-kube-api-access-f9fg4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pjvsc\" (UID: \"6ad7d974-c32e-435e-ae63-d60ca7bebdd8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pjvsc"
Jul 15 15:32:41.518679 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:41.518662    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6ad7d974-c32e-435e-ae63-d60ca7bebdd8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pjvsc\" (UID: \"6ad7d974-c32e-435e-ae63-d60ca7bebdd8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pjvsc"
Jul 15 15:32:41.528165 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:41.528139    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9fg4\" (UniqueName: \"kubernetes.io/projected/6ad7d974-c32e-435e-ae63-d60ca7bebdd8-kube-api-access-f9fg4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pjvsc\" (UID: \"6ad7d974-c32e-435e-ae63-d60ca7bebdd8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pjvsc"
Jul 15 15:32:41.642178 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:41.642116    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pjvsc"
Jul 15 15:32:41.789864 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:41.789834    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pjvsc"]
Jul 15 15:32:41.791361 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:32:41.791338    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ad7d974_c32e_435e_ae63_d60ca7bebdd8.slice/crio-f9db3754efbd3c5a2cf86a61bf89247ed4807437428cc0a9cabd0fc18d5fa97f WatchSource:0}: Error finding container f9db3754efbd3c5a2cf86a61bf89247ed4807437428cc0a9cabd0fc18d5fa97f: Status 404 returned error can't find the container with id f9db3754efbd3c5a2cf86a61bf89247ed4807437428cc0a9cabd0fc18d5fa97f
Jul 15 15:32:42.026518 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:42.026486    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pjvsc" event={"ID":"6ad7d974-c32e-435e-ae63-d60ca7bebdd8","Type":"ContainerStarted","Data":"f9db3754efbd3c5a2cf86a61bf89247ed4807437428cc0a9cabd0fc18d5fa97f"}
Jul 15 15:32:42.504632 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:42.504552    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:32:44.513744 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:44.513703    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:32:45.997982 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:45.997950    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jjrfq"
Jul 15 15:32:46.078652 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:46.078597    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:32:46.180257 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:46.180220    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:32:48.053709 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:48.053676    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pjvsc" event={"ID":"6ad7d974-c32e-435e-ae63-d60ca7bebdd8","Type":"ContainerStarted","Data":"dc2d88cf86cb8dd222b16aa7a37f3a32b4a7dec542e34cd38aef130c4329b65e"}
Jul 15 15:32:48.054090 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:48.053808    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pjvsc"
Jul 15 15:32:48.075675 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:48.075626    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pjvsc" podStartSLOduration=1.661955064 podStartE2EDuration="7.075609361s" totalImagesPullingTime="5.413654297s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:32:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:32:48.073731977 +0000 UTC m=+498.419635168" watchObservedRunningTime="2026-07-15 15:32:48.075609361 +0000 UTC m=+498.421512553"
Jul 15 15:32:49.848651 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:49.848620    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-msb4m"]
Jul 15 15:32:49.851819 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:49.851803    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-msb4m"
Jul 15 15:32:49.854633 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:49.854612    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 15 15:32:49.854920 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:49.854902    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 15 15:32:49.855157 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:49.855144    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-7n4mz\""
Jul 15 15:32:49.861451 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:49.861400    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-msb4m"]
Jul 15 15:32:49.861596 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:49.861579    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:32:49.877113 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:49.877083    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/96e9a46a-13b8-44a4-8957-5ce949b7cb55-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-msb4m\" (UID: \"96e9a46a-13b8-44a4-8957-5ce949b7cb55\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-msb4m"
Jul 15 15:32:49.877207 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:49.877132    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/96e9a46a-13b8-44a4-8957-5ce949b7cb55-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-msb4m\" (UID: \"96e9a46a-13b8-44a4-8957-5ce949b7cb55\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-msb4m"
Jul 15 15:32:49.877207 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:49.877197    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6nkx\" (UniqueName: \"kubernetes.io/projected/96e9a46a-13b8-44a4-8957-5ce949b7cb55-kube-api-access-j6nkx\") pod \"kuadrant-console-plugin-66b5774985-msb4m\" (UID: \"96e9a46a-13b8-44a4-8957-5ce949b7cb55\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-msb4m"
Jul 15 15:32:49.955301 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:49.955256    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:32:49.978292 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:49.978268    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6nkx\" (UniqueName: \"kubernetes.io/projected/96e9a46a-13b8-44a4-8957-5ce949b7cb55-kube-api-access-j6nkx\") pod \"kuadrant-console-plugin-66b5774985-msb4m\" (UID: \"96e9a46a-13b8-44a4-8957-5ce949b7cb55\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-msb4m"
Jul 15 15:32:49.978401 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:49.978324    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/96e9a46a-13b8-44a4-8957-5ce949b7cb55-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-msb4m\" (UID: \"96e9a46a-13b8-44a4-8957-5ce949b7cb55\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-msb4m"
Jul 15 15:32:49.978401 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:49.978374    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/96e9a46a-13b8-44a4-8957-5ce949b7cb55-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-msb4m\" (UID: \"96e9a46a-13b8-44a4-8957-5ce949b7cb55\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-msb4m"
Jul 15 15:32:49.978941 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:49.978919    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/96e9a46a-13b8-44a4-8957-5ce949b7cb55-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-msb4m\" (UID: \"96e9a46a-13b8-44a4-8957-5ce949b7cb55\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-msb4m"
Jul 15 15:32:49.980736 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:49.980709    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/96e9a46a-13b8-44a4-8957-5ce949b7cb55-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-msb4m\" (UID: \"96e9a46a-13b8-44a4-8957-5ce949b7cb55\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-msb4m"
Jul 15 15:32:49.987857 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:49.987834    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6nkx\" (UniqueName: \"kubernetes.io/projected/96e9a46a-13b8-44a4-8957-5ce949b7cb55-kube-api-access-j6nkx\") pod \"kuadrant-console-plugin-66b5774985-msb4m\" (UID: \"96e9a46a-13b8-44a4-8957-5ce949b7cb55\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-msb4m"
Jul 15 15:32:50.020148 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:50.020132    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-bt4wd"
Jul 15 15:32:50.088343 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:50.088319    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:32:50.161966 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:50.161912    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-msb4m"
Jul 15 15:32:50.205515 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:50.205483    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:32:50.306353 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:50.306329    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-msb4m"]
Jul 15 15:32:50.309218 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:32:50.309193    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod96e9a46a_13b8_44a4_8957_5ce949b7cb55.slice/crio-bbf6722171d5d297ded4e4f254c5c128036bc500e1b94d89925d0131bb09c49f WatchSource:0}: Error finding container bbf6722171d5d297ded4e4f254c5c128036bc500e1b94d89925d0131bb09c49f: Status 404 returned error can't find the container with id bbf6722171d5d297ded4e4f254c5c128036bc500e1b94d89925d0131bb09c49f
Jul 15 15:32:50.541802 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:50.541776    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:32:51.068779 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:51.068744    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-msb4m" event={"ID":"96e9a46a-13b8-44a4-8957-5ce949b7cb55","Type":"ContainerStarted","Data":"bbf6722171d5d297ded4e4f254c5c128036bc500e1b94d89925d0131bb09c49f"}
Jul 15 15:32:52.631361 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:52.631276    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:32:52.731262 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:52.731230    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:32:54.535074 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:54.534985    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:32:54.610225 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:54.610165    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:32:59.060173 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:32:59.060135    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pjvsc"
Jul 15 15:33:00.925160 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:00.925124    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pjvsc"]
Jul 15 15:33:00.925705 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:00.925339    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pjvsc" podUID="6ad7d974-c32e-435e-ae63-d60ca7bebdd8" containerName="manager" containerID="cri-o://dc2d88cf86cb8dd222b16aa7a37f3a32b4a7dec542e34cd38aef130c4329b65e" gracePeriod=2
Jul 15 15:33:00.939922 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:00.939893    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pjvsc"]
Jul 15 15:33:00.945739 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:33:00.945704    2564 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"6ad7d974-c32e-435e-ae63-d60ca7bebdd8\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-pjvsc\": pods \"kuadrant-operator-controller-manager-8684c9ff49-pjvsc\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pjvsc"
Jul 15 15:33:00.950952 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:00.950923    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wstws"]
Jul 15 15:33:00.951388 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:00.951368    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ad7d974-c32e-435e-ae63-d60ca7bebdd8" containerName="manager"
Jul 15 15:33:00.951456 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:00.951391    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ad7d974-c32e-435e-ae63-d60ca7bebdd8" containerName="manager"
Jul 15 15:33:00.951516 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:00.951463    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ad7d974-c32e-435e-ae63-d60ca7bebdd8" containerName="manager"
Jul 15 15:33:00.992517 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:00.992472    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wstws"]
Jul 15 15:33:00.992672 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:00.992541    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jjrfq"]
Jul 15 15:33:00.992672 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:00.992583    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jjrfq"]
Jul 15 15:33:00.992843 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:00.992812    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jjrfq" podUID="501e3f31-5bd0-4244-984e-75d247afff12" containerName="manager" containerID="cri-o://7862fc795b43a05fb02697f12927bee72dd4094c86720a36f960892a807f2e1a" gracePeriod=2
Jul 15 15:33:00.993110 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:00.993089    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wstws"
Jul 15 15:33:01.027879 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:33:01.027846    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-jjrfq\" is forbidden: User \"system:node:ip-10-0-138-107.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-107.ec2.internal' and this object" podUID="501e3f31-5bd0-4244-984e-75d247afff12" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jjrfq"
Jul 15 15:33:01.029135 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:01.029112    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bk6sq"]
Jul 15 15:33:01.029387 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:01.029374    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="501e3f31-5bd0-4244-984e-75d247afff12" containerName="manager"
Jul 15 15:33:01.029387 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:01.029387    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="501e3f31-5bd0-4244-984e-75d247afff12" containerName="manager"
Jul 15 15:33:01.029523 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:01.029435    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="501e3f31-5bd0-4244-984e-75d247afff12" containerName="manager"
Jul 15 15:33:01.030306 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:33:01.030283    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-pjvsc\" is forbidden: User \"system:node:ip-10-0-138-107.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-107.ec2.internal' and this object" podUID="6ad7d974-c32e-435e-ae63-d60ca7bebdd8" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pjvsc"
Jul 15 15:33:01.034043 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:01.034025    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bk6sq"
Jul 15 15:33:01.035780 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:33:01.035755    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-jjrfq\" is forbidden: User \"system:node:ip-10-0-138-107.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-107.ec2.internal' and this object" podUID="501e3f31-5bd0-4244-984e-75d247afff12" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jjrfq"
Jul 15 15:33:01.038715 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:33:01.038692    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-pjvsc\" is forbidden: User \"system:node:ip-10-0-138-107.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-107.ec2.internal' and this object" podUID="6ad7d974-c32e-435e-ae63-d60ca7bebdd8" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pjvsc"
Jul 15 15:33:01.040949 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:33:01.040922    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-pjvsc\" is forbidden: User \"system:node:ip-10-0-138-107.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-107.ec2.internal' and this object" podUID="6ad7d974-c32e-435e-ae63-d60ca7bebdd8" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pjvsc"
Jul 15 15:33:01.047798 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:01.047770    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bk6sq"]
Jul 15 15:33:01.075227 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:33:01.075193    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-jjrfq\" is forbidden: User \"system:node:ip-10-0-138-107.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-107.ec2.internal' and this object" podUID="501e3f31-5bd0-4244-984e-75d247afff12" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jjrfq"
Jul 15 15:33:01.085901 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:01.085877    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zv2h\" (UniqueName: \"kubernetes.io/projected/60a117be-18a8-4b05-93d6-cfc3b0f2b0cb-kube-api-access-5zv2h\") pod \"limitador-operator-controller-manager-859d7b78bd-bk6sq\" (UID: \"60a117be-18a8-4b05-93d6-cfc3b0f2b0cb\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bk6sq"
Jul 15 15:33:01.086043 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:01.085930    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmvws\" (UniqueName: \"kubernetes.io/projected/d4fea0f2-fb69-4681-b052-14a017ec912a-kube-api-access-qmvws\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wstws\" (UID: \"d4fea0f2-fb69-4681-b052-14a017ec912a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wstws"
Jul 15 15:33:01.086043 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:01.085993    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d4fea0f2-fb69-4681-b052-14a017ec912a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wstws\" (UID: \"d4fea0f2-fb69-4681-b052-14a017ec912a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wstws"
Jul 15 15:33:01.107210 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:01.106460    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:33:01.186849 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:01.186786    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zv2h\" (UniqueName: \"kubernetes.io/projected/60a117be-18a8-4b05-93d6-cfc3b0f2b0cb-kube-api-access-5zv2h\") pod \"limitador-operator-controller-manager-859d7b78bd-bk6sq\" (UID: \"60a117be-18a8-4b05-93d6-cfc3b0f2b0cb\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bk6sq"
Jul 15 15:33:01.186849 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:01.186840    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmvws\" (UniqueName: \"kubernetes.io/projected/d4fea0f2-fb69-4681-b052-14a017ec912a-kube-api-access-qmvws\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wstws\" (UID: \"d4fea0f2-fb69-4681-b052-14a017ec912a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wstws"
Jul 15 15:33:01.187070 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:01.186890    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d4fea0f2-fb69-4681-b052-14a017ec912a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wstws\" (UID: \"d4fea0f2-fb69-4681-b052-14a017ec912a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wstws"
Jul 15 15:33:01.187286 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:01.187262    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d4fea0f2-fb69-4681-b052-14a017ec912a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wstws\" (UID: \"d4fea0f2-fb69-4681-b052-14a017ec912a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wstws"
Jul 15 15:33:01.198793 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:01.198771    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zv2h\" (UniqueName: \"kubernetes.io/projected/60a117be-18a8-4b05-93d6-cfc3b0f2b0cb-kube-api-access-5zv2h\") pod \"limitador-operator-controller-manager-859d7b78bd-bk6sq\" (UID: \"60a117be-18a8-4b05-93d6-cfc3b0f2b0cb\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bk6sq"
Jul 15 15:33:01.199890 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:01.199864    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmvws\" (UniqueName: \"kubernetes.io/projected/d4fea0f2-fb69-4681-b052-14a017ec912a-kube-api-access-qmvws\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wstws\" (UID: \"d4fea0f2-fb69-4681-b052-14a017ec912a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wstws"
Jul 15 15:33:01.206031 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:01.205964    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:33:01.393500 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:01.393464    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wstws"
Jul 15 15:33:01.400984 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:01.400942    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bk6sq"
Jul 15 15:33:05.395512 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:05.395480    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:33:05.502045 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:05.501987    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:33:09.161787 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:09.161752    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:33:09.228301 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:09.228271    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:33:09.376819 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:09.376784    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:33:09.447814 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:09.447733    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:33:10.883488 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:10.883464    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pjvsc"
Jul 15 15:33:10.885745 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:33:10.885709    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-pjvsc\" is forbidden: User \"system:node:ip-10-0-138-107.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-107.ec2.internal' and this object" podUID="6ad7d974-c32e-435e-ae63-d60ca7bebdd8" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pjvsc"
Jul 15 15:33:10.888193 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:10.888170    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jjrfq"
Jul 15 15:33:10.890692 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:33:10.890666    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-pjvsc\" is forbidden: User \"system:node:ip-10-0-138-107.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-107.ec2.internal' and this object" podUID="6ad7d974-c32e-435e-ae63-d60ca7bebdd8" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pjvsc"
Jul 15 15:33:10.894060 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:33:10.894032    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-jjrfq\" is forbidden: User \"system:node:ip-10-0-138-107.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-107.ec2.internal' and this object" podUID="501e3f31-5bd0-4244-984e-75d247afff12" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jjrfq"
Jul 15 15:33:10.900256 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:10.900226    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bk6sq"]
Jul 15 15:33:10.905389 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:33:10.905366    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60a117be_18a8_4b05_93d6_cfc3b0f2b0cb.slice/crio-1dcf8a2719a0d4501229c78e0bdb4561f00bbac0513003d625d7261f7516e92f WatchSource:0}: Error finding container 1dcf8a2719a0d4501229c78e0bdb4561f00bbac0513003d625d7261f7516e92f: Status 404 returned error can't find the container with id 1dcf8a2719a0d4501229c78e0bdb4561f00bbac0513003d625d7261f7516e92f
Jul 15 15:33:10.931760 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:10.931736    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wstws"]
Jul 15 15:33:10.937046 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:33:10.937019    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4fea0f2_fb69_4681_b052_14a017ec912a.slice/crio-a0deb214b420f53e24e73851ce53f288df9e0f05d3d680f00e174ffbd362f392 WatchSource:0}: Error finding container a0deb214b420f53e24e73851ce53f288df9e0f05d3d680f00e174ffbd362f392: Status 404 returned error can't find the container with id a0deb214b420f53e24e73851ce53f288df9e0f05d3d680f00e174ffbd362f392
Jul 15 15:33:10.977308 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:10.977285    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6ad7d974-c32e-435e-ae63-d60ca7bebdd8-extensions-socket-volume\") pod \"6ad7d974-c32e-435e-ae63-d60ca7bebdd8\" (UID: \"6ad7d974-c32e-435e-ae63-d60ca7bebdd8\") "
Jul 15 15:33:10.977391 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:10.977337    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f9fg4\" (UniqueName: \"kubernetes.io/projected/6ad7d974-c32e-435e-ae63-d60ca7bebdd8-kube-api-access-f9fg4\") pod \"6ad7d974-c32e-435e-ae63-d60ca7bebdd8\" (UID: \"6ad7d974-c32e-435e-ae63-d60ca7bebdd8\") "
Jul 15 15:33:10.977391 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:10.977372    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6nk5b\" (UniqueName: \"kubernetes.io/projected/501e3f31-5bd0-4244-984e-75d247afff12-kube-api-access-6nk5b\") pod \"501e3f31-5bd0-4244-984e-75d247afff12\" (UID: \"501e3f31-5bd0-4244-984e-75d247afff12\") "
Jul 15 15:33:10.977791 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:10.977762    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ad7d974-c32e-435e-ae63-d60ca7bebdd8-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6ad7d974-c32e-435e-ae63-d60ca7bebdd8" (UID: "6ad7d974-c32e-435e-ae63-d60ca7bebdd8"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:33:10.979453 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:10.979412    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ad7d974-c32e-435e-ae63-d60ca7bebdd8-kube-api-access-f9fg4" (OuterVolumeSpecName: "kube-api-access-f9fg4") pod "6ad7d974-c32e-435e-ae63-d60ca7bebdd8" (UID: "6ad7d974-c32e-435e-ae63-d60ca7bebdd8"). InnerVolumeSpecName "kube-api-access-f9fg4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:33:10.979838 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:10.979811    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/501e3f31-5bd0-4244-984e-75d247afff12-kube-api-access-6nk5b" (OuterVolumeSpecName: "kube-api-access-6nk5b") pod "501e3f31-5bd0-4244-984e-75d247afff12" (UID: "501e3f31-5bd0-4244-984e-75d247afff12"). InnerVolumeSpecName "kube-api-access-6nk5b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:33:11.078351 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:11.078321    2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6ad7d974-c32e-435e-ae63-d60ca7bebdd8-extensions-socket-volume\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 15:33:11.078351 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:11.078347    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f9fg4\" (UniqueName: \"kubernetes.io/projected/6ad7d974-c32e-435e-ae63-d60ca7bebdd8-kube-api-access-f9fg4\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 15:33:11.078351 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:11.078357    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6nk5b\" (UniqueName: \"kubernetes.io/projected/501e3f31-5bd0-4244-984e-75d247afff12-kube-api-access-6nk5b\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 15:33:11.167531 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:11.167496    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bk6sq" event={"ID":"60a117be-18a8-4b05-93d6-cfc3b0f2b0cb","Type":"ContainerStarted","Data":"734cbd52a0008c6be848b98040c539df889cd20fd8778419ea9a58b00e730736"}
Jul 15 15:33:11.167722 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:11.167560    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bk6sq" event={"ID":"60a117be-18a8-4b05-93d6-cfc3b0f2b0cb","Type":"ContainerStarted","Data":"1dcf8a2719a0d4501229c78e0bdb4561f00bbac0513003d625d7261f7516e92f"}
Jul 15 15:33:11.167722 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:11.167638    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bk6sq"
Jul 15 15:33:11.169260 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:11.169240    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wstws" event={"ID":"d4fea0f2-fb69-4681-b052-14a017ec912a","Type":"ContainerStarted","Data":"4c832c381eba83ff5f9ac652d47783d991b44bd2e0718fc7d93450b4ee23cc97"}
Jul 15 15:33:11.169378 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:11.169272    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wstws" event={"ID":"d4fea0f2-fb69-4681-b052-14a017ec912a","Type":"ContainerStarted","Data":"a0deb214b420f53e24e73851ce53f288df9e0f05d3d680f00e174ffbd362f392"}
Jul 15 15:33:11.169378 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:11.169309    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wstws"
Jul 15 15:33:11.170021 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:33:11.169985    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-jjrfq\" is forbidden: User \"system:node:ip-10-0-138-107.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-107.ec2.internal' and this object" podUID="501e3f31-5bd0-4244-984e-75d247afff12" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jjrfq"
Jul 15 15:33:11.170487 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:11.170469    2564 generic.go:356] "Generic (PLEG): container finished" podID="6ad7d974-c32e-435e-ae63-d60ca7bebdd8" containerID="dc2d88cf86cb8dd222b16aa7a37f3a32b4a7dec542e34cd38aef130c4329b65e" exitCode=0
Jul 15 15:33:11.170560 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:11.170500    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pjvsc"
Jul 15 15:33:11.170560 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:11.170541    2564 scope.go:117] "RemoveContainer" containerID="dc2d88cf86cb8dd222b16aa7a37f3a32b4a7dec542e34cd38aef130c4329b65e"
Jul 15 15:33:11.171913 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:11.171891    2564 generic.go:356] "Generic (PLEG): container finished" podID="501e3f31-5bd0-4244-984e-75d247afff12" containerID="7862fc795b43a05fb02697f12927bee72dd4094c86720a36f960892a807f2e1a" exitCode=0
Jul 15 15:33:11.172030 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:11.171944    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jjrfq"
Jul 15 15:33:11.172030 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:33:11.171952    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-pjvsc\" is forbidden: User \"system:node:ip-10-0-138-107.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-107.ec2.internal' and this object" podUID="6ad7d974-c32e-435e-ae63-d60ca7bebdd8" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pjvsc"
Jul 15 15:33:11.182546 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:11.182402    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-msb4m" event={"ID":"96e9a46a-13b8-44a4-8957-5ce949b7cb55","Type":"ContainerStarted","Data":"cf7660ee63d0f77da0b959e91bf3958fb8579caa9d8678e6d9a979b8f4eada5c"}
Jul 15 15:33:11.184447 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:11.184429    2564 scope.go:117] "RemoveContainer" containerID="dc2d88cf86cb8dd222b16aa7a37f3a32b4a7dec542e34cd38aef130c4329b65e"
Jul 15 15:33:11.184745 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:33:11.184719    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc2d88cf86cb8dd222b16aa7a37f3a32b4a7dec542e34cd38aef130c4329b65e\": container with ID starting with dc2d88cf86cb8dd222b16aa7a37f3a32b4a7dec542e34cd38aef130c4329b65e not found: ID does not exist" containerID="dc2d88cf86cb8dd222b16aa7a37f3a32b4a7dec542e34cd38aef130c4329b65e"
Jul 15 15:33:11.184818 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:11.184758    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc2d88cf86cb8dd222b16aa7a37f3a32b4a7dec542e34cd38aef130c4329b65e"} err="failed to get container status \"dc2d88cf86cb8dd222b16aa7a37f3a32b4a7dec542e34cd38aef130c4329b65e\": rpc error: code = NotFound desc = could not find container \"dc2d88cf86cb8dd222b16aa7a37f3a32b4a7dec542e34cd38aef130c4329b65e\": container with ID starting with dc2d88cf86cb8dd222b16aa7a37f3a32b4a7dec542e34cd38aef130c4329b65e not found: ID does not exist"
Jul 15 15:33:11.184818 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:11.184781    2564 scope.go:117] "RemoveContainer" containerID="7862fc795b43a05fb02697f12927bee72dd4094c86720a36f960892a807f2e1a"
Jul 15 15:33:11.195411 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:11.195396    2564 scope.go:117] "RemoveContainer" containerID="7862fc795b43a05fb02697f12927bee72dd4094c86720a36f960892a807f2e1a"
Jul 15 15:33:11.195636 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:33:11.195620    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7862fc795b43a05fb02697f12927bee72dd4094c86720a36f960892a807f2e1a\": container with ID starting with 7862fc795b43a05fb02697f12927bee72dd4094c86720a36f960892a807f2e1a not found: ID does not exist" containerID="7862fc795b43a05fb02697f12927bee72dd4094c86720a36f960892a807f2e1a"
Jul 15 15:33:11.195681 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:11.195642    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7862fc795b43a05fb02697f12927bee72dd4094c86720a36f960892a807f2e1a"} err="failed to get container status \"7862fc795b43a05fb02697f12927bee72dd4094c86720a36f960892a807f2e1a\": rpc error: code = NotFound desc = could not find container \"7862fc795b43a05fb02697f12927bee72dd4094c86720a36f960892a807f2e1a\": container with ID starting with 7862fc795b43a05fb02697f12927bee72dd4094c86720a36f960892a807f2e1a not found: ID does not exist"
Jul 15 15:33:11.198045 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:11.197978    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bk6sq" podStartSLOduration=11.197966268 podStartE2EDuration="11.197966268s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:33:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:33:11.196465324 +0000 UTC m=+521.542368530" watchObservedRunningTime="2026-07-15 15:33:11.197966268 +0000 UTC m=+521.543869461"
Jul 15 15:33:11.215685 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:11.215646    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-msb4m" podStartSLOduration=1.741993961 podStartE2EDuration="22.21563632s" totalImagesPullingTime="20.473642359s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:32:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:33:11.214826985 +0000 UTC m=+521.560730179" watchObservedRunningTime="2026-07-15 15:33:11.21563632 +0000 UTC m=+521.561539512"
Jul 15 15:33:11.234380 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:11.234314    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wstws" podStartSLOduration=11.234303317 podStartE2EDuration="11.234303317s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:33:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:33:11.232469605 +0000 UTC m=+521.578372799" watchObservedRunningTime="2026-07-15 15:33:11.234303317 +0000 UTC m=+521.580206510"
Jul 15 15:33:11.235083 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:33:11.235057    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-jjrfq\" is forbidden: User \"system:node:ip-10-0-138-107.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-107.ec2.internal' and this object" podUID="501e3f31-5bd0-4244-984e-75d247afff12" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jjrfq"
Jul 15 15:33:11.237061 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:33:11.237038    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-pjvsc\" is forbidden: User \"system:node:ip-10-0-138-107.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-107.ec2.internal' and this object" podUID="6ad7d974-c32e-435e-ae63-d60ca7bebdd8" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pjvsc"
Jul 15 15:33:12.228718 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:12.228689    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="501e3f31-5bd0-4244-984e-75d247afff12" path="/var/lib/kubelet/pods/501e3f31-5bd0-4244-984e-75d247afff12/volumes"
Jul 15 15:33:12.229187 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:12.229035    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ad7d974-c32e-435e-ae63-d60ca7bebdd8" path="/var/lib/kubelet/pods/6ad7d974-c32e-435e-ae63-d60ca7bebdd8/volumes"
Jul 15 15:33:14.376625 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:14.376589    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:33:14.491512 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:14.491476    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:33:18.309215 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:18.309180    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wstws"]
Jul 15 15:33:18.309577 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:18.309370    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wstws" podUID="d4fea0f2-fb69-4681-b052-14a017ec912a" containerName="manager" containerID="cri-o://4c832c381eba83ff5f9ac652d47783d991b44bd2e0718fc7d93450b4ee23cc97" gracePeriod=10
Jul 15 15:33:18.311204 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:18.311176    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wstws"
Jul 15 15:33:18.542489 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:18.542467    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wstws"
Jul 15 15:33:18.637710 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:18.637655    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qmvws\" (UniqueName: \"kubernetes.io/projected/d4fea0f2-fb69-4681-b052-14a017ec912a-kube-api-access-qmvws\") pod \"d4fea0f2-fb69-4681-b052-14a017ec912a\" (UID: \"d4fea0f2-fb69-4681-b052-14a017ec912a\") "
Jul 15 15:33:18.637710 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:18.637693    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d4fea0f2-fb69-4681-b052-14a017ec912a-extensions-socket-volume\") pod \"d4fea0f2-fb69-4681-b052-14a017ec912a\" (UID: \"d4fea0f2-fb69-4681-b052-14a017ec912a\") "
Jul 15 15:33:18.638110 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:18.638088    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4fea0f2-fb69-4681-b052-14a017ec912a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d4fea0f2-fb69-4681-b052-14a017ec912a" (UID: "d4fea0f2-fb69-4681-b052-14a017ec912a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:33:18.639665 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:18.639641    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4fea0f2-fb69-4681-b052-14a017ec912a-kube-api-access-qmvws" (OuterVolumeSpecName: "kube-api-access-qmvws") pod "d4fea0f2-fb69-4681-b052-14a017ec912a" (UID: "d4fea0f2-fb69-4681-b052-14a017ec912a"). InnerVolumeSpecName "kube-api-access-qmvws". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:33:18.738848 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:18.738823    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qmvws\" (UniqueName: \"kubernetes.io/projected/d4fea0f2-fb69-4681-b052-14a017ec912a-kube-api-access-qmvws\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 15:33:18.738848 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:18.738845    2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d4fea0f2-fb69-4681-b052-14a017ec912a-extensions-socket-volume\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 15:33:19.219892 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:19.219856    2564 generic.go:356] "Generic (PLEG): container finished" podID="d4fea0f2-fb69-4681-b052-14a017ec912a" containerID="4c832c381eba83ff5f9ac652d47783d991b44bd2e0718fc7d93450b4ee23cc97" exitCode=0
Jul 15 15:33:19.220116 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:19.219904    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wstws"
Jul 15 15:33:19.220116 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:19.219947    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wstws" event={"ID":"d4fea0f2-fb69-4681-b052-14a017ec912a","Type":"ContainerDied","Data":"4c832c381eba83ff5f9ac652d47783d991b44bd2e0718fc7d93450b4ee23cc97"}
Jul 15 15:33:19.220116 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:19.220000    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wstws" event={"ID":"d4fea0f2-fb69-4681-b052-14a017ec912a","Type":"ContainerDied","Data":"a0deb214b420f53e24e73851ce53f288df9e0f05d3d680f00e174ffbd362f392"}
Jul 15 15:33:19.220116 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:19.220052    2564 scope.go:117] "RemoveContainer" containerID="4c832c381eba83ff5f9ac652d47783d991b44bd2e0718fc7d93450b4ee23cc97"
Jul 15 15:33:19.228871 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:19.228848    2564 scope.go:117] "RemoveContainer" containerID="4c832c381eba83ff5f9ac652d47783d991b44bd2e0718fc7d93450b4ee23cc97"
Jul 15 15:33:19.229195 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:33:19.229173    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c832c381eba83ff5f9ac652d47783d991b44bd2e0718fc7d93450b4ee23cc97\": container with ID starting with 4c832c381eba83ff5f9ac652d47783d991b44bd2e0718fc7d93450b4ee23cc97 not found: ID does not exist" containerID="4c832c381eba83ff5f9ac652d47783d991b44bd2e0718fc7d93450b4ee23cc97"
Jul 15 15:33:19.229266 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:19.229204    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c832c381eba83ff5f9ac652d47783d991b44bd2e0718fc7d93450b4ee23cc97"} err="failed to get container status \"4c832c381eba83ff5f9ac652d47783d991b44bd2e0718fc7d93450b4ee23cc97\": rpc error: code = NotFound desc = could not find container \"4c832c381eba83ff5f9ac652d47783d991b44bd2e0718fc7d93450b4ee23cc97\": container with ID starting with 4c832c381eba83ff5f9ac652d47783d991b44bd2e0718fc7d93450b4ee23cc97 not found: ID does not exist"
Jul 15 15:33:19.257796 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:19.257770    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wstws"]
Jul 15 15:33:19.263477 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:19.263455    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wstws"]
Jul 15 15:33:19.895672 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:19.895635    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:33:19.992917 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:19.992885    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:33:20.227885 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:20.227814    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4fea0f2-fb69-4681-b052-14a017ec912a" path="/var/lib/kubelet/pods/d4fea0f2-fb69-4681-b052-14a017ec912a/volumes"
Jul 15 15:33:22.190991 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:22.190918    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bk6sq"
Jul 15 15:33:22.827724 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:22.827691    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:33:22.931530 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:22.931502    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:33:28.695745 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:28.695715    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:33:28.801093 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:28.801059    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:33:34.785252 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:34.785208    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cvc9d"]
Jul 15 15:33:34.785761 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:34.785670    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4fea0f2-fb69-4681-b052-14a017ec912a" containerName="manager"
Jul 15 15:33:34.785761 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:34.785689    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4fea0f2-fb69-4681-b052-14a017ec912a" containerName="manager"
Jul 15 15:33:34.785872 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:34.785770    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4fea0f2-fb69-4681-b052-14a017ec912a" containerName="manager"
Jul 15 15:33:34.828681 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:34.828642    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:33:34.947638 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:34.947600    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cvc9d"]
Jul 15 15:33:34.947802 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:34.947722    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cvc9d"
Jul 15 15:33:34.950737 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:34.950719    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 15 15:33:34.950737 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:34.950729    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-fvl2v\""
Jul 15 15:33:34.957637 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:34.957610    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6305fffd-77fc-4b0f-8ea3-1cac9f591cf6-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-cvc9d\" (UID: \"6305fffd-77fc-4b0f-8ea3-1cac9f591cf6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cvc9d"
Jul 15 15:33:34.957721 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:34.957651    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6305fffd-77fc-4b0f-8ea3-1cac9f591cf6-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-cvc9d\" (UID: \"6305fffd-77fc-4b0f-8ea3-1cac9f591cf6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cvc9d"
Jul 15 15:33:34.957721 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:34.957677    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6305fffd-77fc-4b0f-8ea3-1cac9f591cf6-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-cvc9d\" (UID: \"6305fffd-77fc-4b0f-8ea3-1cac9f591cf6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cvc9d"
Jul 15 15:33:34.957794 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:34.957740    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6305fffd-77fc-4b0f-8ea3-1cac9f591cf6-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-cvc9d\" (UID: \"6305fffd-77fc-4b0f-8ea3-1cac9f591cf6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cvc9d"
Jul 15 15:33:34.957794 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:34.957773    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6305fffd-77fc-4b0f-8ea3-1cac9f591cf6-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-cvc9d\" (UID: \"6305fffd-77fc-4b0f-8ea3-1cac9f591cf6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cvc9d"
Jul 15 15:33:34.957857 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:34.957815    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6305fffd-77fc-4b0f-8ea3-1cac9f591cf6-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-cvc9d\" (UID: \"6305fffd-77fc-4b0f-8ea3-1cac9f591cf6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cvc9d"
Jul 15 15:33:34.957857 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:34.957843    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6305fffd-77fc-4b0f-8ea3-1cac9f591cf6-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-cvc9d\" (UID: \"6305fffd-77fc-4b0f-8ea3-1cac9f591cf6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cvc9d"
Jul 15 15:33:34.957920 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:34.957884    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6305fffd-77fc-4b0f-8ea3-1cac9f591cf6-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-cvc9d\" (UID: \"6305fffd-77fc-4b0f-8ea3-1cac9f591cf6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cvc9d"
Jul 15 15:33:34.957920 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:34.957913    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8mn6\" (UniqueName: \"kubernetes.io/projected/6305fffd-77fc-4b0f-8ea3-1cac9f591cf6-kube-api-access-j8mn6\") pod \"maas-default-gateway-openshift-default-56654dcf7-cvc9d\" (UID: \"6305fffd-77fc-4b0f-8ea3-1cac9f591cf6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cvc9d"
Jul 15 15:33:35.058336 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:35.058273    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6305fffd-77fc-4b0f-8ea3-1cac9f591cf6-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-cvc9d\" (UID: \"6305fffd-77fc-4b0f-8ea3-1cac9f591cf6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cvc9d"
Jul 15 15:33:35.058336 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:35.058311    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6305fffd-77fc-4b0f-8ea3-1cac9f591cf6-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-cvc9d\" (UID: \"6305fffd-77fc-4b0f-8ea3-1cac9f591cf6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cvc9d"
Jul 15 15:33:35.058336 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:35.058330    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8mn6\" (UniqueName: \"kubernetes.io/projected/6305fffd-77fc-4b0f-8ea3-1cac9f591cf6-kube-api-access-j8mn6\") pod \"maas-default-gateway-openshift-default-56654dcf7-cvc9d\" (UID: \"6305fffd-77fc-4b0f-8ea3-1cac9f591cf6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cvc9d"
Jul 15 15:33:35.058582 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:35.058353    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6305fffd-77fc-4b0f-8ea3-1cac9f591cf6-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-cvc9d\" (UID: \"6305fffd-77fc-4b0f-8ea3-1cac9f591cf6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cvc9d"
Jul 15 15:33:35.058582 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:35.058378    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6305fffd-77fc-4b0f-8ea3-1cac9f591cf6-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-cvc9d\" (UID: \"6305fffd-77fc-4b0f-8ea3-1cac9f591cf6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cvc9d"
Jul 15 15:33:35.058582 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:35.058402    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6305fffd-77fc-4b0f-8ea3-1cac9f591cf6-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-cvc9d\" (UID: \"6305fffd-77fc-4b0f-8ea3-1cac9f591cf6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cvc9d"
Jul 15 15:33:35.058582 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:35.058440    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6305fffd-77fc-4b0f-8ea3-1cac9f591cf6-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-cvc9d\" (UID: \"6305fffd-77fc-4b0f-8ea3-1cac9f591cf6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cvc9d"
Jul 15 15:33:35.058582 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:35.058470    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6305fffd-77fc-4b0f-8ea3-1cac9f591cf6-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-cvc9d\" (UID: \"6305fffd-77fc-4b0f-8ea3-1cac9f591cf6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cvc9d"
Jul 15 15:33:35.058582 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:35.058517    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6305fffd-77fc-4b0f-8ea3-1cac9f591cf6-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-cvc9d\" (UID: \"6305fffd-77fc-4b0f-8ea3-1cac9f591cf6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cvc9d"
Jul 15 15:33:35.058969 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:35.058851    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6305fffd-77fc-4b0f-8ea3-1cac9f591cf6-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-cvc9d\" (UID: \"6305fffd-77fc-4b0f-8ea3-1cac9f591cf6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cvc9d"
Jul 15 15:33:35.059047 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:35.058972    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6305fffd-77fc-4b0f-8ea3-1cac9f591cf6-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-cvc9d\" (UID: \"6305fffd-77fc-4b0f-8ea3-1cac9f591cf6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cvc9d"
Jul 15 15:33:35.059100 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:35.059074    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6305fffd-77fc-4b0f-8ea3-1cac9f591cf6-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-cvc9d\" (UID: \"6305fffd-77fc-4b0f-8ea3-1cac9f591cf6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cvc9d"
Jul 15 15:33:35.059158 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:35.059140    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6305fffd-77fc-4b0f-8ea3-1cac9f591cf6-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-cvc9d\" (UID: \"6305fffd-77fc-4b0f-8ea3-1cac9f591cf6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cvc9d"
Jul 15 15:33:35.059242 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:35.059223    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6305fffd-77fc-4b0f-8ea3-1cac9f591cf6-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-cvc9d\" (UID: \"6305fffd-77fc-4b0f-8ea3-1cac9f591cf6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cvc9d"
Jul 15 15:33:35.060938 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:35.060913    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6305fffd-77fc-4b0f-8ea3-1cac9f591cf6-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-cvc9d\" (UID: \"6305fffd-77fc-4b0f-8ea3-1cac9f591cf6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cvc9d"
Jul 15 15:33:35.061121 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:35.061103    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6305fffd-77fc-4b0f-8ea3-1cac9f591cf6-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-cvc9d\" (UID: \"6305fffd-77fc-4b0f-8ea3-1cac9f591cf6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cvc9d"
Jul 15 15:33:35.066728 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:35.066709    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6305fffd-77fc-4b0f-8ea3-1cac9f591cf6-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-cvc9d\" (UID: \"6305fffd-77fc-4b0f-8ea3-1cac9f591cf6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cvc9d"
Jul 15 15:33:35.066808 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:35.066729    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8mn6\" (UniqueName: \"kubernetes.io/projected/6305fffd-77fc-4b0f-8ea3-1cac9f591cf6-kube-api-access-j8mn6\") pod \"maas-default-gateway-openshift-default-56654dcf7-cvc9d\" (UID: \"6305fffd-77fc-4b0f-8ea3-1cac9f591cf6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cvc9d"
Jul 15 15:33:35.126090 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:35.126053    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:33:35.258413 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:35.258376    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cvc9d"
Jul 15 15:33:35.420804 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:35.420778    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cvc9d"]
Jul 15 15:33:35.423046 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:33:35.422995    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6305fffd_77fc_4b0f_8ea3_1cac9f591cf6.slice/crio-96380f8cb6fcef0ac4b8b880cd23053f91b2cb4ccf59d054d57f00b65efddcf4 WatchSource:0}: Error finding container 96380f8cb6fcef0ac4b8b880cd23053f91b2cb4ccf59d054d57f00b65efddcf4: Status 404 returned error can't find the container with id 96380f8cb6fcef0ac4b8b880cd23053f91b2cb4ccf59d054d57f00b65efddcf4
Jul 15 15:33:36.284878 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:36.284847    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cvc9d" event={"ID":"6305fffd-77fc-4b0f-8ea3-1cac9f591cf6","Type":"ContainerStarted","Data":"96380f8cb6fcef0ac4b8b880cd23053f91b2cb4ccf59d054d57f00b65efddcf4"}
Jul 15 15:33:39.952842 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:39.952806    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 15:33:39.953191 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:39.952877    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 15:33:39.953191 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:39.952903    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 15:33:40.303895 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:40.303856    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cvc9d" event={"ID":"6305fffd-77fc-4b0f-8ea3-1cac9f591cf6","Type":"ContainerStarted","Data":"97714cf057b3818dfe77a9dc1232f7517f411d6f120620580255e50e20c3e7de"}
Jul 15 15:33:40.324434 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:40.324386    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cvc9d" podStartSLOduration=1.7972211470000001 podStartE2EDuration="6.324370515s" totalImagesPullingTime="4.527149368s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:33:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:33:40.32295939 +0000 UTC m=+550.668862585" watchObservedRunningTime="2026-07-15 15:33:40.324370515 +0000 UTC m=+550.670273706"
Jul 15 15:33:41.258857 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:41.258825    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cvc9d"
Jul 15 15:33:41.263721 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:41.263698    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cvc9d"
Jul 15 15:33:41.307624 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:41.307594    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cvc9d"
Jul 15 15:33:41.308573 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:41.308554    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cvc9d"
Jul 15 15:33:41.379886 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:41.379856    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:33:41.382954 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:41.382931    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-26ml4"]
Jul 15 15:33:41.444661 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:41.444630    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-26ml4"]
Jul 15 15:33:41.445099 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:41.444774    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-26ml4"
Jul 15 15:33:41.447425 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:41.447401    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 15 15:33:41.487870 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:41.487838    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-26ml4"]
Jul 15 15:33:41.505186 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:41.505162    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3325783f-3052-4183-b285-8faef61f8a13-config-file\") pod \"limitador-limitador-64c94fd64f-26ml4\" (UID: \"3325783f-3052-4183-b285-8faef61f8a13\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-26ml4"
Jul 15 15:33:41.505319 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:41.505192    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9x72\" (UniqueName: \"kubernetes.io/projected/3325783f-3052-4183-b285-8faef61f8a13-kube-api-access-v9x72\") pod \"limitador-limitador-64c94fd64f-26ml4\" (UID: \"3325783f-3052-4183-b285-8faef61f8a13\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-26ml4"
Jul 15 15:33:41.512548 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:41.512475    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:33:41.605713 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:41.605678    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3325783f-3052-4183-b285-8faef61f8a13-config-file\") pod \"limitador-limitador-64c94fd64f-26ml4\" (UID: \"3325783f-3052-4183-b285-8faef61f8a13\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-26ml4"
Jul 15 15:33:41.605713 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:41.605717    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9x72\" (UniqueName: \"kubernetes.io/projected/3325783f-3052-4183-b285-8faef61f8a13-kube-api-access-v9x72\") pod \"limitador-limitador-64c94fd64f-26ml4\" (UID: \"3325783f-3052-4183-b285-8faef61f8a13\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-26ml4"
Jul 15 15:33:41.606387 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:41.606367    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3325783f-3052-4183-b285-8faef61f8a13-config-file\") pod \"limitador-limitador-64c94fd64f-26ml4\" (UID: \"3325783f-3052-4183-b285-8faef61f8a13\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-26ml4"
Jul 15 15:33:41.612468 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:41.612445    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:33:41.614133 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:41.614110    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9x72\" (UniqueName: \"kubernetes.io/projected/3325783f-3052-4183-b285-8faef61f8a13-kube-api-access-v9x72\") pod \"limitador-limitador-64c94fd64f-26ml4\" (UID: \"3325783f-3052-4183-b285-8faef61f8a13\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-26ml4"
Jul 15 15:33:41.756709 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:41.756662    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-26ml4"
Jul 15 15:33:41.907936 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:41.907723    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-26ml4"]
Jul 15 15:33:41.910622 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:33:41.910591    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3325783f_3052_4183_b285_8faef61f8a13.slice/crio-d9ca7cb7fe8b64aa82cead767d6184259f42eff9aa8be01470d4d62a2f917b73 WatchSource:0}: Error finding container d9ca7cb7fe8b64aa82cead767d6184259f42eff9aa8be01470d4d62a2f917b73: Status 404 returned error can't find the container with id d9ca7cb7fe8b64aa82cead767d6184259f42eff9aa8be01470d4d62a2f917b73
Jul 15 15:33:42.192881 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:42.192794    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-phxr7"]
Jul 15 15:33:42.222186 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:42.222152    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-phxr7"]
Jul 15 15:33:42.222361 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:42.222274    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-phxr7"
Jul 15 15:33:42.224814 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:42.224796    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-dwnh6\""
Jul 15 15:33:42.242797 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:42.242775    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:33:42.308781 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:42.308737    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kn9r\" (UniqueName: \"kubernetes.io/projected/e0559db0-acc1-4bfa-81b3-240741d36f7b-kube-api-access-2kn9r\") pod \"authorino-58cd955675-phxr7\" (UID: \"e0559db0-acc1-4bfa-81b3-240741d36f7b\") " pod="kuadrant-system/authorino-58cd955675-phxr7"
Jul 15 15:33:42.312490 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:42.312456    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:33:42.313504 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:42.313482    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-26ml4" event={"ID":"3325783f-3052-4183-b285-8faef61f8a13","Type":"ContainerStarted","Data":"d9ca7cb7fe8b64aa82cead767d6184259f42eff9aa8be01470d4d62a2f917b73"}
Jul 15 15:33:42.395948 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:42.395873    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-mnhj9"]
Jul 15 15:33:42.401217 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:42.401193    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-mnhj9"
Jul 15 15:33:42.403858 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:42.403830    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-mnhj9"]
Jul 15 15:33:42.409290 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:42.409261    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvzth\" (UniqueName: \"kubernetes.io/projected/c0eb252c-52eb-4991-97fc-f15cc24a2db0-kube-api-access-bvzth\") pod \"authorino-75d556bd77-mnhj9\" (UID: \"c0eb252c-52eb-4991-97fc-f15cc24a2db0\") " pod="kuadrant-system/authorino-75d556bd77-mnhj9"
Jul 15 15:33:42.409412 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:42.409315    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kn9r\" (UniqueName: \"kubernetes.io/projected/e0559db0-acc1-4bfa-81b3-240741d36f7b-kube-api-access-2kn9r\") pod \"authorino-58cd955675-phxr7\" (UID: \"e0559db0-acc1-4bfa-81b3-240741d36f7b\") " pod="kuadrant-system/authorino-58cd955675-phxr7"
Jul 15 15:33:42.422200 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:42.422178    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kn9r\" (UniqueName: \"kubernetes.io/projected/e0559db0-acc1-4bfa-81b3-240741d36f7b-kube-api-access-2kn9r\") pod \"authorino-58cd955675-phxr7\" (UID: \"e0559db0-acc1-4bfa-81b3-240741d36f7b\") " pod="kuadrant-system/authorino-58cd955675-phxr7"
Jul 15 15:33:42.510577 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:42.510501    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvzth\" (UniqueName: \"kubernetes.io/projected/c0eb252c-52eb-4991-97fc-f15cc24a2db0-kube-api-access-bvzth\") pod \"authorino-75d556bd77-mnhj9\" (UID: \"c0eb252c-52eb-4991-97fc-f15cc24a2db0\") " pod="kuadrant-system/authorino-75d556bd77-mnhj9"
Jul 15 15:33:42.519587 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:42.519531    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvzth\" (UniqueName: \"kubernetes.io/projected/c0eb252c-52eb-4991-97fc-f15cc24a2db0-kube-api-access-bvzth\") pod \"authorino-75d556bd77-mnhj9\" (UID: \"c0eb252c-52eb-4991-97fc-f15cc24a2db0\") " pod="kuadrant-system/authorino-75d556bd77-mnhj9"
Jul 15 15:33:42.532161 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:42.532110    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-phxr7"
Jul 15 15:33:42.712323 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:42.712270    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-mnhj9"
Jul 15 15:33:42.714762 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:42.714738    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-phxr7"]
Jul 15 15:33:42.718089 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:33:42.718056    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode0559db0_acc1_4bfa_81b3_240741d36f7b.slice/crio-52133a6dd82ec716d77c3cf1876d99125e2e48953360eebd5059dbac039185bd WatchSource:0}: Error finding container 52133a6dd82ec716d77c3cf1876d99125e2e48953360eebd5059dbac039185bd: Status 404 returned error can't find the container with id 52133a6dd82ec716d77c3cf1876d99125e2e48953360eebd5059dbac039185bd
Jul 15 15:33:42.895635 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:42.895078    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-mnhj9"]
Jul 15 15:33:42.898581 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:33:42.898459    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc0eb252c_52eb_4991_97fc_f15cc24a2db0.slice/crio-a9219241ce52674aaf1ac520ef2e096081233f87f46fbc615cec4817b86795fa WatchSource:0}: Error finding container a9219241ce52674aaf1ac520ef2e096081233f87f46fbc615cec4817b86795fa: Status 404 returned error can't find the container with id a9219241ce52674aaf1ac520ef2e096081233f87f46fbc615cec4817b86795fa
Jul 15 15:33:43.320922 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:43.320866    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-mnhj9" event={"ID":"c0eb252c-52eb-4991-97fc-f15cc24a2db0","Type":"ContainerStarted","Data":"a9219241ce52674aaf1ac520ef2e096081233f87f46fbc615cec4817b86795fa"}
Jul 15 15:33:43.322655 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:43.322607    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-phxr7" event={"ID":"e0559db0-acc1-4bfa-81b3-240741d36f7b","Type":"ContainerStarted","Data":"52133a6dd82ec716d77c3cf1876d99125e2e48953360eebd5059dbac039185bd"}
Jul 15 15:33:47.350293 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:47.350210    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-26ml4" event={"ID":"3325783f-3052-4183-b285-8faef61f8a13","Type":"ContainerStarted","Data":"7fff2d7f77a7f49abb9ab7d03711d0ba19f68dd408a5e5f643edf4770402e175"}
Jul 15 15:33:47.350707 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:47.350322    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-26ml4"
Jul 15 15:33:47.351700 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:47.351674    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-mnhj9" event={"ID":"c0eb252c-52eb-4991-97fc-f15cc24a2db0","Type":"ContainerStarted","Data":"6e73c797fa55703c253aa0a7f34bca22c9ed11a46b68bc2a21521d746a0a0ba1"}
Jul 15 15:33:47.353065 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:47.353045    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-phxr7" event={"ID":"e0559db0-acc1-4bfa-81b3-240741d36f7b","Type":"ContainerStarted","Data":"9752ece66d20aa8453e5a281e05fe4f6bb9e0713412959e0ee15253d6888b356"}
Jul 15 15:33:47.369847 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:47.369799    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-26ml4" podStartSLOduration=1.244278844 podStartE2EDuration="6.369785667s" totalImagesPullingTime="5.125506823s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:33:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:33:47.36863135 +0000 UTC m=+557.714534544" watchObservedRunningTime="2026-07-15 15:33:47.369785667 +0000 UTC m=+557.715688860"
Jul 15 15:33:47.389502 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:47.389459    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-mnhj9" podStartSLOduration=1.239934056 podStartE2EDuration="5.389447748s" totalImagesPullingTime="4.149513692s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:33:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:33:47.389282916 +0000 UTC m=+557.735186123" watchObservedRunningTime="2026-07-15 15:33:47.389447748 +0000 UTC m=+557.735350940"
Jul 15 15:33:47.409305 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:47.409241    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-phxr7" podStartSLOduration=1.090168776 podStartE2EDuration="5.409222441s" totalImagesPullingTime="4.319053665s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:33:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:33:47.406981417 +0000 UTC m=+557.752884608" watchObservedRunningTime="2026-07-15 15:33:47.409222441 +0000 UTC m=+557.755125634"
Jul 15 15:33:47.436104 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:47.436075    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-phxr7"]
Jul 15 15:33:49.360737 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:49.360702    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-phxr7" podUID="e0559db0-acc1-4bfa-81b3-240741d36f7b" containerName="authorino" containerID="cri-o://9752ece66d20aa8453e5a281e05fe4f6bb9e0713412959e0ee15253d6888b356" gracePeriod=30
Jul 15 15:33:49.620788 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:49.620735    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-phxr7"
Jul 15 15:33:49.662833 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:49.662808    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2kn9r\" (UniqueName: \"kubernetes.io/projected/e0559db0-acc1-4bfa-81b3-240741d36f7b-kube-api-access-2kn9r\") pod \"e0559db0-acc1-4bfa-81b3-240741d36f7b\" (UID: \"e0559db0-acc1-4bfa-81b3-240741d36f7b\") "
Jul 15 15:33:49.664793 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:49.664769    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0559db0-acc1-4bfa-81b3-240741d36f7b-kube-api-access-2kn9r" (OuterVolumeSpecName: "kube-api-access-2kn9r") pod "e0559db0-acc1-4bfa-81b3-240741d36f7b" (UID: "e0559db0-acc1-4bfa-81b3-240741d36f7b"). InnerVolumeSpecName "kube-api-access-2kn9r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:33:49.763333 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:49.763294    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2kn9r\" (UniqueName: \"kubernetes.io/projected/e0559db0-acc1-4bfa-81b3-240741d36f7b-kube-api-access-2kn9r\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 15:33:50.365864 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:50.365827    2564 generic.go:356] "Generic (PLEG): container finished" podID="e0559db0-acc1-4bfa-81b3-240741d36f7b" containerID="9752ece66d20aa8453e5a281e05fe4f6bb9e0713412959e0ee15253d6888b356" exitCode=0
Jul 15 15:33:50.366322 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:50.365872    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-phxr7"
Jul 15 15:33:50.366322 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:50.365904    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-phxr7" event={"ID":"e0559db0-acc1-4bfa-81b3-240741d36f7b","Type":"ContainerDied","Data":"9752ece66d20aa8453e5a281e05fe4f6bb9e0713412959e0ee15253d6888b356"}
Jul 15 15:33:50.366322 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:50.365940    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-phxr7" event={"ID":"e0559db0-acc1-4bfa-81b3-240741d36f7b","Type":"ContainerDied","Data":"52133a6dd82ec716d77c3cf1876d99125e2e48953360eebd5059dbac039185bd"}
Jul 15 15:33:50.366322 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:50.365964    2564 scope.go:117] "RemoveContainer" containerID="9752ece66d20aa8453e5a281e05fe4f6bb9e0713412959e0ee15253d6888b356"
Jul 15 15:33:50.373964 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:50.373948    2564 scope.go:117] "RemoveContainer" containerID="9752ece66d20aa8453e5a281e05fe4f6bb9e0713412959e0ee15253d6888b356"
Jul 15 15:33:50.374243 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:33:50.374225    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9752ece66d20aa8453e5a281e05fe4f6bb9e0713412959e0ee15253d6888b356\": container with ID starting with 9752ece66d20aa8453e5a281e05fe4f6bb9e0713412959e0ee15253d6888b356 not found: ID does not exist" containerID="9752ece66d20aa8453e5a281e05fe4f6bb9e0713412959e0ee15253d6888b356"
Jul 15 15:33:50.374299 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:50.374256    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9752ece66d20aa8453e5a281e05fe4f6bb9e0713412959e0ee15253d6888b356"} err="failed to get container status \"9752ece66d20aa8453e5a281e05fe4f6bb9e0713412959e0ee15253d6888b356\": rpc error: code = NotFound desc = could not find container \"9752ece66d20aa8453e5a281e05fe4f6bb9e0713412959e0ee15253d6888b356\": container with ID starting with 9752ece66d20aa8453e5a281e05fe4f6bb9e0713412959e0ee15253d6888b356 not found: ID does not exist"
Jul 15 15:33:50.385052 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:50.385031    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-phxr7"]
Jul 15 15:33:50.389004 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:50.388985    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-phxr7"]
Jul 15 15:33:52.229354 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:52.229323    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0559db0-acc1-4bfa-81b3-240741d36f7b" path="/var/lib/kubelet/pods/e0559db0-acc1-4bfa-81b3-240741d36f7b/volumes"
Jul 15 15:33:52.818722 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:52.818692    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:33:55.863532 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:55.863499    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:33:56.498074 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:56.498036    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-26ml4"]
Jul 15 15:33:56.498264 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:56.498239    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-26ml4" podUID="3325783f-3052-4183-b285-8faef61f8a13" containerName="limitador" containerID="cri-o://7fff2d7f77a7f49abb9ab7d03711d0ba19f68dd408a5e5f643edf4770402e175" gracePeriod=30
Jul 15 15:33:56.500795 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:56.500774    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-26ml4"
Jul 15 15:33:57.033148 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:57.033128    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-26ml4"
Jul 15 15:33:57.119572 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:57.119507    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v9x72\" (UniqueName: \"kubernetes.io/projected/3325783f-3052-4183-b285-8faef61f8a13-kube-api-access-v9x72\") pod \"3325783f-3052-4183-b285-8faef61f8a13\" (UID: \"3325783f-3052-4183-b285-8faef61f8a13\") "
Jul 15 15:33:57.119572 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:57.119548    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3325783f-3052-4183-b285-8faef61f8a13-config-file\") pod \"3325783f-3052-4183-b285-8faef61f8a13\" (UID: \"3325783f-3052-4183-b285-8faef61f8a13\") "
Jul 15 15:33:57.119941 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:57.119917    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3325783f-3052-4183-b285-8faef61f8a13-config-file" (OuterVolumeSpecName: "config-file") pod "3325783f-3052-4183-b285-8faef61f8a13" (UID: "3325783f-3052-4183-b285-8faef61f8a13"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 15:33:57.121499 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:57.121481    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3325783f-3052-4183-b285-8faef61f8a13-kube-api-access-v9x72" (OuterVolumeSpecName: "kube-api-access-v9x72") pod "3325783f-3052-4183-b285-8faef61f8a13" (UID: "3325783f-3052-4183-b285-8faef61f8a13"). InnerVolumeSpecName "kube-api-access-v9x72". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:33:57.220560 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:57.220528    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v9x72\" (UniqueName: \"kubernetes.io/projected/3325783f-3052-4183-b285-8faef61f8a13-kube-api-access-v9x72\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 15:33:57.220560 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:57.220554    2564 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3325783f-3052-4183-b285-8faef61f8a13-config-file\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 15:33:57.397349 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:57.397264    2564 generic.go:356] "Generic (PLEG): container finished" podID="3325783f-3052-4183-b285-8faef61f8a13" containerID="7fff2d7f77a7f49abb9ab7d03711d0ba19f68dd408a5e5f643edf4770402e175" exitCode=0
Jul 15 15:33:57.397349 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:57.397312    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-26ml4"
Jul 15 15:33:57.397349 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:57.397321    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-26ml4" event={"ID":"3325783f-3052-4183-b285-8faef61f8a13","Type":"ContainerDied","Data":"7fff2d7f77a7f49abb9ab7d03711d0ba19f68dd408a5e5f643edf4770402e175"}
Jul 15 15:33:57.397614 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:57.397361    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-26ml4" event={"ID":"3325783f-3052-4183-b285-8faef61f8a13","Type":"ContainerDied","Data":"d9ca7cb7fe8b64aa82cead767d6184259f42eff9aa8be01470d4d62a2f917b73"}
Jul 15 15:33:57.397614 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:57.397381    2564 scope.go:117] "RemoveContainer" containerID="7fff2d7f77a7f49abb9ab7d03711d0ba19f68dd408a5e5f643edf4770402e175"
Jul 15 15:33:57.406057 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:57.406042    2564 scope.go:117] "RemoveContainer" containerID="7fff2d7f77a7f49abb9ab7d03711d0ba19f68dd408a5e5f643edf4770402e175"
Jul 15 15:33:57.406287 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:33:57.406268    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7fff2d7f77a7f49abb9ab7d03711d0ba19f68dd408a5e5f643edf4770402e175\": container with ID starting with 7fff2d7f77a7f49abb9ab7d03711d0ba19f68dd408a5e5f643edf4770402e175 not found: ID does not exist" containerID="7fff2d7f77a7f49abb9ab7d03711d0ba19f68dd408a5e5f643edf4770402e175"
Jul 15 15:33:57.406339 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:57.406295    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7fff2d7f77a7f49abb9ab7d03711d0ba19f68dd408a5e5f643edf4770402e175"} err="failed to get container status \"7fff2d7f77a7f49abb9ab7d03711d0ba19f68dd408a5e5f643edf4770402e175\": rpc error: code = NotFound desc = could not find container \"7fff2d7f77a7f49abb9ab7d03711d0ba19f68dd408a5e5f643edf4770402e175\": container with ID starting with 7fff2d7f77a7f49abb9ab7d03711d0ba19f68dd408a5e5f643edf4770402e175 not found: ID does not exist"
Jul 15 15:33:57.420579 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:57.420558    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-26ml4"]
Jul 15 15:33:57.424914 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:57.424897    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-26ml4"]
Jul 15 15:33:57.614871 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:57.614833    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:33:57.713743 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:57.713668    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:33:58.095170 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:58.095142    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-kj4g2"]
Jul 15 15:33:58.095536 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:58.095432    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0559db0-acc1-4bfa-81b3-240741d36f7b" containerName="authorino"
Jul 15 15:33:58.095536 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:58.095443    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0559db0-acc1-4bfa-81b3-240741d36f7b" containerName="authorino"
Jul 15 15:33:58.095536 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:58.095456    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3325783f-3052-4183-b285-8faef61f8a13" containerName="limitador"
Jul 15 15:33:58.095536 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:58.095461    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="3325783f-3052-4183-b285-8faef61f8a13" containerName="limitador"
Jul 15 15:33:58.095536 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:58.095521    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="3325783f-3052-4183-b285-8faef61f8a13" containerName="limitador"
Jul 15 15:33:58.095536 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:58.095532    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0559db0-acc1-4bfa-81b3-240741d36f7b" containerName="authorino"
Jul 15 15:33:58.098149 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:58.098130    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-kj4g2"
Jul 15 15:33:58.100877 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:58.100852    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 15:33:58.101000 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:58.100856    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-6m4cx\""
Jul 15 15:33:58.101873 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:58.101853    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 15 15:33:58.101985 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:58.101858    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 15 15:33:58.107703 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:58.107678    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-kj4g2"]
Jul 15 15:33:58.127192 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:58.127172    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/427413c9-36f1-4436-aeff-87dd01b082d0-data\") pod \"postgres-69fb4594cf-kj4g2\" (UID: \"427413c9-36f1-4436-aeff-87dd01b082d0\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-kj4g2"
Jul 15 15:33:58.127293 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:58.127231    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jh458\" (UniqueName: \"kubernetes.io/projected/427413c9-36f1-4436-aeff-87dd01b082d0-kube-api-access-jh458\") pod \"postgres-69fb4594cf-kj4g2\" (UID: \"427413c9-36f1-4436-aeff-87dd01b082d0\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-kj4g2"
Jul 15 15:33:58.131907 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:58.131886    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:33:58.227536 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:58.227508    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/427413c9-36f1-4436-aeff-87dd01b082d0-data\") pod \"postgres-69fb4594cf-kj4g2\" (UID: \"427413c9-36f1-4436-aeff-87dd01b082d0\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-kj4g2"
Jul 15 15:33:58.227717 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:58.227577    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jh458\" (UniqueName: \"kubernetes.io/projected/427413c9-36f1-4436-aeff-87dd01b082d0-kube-api-access-jh458\") pod \"postgres-69fb4594cf-kj4g2\" (UID: \"427413c9-36f1-4436-aeff-87dd01b082d0\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-kj4g2"
Jul 15 15:33:58.227942 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:58.227909    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/427413c9-36f1-4436-aeff-87dd01b082d0-data\") pod \"postgres-69fb4594cf-kj4g2\" (UID: \"427413c9-36f1-4436-aeff-87dd01b082d0\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-kj4g2"
Jul 15 15:33:58.228986 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:58.228965    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3325783f-3052-4183-b285-8faef61f8a13" path="/var/lib/kubelet/pods/3325783f-3052-4183-b285-8faef61f8a13/volumes"
Jul 15 15:33:58.235885 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:58.235865    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jh458\" (UniqueName: \"kubernetes.io/projected/427413c9-36f1-4436-aeff-87dd01b082d0-kube-api-access-jh458\") pod \"postgres-69fb4594cf-kj4g2\" (UID: \"427413c9-36f1-4436-aeff-87dd01b082d0\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-kj4g2"
Jul 15 15:33:58.408585 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:58.408509    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-kj4g2"
Jul 15 15:33:58.535870 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:58.535848    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-kj4g2"]
Jul 15 15:33:58.538139 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:33:58.538113    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod427413c9_36f1_4436_aeff_87dd01b082d0.slice/crio-a912adb822bb5e129d561890e154f06927a316eea9c1aa0cdb7246e84ec71eff WatchSource:0}: Error finding container a912adb822bb5e129d561890e154f06927a316eea9c1aa0cdb7246e84ec71eff: Status 404 returned error can't find the container with id a912adb822bb5e129d561890e154f06927a316eea9c1aa0cdb7246e84ec71eff
Jul 15 15:33:59.408633 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:33:59.408599    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-kj4g2" event={"ID":"427413c9-36f1-4436-aeff-87dd01b082d0","Type":"ContainerStarted","Data":"a912adb822bb5e129d561890e154f06927a316eea9c1aa0cdb7246e84ec71eff"}
Jul 15 15:34:04.434219 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:04.434187    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-kj4g2" event={"ID":"427413c9-36f1-4436-aeff-87dd01b082d0","Type":"ContainerStarted","Data":"647e25e78394b1ed20eb446eeb0f2ffc6594117a2c845c043cf9596946761227"}
Jul 15 15:34:04.434625 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:04.434266    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-kj4g2"
Jul 15 15:34:04.456134 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:04.456091    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-kj4g2" podStartSLOduration=1.44894455 podStartE2EDuration="6.456076973s" totalImagesPullingTime="5.007132423s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:33:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:34:04.455971504 +0000 UTC m=+574.801874705" watchObservedRunningTime="2026-07-15 15:34:04.456076973 +0000 UTC m=+574.801980206"
Jul 15 15:34:10.468821 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:10.468789    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-kj4g2"
Jul 15 15:34:10.800078 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:10.800049    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:34:10.940871 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:10.940838    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:34:11.035607 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:11.035582    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-cvhh6"]
Jul 15 15:34:11.041336 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:11.041319    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-cvhh6"
Jul 15 15:34:11.046121 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:11.046101    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-cvhh6"]
Jul 15 15:34:11.130754 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:11.130667    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgjnl\" (UniqueName: \"kubernetes.io/projected/93211646-11a9-4777-9571-89bbe4d1ab49-kube-api-access-vgjnl\") pod \"authorino-5d4b67c446-cvhh6\" (UID: \"93211646-11a9-4777-9571-89bbe4d1ab49\") " pod="kuadrant-system/authorino-5d4b67c446-cvhh6"
Jul 15 15:34:11.231537 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:11.231502    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgjnl\" (UniqueName: \"kubernetes.io/projected/93211646-11a9-4777-9571-89bbe4d1ab49-kube-api-access-vgjnl\") pod \"authorino-5d4b67c446-cvhh6\" (UID: \"93211646-11a9-4777-9571-89bbe4d1ab49\") " pod="kuadrant-system/authorino-5d4b67c446-cvhh6"
Jul 15 15:34:11.240184 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:11.240152    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgjnl\" (UniqueName: \"kubernetes.io/projected/93211646-11a9-4777-9571-89bbe4d1ab49-kube-api-access-vgjnl\") pod \"authorino-5d4b67c446-cvhh6\" (UID: \"93211646-11a9-4777-9571-89bbe4d1ab49\") " pod="kuadrant-system/authorino-5d4b67c446-cvhh6"
Jul 15 15:34:11.282519 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:11.282483    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-cvhh6"]
Jul 15 15:34:11.283057 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:11.283039    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-cvhh6"
Jul 15 15:34:11.310202 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:11.310169    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-cfdd5d599-hfz2t"]
Jul 15 15:34:11.315699 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:11.315675    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-cfdd5d599-hfz2t"
Jul 15 15:34:11.322266 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:11.322230    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-cfdd5d599-hfz2t"]
Jul 15 15:34:11.388474 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:11.388408    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-cfdd5d599-hfz2t"]
Jul 15 15:34:11.388718 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:34:11.388689    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-95nbp], unattached volumes=[], failed to process volumes=[kube-api-access-95nbp]: context canceled" pod="kuadrant-system/authorino-cfdd5d599-hfz2t" podUID="aa9a3da7-1310-4d27-8d6c-33d3ee6e8b2f"
Jul 15 15:34:11.418567 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:11.418542    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-cvhh6"]
Jul 15 15:34:11.421136 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:34:11.421110    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod93211646_11a9_4777_9571_89bbe4d1ab49.slice/crio-b67411f43052f147e99f136fc26f7b03f6532fb668b8638d42177ca5139bd545 WatchSource:0}: Error finding container b67411f43052f147e99f136fc26f7b03f6532fb668b8638d42177ca5139bd545: Status 404 returned error can't find the container with id b67411f43052f147e99f136fc26f7b03f6532fb668b8638d42177ca5139bd545
Jul 15 15:34:11.433678 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:11.433651    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95nbp\" (UniqueName: \"kubernetes.io/projected/aa9a3da7-1310-4d27-8d6c-33d3ee6e8b2f-kube-api-access-95nbp\") pod \"authorino-cfdd5d599-hfz2t\" (UID: \"aa9a3da7-1310-4d27-8d6c-33d3ee6e8b2f\") " pod="kuadrant-system/authorino-cfdd5d599-hfz2t"
Jul 15 15:34:11.467697 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:11.467665    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-cvhh6" event={"ID":"93211646-11a9-4777-9571-89bbe4d1ab49","Type":"ContainerStarted","Data":"b67411f43052f147e99f136fc26f7b03f6532fb668b8638d42177ca5139bd545"}
Jul 15 15:34:11.467697 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:11.467679    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-cfdd5d599-hfz2t"
Jul 15 15:34:11.475210 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:11.475191    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-cfdd5d599-hfz2t"
Jul 15 15:34:11.535097 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:11.535063    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95nbp\" (UniqueName: \"kubernetes.io/projected/aa9a3da7-1310-4d27-8d6c-33d3ee6e8b2f-kube-api-access-95nbp\") pod \"authorino-cfdd5d599-hfz2t\" (UID: \"aa9a3da7-1310-4d27-8d6c-33d3ee6e8b2f\") " pod="kuadrant-system/authorino-cfdd5d599-hfz2t"
Jul 15 15:34:11.543489 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:11.543463    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-95nbp\" (UniqueName: \"kubernetes.io/projected/aa9a3da7-1310-4d27-8d6c-33d3ee6e8b2f-kube-api-access-95nbp\") pod \"authorino-cfdd5d599-hfz2t\" (UID: \"aa9a3da7-1310-4d27-8d6c-33d3ee6e8b2f\") " pod="kuadrant-system/authorino-cfdd5d599-hfz2t"
Jul 15 15:34:11.636272 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:11.636236    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-95nbp\" (UniqueName: \"kubernetes.io/projected/aa9a3da7-1310-4d27-8d6c-33d3ee6e8b2f-kube-api-access-95nbp\") pod \"aa9a3da7-1310-4d27-8d6c-33d3ee6e8b2f\" (UID: \"aa9a3da7-1310-4d27-8d6c-33d3ee6e8b2f\") "
Jul 15 15:34:11.639185 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:11.638943    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa9a3da7-1310-4d27-8d6c-33d3ee6e8b2f-kube-api-access-95nbp" (OuterVolumeSpecName: "kube-api-access-95nbp") pod "aa9a3da7-1310-4d27-8d6c-33d3ee6e8b2f" (UID: "aa9a3da7-1310-4d27-8d6c-33d3ee6e8b2f"). InnerVolumeSpecName "kube-api-access-95nbp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:34:11.737274 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:11.737254    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-95nbp\" (UniqueName: \"kubernetes.io/projected/aa9a3da7-1310-4d27-8d6c-33d3ee6e8b2f-kube-api-access-95nbp\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 15:34:12.472866 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:12.472835    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-cfdd5d599-hfz2t"
Jul 15 15:34:12.473091 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:12.472881    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-cvhh6" event={"ID":"93211646-11a9-4777-9571-89bbe4d1ab49","Type":"ContainerStarted","Data":"a41acb032f75e6f2ab57061901b6835b0f580c539b4e206ddae051ada8fbe412"}
Jul 15 15:34:12.473091 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:12.472893    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-cvhh6" podUID="93211646-11a9-4777-9571-89bbe4d1ab49" containerName="authorino" containerID="cri-o://a41acb032f75e6f2ab57061901b6835b0f580c539b4e206ddae051ada8fbe412" gracePeriod=30
Jul 15 15:34:12.487975 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:12.487934    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-cvhh6" podStartSLOduration=1.175262956 podStartE2EDuration="1.487919614s" totalImagesPullingTime="312.656658ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:34:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:34:12.486982273 +0000 UTC m=+582.832885465" watchObservedRunningTime="2026-07-15 15:34:12.487919614 +0000 UTC m=+582.833822807"
Jul 15 15:34:12.512745 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:12.512721    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-cfdd5d599-hfz2t"]
Jul 15 15:34:12.516134 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:12.516111    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-cfdd5d599-hfz2t"]
Jul 15 15:34:12.723439 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:12.723415    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-cvhh6"
Jul 15 15:34:12.846650 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:12.846621    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vgjnl\" (UniqueName: \"kubernetes.io/projected/93211646-11a9-4777-9571-89bbe4d1ab49-kube-api-access-vgjnl\") pod \"93211646-11a9-4777-9571-89bbe4d1ab49\" (UID: \"93211646-11a9-4777-9571-89bbe4d1ab49\") "
Jul 15 15:34:12.848622 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:12.848597    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93211646-11a9-4777-9571-89bbe4d1ab49-kube-api-access-vgjnl" (OuterVolumeSpecName: "kube-api-access-vgjnl") pod "93211646-11a9-4777-9571-89bbe4d1ab49" (UID: "93211646-11a9-4777-9571-89bbe4d1ab49"). InnerVolumeSpecName "kube-api-access-vgjnl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:34:12.947211 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:12.947176    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vgjnl\" (UniqueName: \"kubernetes.io/projected/93211646-11a9-4777-9571-89bbe4d1ab49-kube-api-access-vgjnl\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 15:34:13.477651 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:13.477619    2564 generic.go:356] "Generic (PLEG): container finished" podID="93211646-11a9-4777-9571-89bbe4d1ab49" containerID="a41acb032f75e6f2ab57061901b6835b0f580c539b4e206ddae051ada8fbe412" exitCode=0
Jul 15 15:34:13.477828 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:13.477658    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-cvhh6"
Jul 15 15:34:13.477828 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:13.477706    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-cvhh6" event={"ID":"93211646-11a9-4777-9571-89bbe4d1ab49","Type":"ContainerDied","Data":"a41acb032f75e6f2ab57061901b6835b0f580c539b4e206ddae051ada8fbe412"}
Jul 15 15:34:13.477828 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:13.477743    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-cvhh6" event={"ID":"93211646-11a9-4777-9571-89bbe4d1ab49","Type":"ContainerDied","Data":"b67411f43052f147e99f136fc26f7b03f6532fb668b8638d42177ca5139bd545"}
Jul 15 15:34:13.477828 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:13.477760    2564 scope.go:117] "RemoveContainer" containerID="a41acb032f75e6f2ab57061901b6835b0f580c539b4e206ddae051ada8fbe412"
Jul 15 15:34:13.486415 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:13.486399    2564 scope.go:117] "RemoveContainer" containerID="a41acb032f75e6f2ab57061901b6835b0f580c539b4e206ddae051ada8fbe412"
Jul 15 15:34:13.486639 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:34:13.486623    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a41acb032f75e6f2ab57061901b6835b0f580c539b4e206ddae051ada8fbe412\": container with ID starting with a41acb032f75e6f2ab57061901b6835b0f580c539b4e206ddae051ada8fbe412 not found: ID does not exist" containerID="a41acb032f75e6f2ab57061901b6835b0f580c539b4e206ddae051ada8fbe412"
Jul 15 15:34:13.486685 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:13.486647    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a41acb032f75e6f2ab57061901b6835b0f580c539b4e206ddae051ada8fbe412"} err="failed to get container status \"a41acb032f75e6f2ab57061901b6835b0f580c539b4e206ddae051ada8fbe412\": rpc error: code = NotFound desc = could not find container \"a41acb032f75e6f2ab57061901b6835b0f580c539b4e206ddae051ada8fbe412\": container with ID starting with a41acb032f75e6f2ab57061901b6835b0f580c539b4e206ddae051ada8fbe412 not found: ID does not exist"
Jul 15 15:34:13.497647 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:13.497625    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-cvhh6"]
Jul 15 15:34:13.501909 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:13.501889    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-cvhh6"]
Jul 15 15:34:14.229444 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:14.229411    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93211646-11a9-4777-9571-89bbe4d1ab49" path="/var/lib/kubelet/pods/93211646-11a9-4777-9571-89bbe4d1ab49/volumes"
Jul 15 15:34:14.229729 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:14.229717    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa9a3da7-1310-4d27-8d6c-33d3ee6e8b2f" path="/var/lib/kubelet/pods/aa9a3da7-1310-4d27-8d6c-33d3ee6e8b2f/volumes"
Jul 15 15:34:15.660736 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:15.660705    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-mnhj9"]
Jul 15 15:34:15.661169 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:15.660875    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-mnhj9" podUID="c0eb252c-52eb-4991-97fc-f15cc24a2db0" containerName="authorino" containerID="cri-o://6e73c797fa55703c253aa0a7f34bca22c9ed11a46b68bc2a21521d746a0a0ba1" gracePeriod=30
Jul 15 15:34:15.926212 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:15.926158    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-mnhj9"
Jul 15 15:34:15.970956 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:15.970931    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bvzth\" (UniqueName: \"kubernetes.io/projected/c0eb252c-52eb-4991-97fc-f15cc24a2db0-kube-api-access-bvzth\") pod \"c0eb252c-52eb-4991-97fc-f15cc24a2db0\" (UID: \"c0eb252c-52eb-4991-97fc-f15cc24a2db0\") "
Jul 15 15:34:15.972955 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:15.972923    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0eb252c-52eb-4991-97fc-f15cc24a2db0-kube-api-access-bvzth" (OuterVolumeSpecName: "kube-api-access-bvzth") pod "c0eb252c-52eb-4991-97fc-f15cc24a2db0" (UID: "c0eb252c-52eb-4991-97fc-f15cc24a2db0"). InnerVolumeSpecName "kube-api-access-bvzth". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:34:16.072406 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:16.072382    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bvzth\" (UniqueName: \"kubernetes.io/projected/c0eb252c-52eb-4991-97fc-f15cc24a2db0-kube-api-access-bvzth\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 15:34:16.492634 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:16.492562    2564 generic.go:356] "Generic (PLEG): container finished" podID="c0eb252c-52eb-4991-97fc-f15cc24a2db0" containerID="6e73c797fa55703c253aa0a7f34bca22c9ed11a46b68bc2a21521d746a0a0ba1" exitCode=0
Jul 15 15:34:16.492634 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:16.492623    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-mnhj9"
Jul 15 15:34:16.492799 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:16.492646    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-mnhj9" event={"ID":"c0eb252c-52eb-4991-97fc-f15cc24a2db0","Type":"ContainerDied","Data":"6e73c797fa55703c253aa0a7f34bca22c9ed11a46b68bc2a21521d746a0a0ba1"}
Jul 15 15:34:16.492799 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:16.492686    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-mnhj9" event={"ID":"c0eb252c-52eb-4991-97fc-f15cc24a2db0","Type":"ContainerDied","Data":"a9219241ce52674aaf1ac520ef2e096081233f87f46fbc615cec4817b86795fa"}
Jul 15 15:34:16.492799 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:16.492702    2564 scope.go:117] "RemoveContainer" containerID="6e73c797fa55703c253aa0a7f34bca22c9ed11a46b68bc2a21521d746a0a0ba1"
Jul 15 15:34:16.500985 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:16.500971    2564 scope.go:117] "RemoveContainer" containerID="6e73c797fa55703c253aa0a7f34bca22c9ed11a46b68bc2a21521d746a0a0ba1"
Jul 15 15:34:16.501227 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:34:16.501212    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e73c797fa55703c253aa0a7f34bca22c9ed11a46b68bc2a21521d746a0a0ba1\": container with ID starting with 6e73c797fa55703c253aa0a7f34bca22c9ed11a46b68bc2a21521d746a0a0ba1 not found: ID does not exist" containerID="6e73c797fa55703c253aa0a7f34bca22c9ed11a46b68bc2a21521d746a0a0ba1"
Jul 15 15:34:16.501284 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:16.501235    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e73c797fa55703c253aa0a7f34bca22c9ed11a46b68bc2a21521d746a0a0ba1"} err="failed to get container status \"6e73c797fa55703c253aa0a7f34bca22c9ed11a46b68bc2a21521d746a0a0ba1\": rpc error: code = NotFound desc = could not find container \"6e73c797fa55703c253aa0a7f34bca22c9ed11a46b68bc2a21521d746a0a0ba1\": container with ID starting with 6e73c797fa55703c253aa0a7f34bca22c9ed11a46b68bc2a21521d746a0a0ba1 not found: ID does not exist"
Jul 15 15:34:16.508872 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:16.508849    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-mnhj9"]
Jul 15 15:34:16.515082 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:16.515061    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-mnhj9"]
Jul 15 15:34:18.228742 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:18.228710    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0eb252c-52eb-4991-97fc-f15cc24a2db0" path="/var/lib/kubelet/pods/c0eb252c-52eb-4991-97fc-f15cc24a2db0/volumes"
Jul 15 15:34:20.520535 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:20.520496    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7bfbcd898c-m4slz"]
Jul 15 15:34:20.520987 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:20.520956    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93211646-11a9-4777-9571-89bbe4d1ab49" containerName="authorino"
Jul 15 15:34:20.520987 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:20.520975    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="93211646-11a9-4777-9571-89bbe4d1ab49" containerName="authorino"
Jul 15 15:34:20.521148 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:20.520998    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0eb252c-52eb-4991-97fc-f15cc24a2db0" containerName="authorino"
Jul 15 15:34:20.521148 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:20.521026    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0eb252c-52eb-4991-97fc-f15cc24a2db0" containerName="authorino"
Jul 15 15:34:20.521148 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:20.521142    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0eb252c-52eb-4991-97fc-f15cc24a2db0" containerName="authorino"
Jul 15 15:34:20.521291 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:20.521157    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="93211646-11a9-4777-9571-89bbe4d1ab49" containerName="authorino"
Jul 15 15:34:20.569692 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:20.569651    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:34:20.699478 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:20.699435    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:34:20.730458 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:20.730428    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7bfbcd898c-m4slz"]
Jul 15 15:34:20.730458 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:20.730444    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bfbcd898c-m4slz"
Jul 15 15:34:20.731211 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:20.731183    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5cd4d7f4b-62fft"]
Jul 15 15:34:20.733053 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:20.733034    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-vwkk2\""
Jul 15 15:34:20.733301 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:20.733285    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 15 15:34:20.733351 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:20.733303    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 15 15:34:20.746081 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:20.746059    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5cd4d7f4b-62fft"]
Jul 15 15:34:20.746219 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:20.746160    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5cd4d7f4b-62fft"
Jul 15 15:34:20.811000 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:20.810932    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4m9wz\" (UniqueName: \"kubernetes.io/projected/7a0f5477-066e-49f9-a153-a02bb6c719a9-kube-api-access-4m9wz\") pod \"maas-controller-5cd4d7f4b-62fft\" (UID: \"7a0f5477-066e-49f9-a153-a02bb6c719a9\") " pod="opendatahub/maas-controller-5cd4d7f4b-62fft"
Jul 15 15:34:20.811000 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:20.810969    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8fa4138a-c219-42e9-862d-f97de886e4bc-webhook-cert\") pod \"maas-controller-7bfbcd898c-m4slz\" (UID: \"8fa4138a-c219-42e9-862d-f97de886e4bc\") " pod="opendatahub/maas-controller-7bfbcd898c-m4slz"
Jul 15 15:34:20.811194 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:20.811004    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sd4jw\" (UniqueName: \"kubernetes.io/projected/8fa4138a-c219-42e9-862d-f97de886e4bc-kube-api-access-sd4jw\") pod \"maas-controller-7bfbcd898c-m4slz\" (UID: \"8fa4138a-c219-42e9-862d-f97de886e4bc\") " pod="opendatahub/maas-controller-7bfbcd898c-m4slz"
Jul 15 15:34:20.811194 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:20.811063    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7a0f5477-066e-49f9-a153-a02bb6c719a9-webhook-cert\") pod \"maas-controller-5cd4d7f4b-62fft\" (UID: \"7a0f5477-066e-49f9-a153-a02bb6c719a9\") " pod="opendatahub/maas-controller-5cd4d7f4b-62fft"
Jul 15 15:34:20.885408 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:20.885377    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:34:20.912470 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:20.912446    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4m9wz\" (UniqueName: \"kubernetes.io/projected/7a0f5477-066e-49f9-a153-a02bb6c719a9-kube-api-access-4m9wz\") pod \"maas-controller-5cd4d7f4b-62fft\" (UID: \"7a0f5477-066e-49f9-a153-a02bb6c719a9\") " pod="opendatahub/maas-controller-5cd4d7f4b-62fft"
Jul 15 15:34:20.912626 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:20.912485    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8fa4138a-c219-42e9-862d-f97de886e4bc-webhook-cert\") pod \"maas-controller-7bfbcd898c-m4slz\" (UID: \"8fa4138a-c219-42e9-862d-f97de886e4bc\") " pod="opendatahub/maas-controller-7bfbcd898c-m4slz"
Jul 15 15:34:20.912626 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:20.912538    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sd4jw\" (UniqueName: \"kubernetes.io/projected/8fa4138a-c219-42e9-862d-f97de886e4bc-kube-api-access-sd4jw\") pod \"maas-controller-7bfbcd898c-m4slz\" (UID: \"8fa4138a-c219-42e9-862d-f97de886e4bc\") " pod="opendatahub/maas-controller-7bfbcd898c-m4slz"
Jul 15 15:34:20.912626 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:20.912562    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7a0f5477-066e-49f9-a153-a02bb6c719a9-webhook-cert\") pod \"maas-controller-5cd4d7f4b-62fft\" (UID: \"7a0f5477-066e-49f9-a153-a02bb6c719a9\") " pod="opendatahub/maas-controller-5cd4d7f4b-62fft"
Jul 15 15:34:20.914950 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:20.914922    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8fa4138a-c219-42e9-862d-f97de886e4bc-webhook-cert\") pod \"maas-controller-7bfbcd898c-m4slz\" (UID: \"8fa4138a-c219-42e9-862d-f97de886e4bc\") " pod="opendatahub/maas-controller-7bfbcd898c-m4slz"
Jul 15 15:34:20.915088 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:20.915069    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7a0f5477-066e-49f9-a153-a02bb6c719a9-webhook-cert\") pod \"maas-controller-5cd4d7f4b-62fft\" (UID: \"7a0f5477-066e-49f9-a153-a02bb6c719a9\") " pod="opendatahub/maas-controller-5cd4d7f4b-62fft"
Jul 15 15:34:20.920762 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:20.920737    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sd4jw\" (UniqueName: \"kubernetes.io/projected/8fa4138a-c219-42e9-862d-f97de886e4bc-kube-api-access-sd4jw\") pod \"maas-controller-7bfbcd898c-m4slz\" (UID: \"8fa4138a-c219-42e9-862d-f97de886e4bc\") " pod="opendatahub/maas-controller-7bfbcd898c-m4slz"
Jul 15 15:34:20.920949 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:20.920930    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4m9wz\" (UniqueName: \"kubernetes.io/projected/7a0f5477-066e-49f9-a153-a02bb6c719a9-kube-api-access-4m9wz\") pod \"maas-controller-5cd4d7f4b-62fft\" (UID: \"7a0f5477-066e-49f9-a153-a02bb6c719a9\") " pod="opendatahub/maas-controller-5cd4d7f4b-62fft"
Jul 15 15:34:21.047852 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:21.047814    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bfbcd898c-m4slz"
Jul 15 15:34:21.057036 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:21.056998    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5cd4d7f4b-62fft"
Jul 15 15:34:21.230633 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:21.230608    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7bfbcd898c-m4slz"]
Jul 15 15:34:21.232418 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:34:21.232392    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fa4138a_c219_42e9_862d_f97de886e4bc.slice/crio-6e5650112ae31d42d2ed0c5e9d6d157da0f71dd2941112f3a41364f83757bfb8 WatchSource:0}: Error finding container 6e5650112ae31d42d2ed0c5e9d6d157da0f71dd2941112f3a41364f83757bfb8: Status 404 returned error can't find the container with id 6e5650112ae31d42d2ed0c5e9d6d157da0f71dd2941112f3a41364f83757bfb8
Jul 15 15:34:21.256299 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:21.256277    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5cd4d7f4b-62fft"]
Jul 15 15:34:21.258306 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:34:21.258282    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a0f5477_066e_49f9_a153_a02bb6c719a9.slice/crio-c29a72524859da2d3d343c9738e1024786d1562c0806c2fc8625eb9e412fb477 WatchSource:0}: Error finding container c29a72524859da2d3d343c9738e1024786d1562c0806c2fc8625eb9e412fb477: Status 404 returned error can't find the container with id c29a72524859da2d3d343c9738e1024786d1562c0806c2fc8625eb9e412fb477
Jul 15 15:34:21.514404 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:21.514324    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5cd4d7f4b-62fft" event={"ID":"7a0f5477-066e-49f9-a153-a02bb6c719a9","Type":"ContainerStarted","Data":"c29a72524859da2d3d343c9738e1024786d1562c0806c2fc8625eb9e412fb477"}
Jul 15 15:34:21.515474 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:21.515455    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bfbcd898c-m4slz" event={"ID":"8fa4138a-c219-42e9-862d-f97de886e4bc","Type":"ContainerStarted","Data":"6e5650112ae31d42d2ed0c5e9d6d157da0f71dd2941112f3a41364f83757bfb8"}
Jul 15 15:34:24.179406 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:24.179334    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:34:24.278334 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:24.278307    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:34:24.539403 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:24.539362    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5cd4d7f4b-62fft" event={"ID":"7a0f5477-066e-49f9-a153-a02bb6c719a9","Type":"ContainerStarted","Data":"b7ec4ae19eb0279a18acc742b728dba3c709cf1476b8ab50822197745e178377"}
Jul 15 15:34:24.539669 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:24.539485    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5cd4d7f4b-62fft"
Jul 15 15:34:24.540859 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:24.540836    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bfbcd898c-m4slz" event={"ID":"8fa4138a-c219-42e9-862d-f97de886e4bc","Type":"ContainerStarted","Data":"fc704370833c9988bb40e1c32c365ac49f25dc2763fddb66e55b3c32d055bf17"}
Jul 15 15:34:24.540988 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:24.540888    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7bfbcd898c-m4slz"
Jul 15 15:34:24.560192 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:24.560146    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5cd4d7f4b-62fft" podStartSLOduration=1.8800651990000001 podStartE2EDuration="4.560135015s" totalImagesPullingTime="2.680069816s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:34:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:34:24.558669149 +0000 UTC m=+594.904572333" watchObservedRunningTime="2026-07-15 15:34:24.560135015 +0000 UTC m=+594.906038186"
Jul 15 15:34:24.585130 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:24.585093    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7bfbcd898c-m4slz" podStartSLOduration=1.888093706 podStartE2EDuration="4.585081208s" totalImagesPullingTime="2.696987502s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:34:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:34:24.583627531 +0000 UTC m=+594.929530724" watchObservedRunningTime="2026-07-15 15:34:24.585081208 +0000 UTC m=+594.930984400"
Jul 15 15:34:30.039442 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:30.039417    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfw7r_55d0e798-7e5a-4f3e-afc2-67dfb308d934/ovn-acl-logging/0.log"
Jul 15 15:34:30.041684 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:30.041663    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfw7r_55d0e798-7e5a-4f3e-afc2-67dfb308d934/ovn-acl-logging/0.log"
Jul 15 15:34:35.547703 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:35.547674    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5cd4d7f4b-62fft"
Jul 15 15:34:35.549067 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:35.547742    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7bfbcd898c-m4slz"
Jul 15 15:34:35.593675 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:35.593647    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7bfbcd898c-m4slz"]
Jul 15 15:34:35.593824 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:35.593804    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7bfbcd898c-m4slz" podUID="8fa4138a-c219-42e9-862d-f97de886e4bc" containerName="manager" containerID="cri-o://fc704370833c9988bb40e1c32c365ac49f25dc2763fddb66e55b3c32d055bf17" gracePeriod=30
Jul 15 15:34:35.841040 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:35.841004    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bfbcd898c-m4slz"
Jul 15 15:34:35.926765 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:35.926738    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8fa4138a-c219-42e9-862d-f97de886e4bc-webhook-cert\") pod \"8fa4138a-c219-42e9-862d-f97de886e4bc\" (UID: \"8fa4138a-c219-42e9-862d-f97de886e4bc\") "
Jul 15 15:34:35.926881 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:35.926817    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sd4jw\" (UniqueName: \"kubernetes.io/projected/8fa4138a-c219-42e9-862d-f97de886e4bc-kube-api-access-sd4jw\") pod \"8fa4138a-c219-42e9-862d-f97de886e4bc\" (UID: \"8fa4138a-c219-42e9-862d-f97de886e4bc\") "
Jul 15 15:34:35.928896 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:35.928871    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8fa4138a-c219-42e9-862d-f97de886e4bc-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "8fa4138a-c219-42e9-862d-f97de886e4bc" (UID: "8fa4138a-c219-42e9-862d-f97de886e4bc"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 15:34:35.928984 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:35.928871    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8fa4138a-c219-42e9-862d-f97de886e4bc-kube-api-access-sd4jw" (OuterVolumeSpecName: "kube-api-access-sd4jw") pod "8fa4138a-c219-42e9-862d-f97de886e4bc" (UID: "8fa4138a-c219-42e9-862d-f97de886e4bc"). InnerVolumeSpecName "kube-api-access-sd4jw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:34:36.028297 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:36.028278    2564 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8fa4138a-c219-42e9-862d-f97de886e4bc-webhook-cert\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 15:34:36.028297 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:36.028298    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sd4jw\" (UniqueName: \"kubernetes.io/projected/8fa4138a-c219-42e9-862d-f97de886e4bc-kube-api-access-sd4jw\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 15:34:36.591663 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:36.591629    2564 generic.go:356] "Generic (PLEG): container finished" podID="8fa4138a-c219-42e9-862d-f97de886e4bc" containerID="fc704370833c9988bb40e1c32c365ac49f25dc2763fddb66e55b3c32d055bf17" exitCode=0
Jul 15 15:34:36.591997 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:36.591670    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bfbcd898c-m4slz"
Jul 15 15:34:36.591997 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:36.591715    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bfbcd898c-m4slz" event={"ID":"8fa4138a-c219-42e9-862d-f97de886e4bc","Type":"ContainerDied","Data":"fc704370833c9988bb40e1c32c365ac49f25dc2763fddb66e55b3c32d055bf17"}
Jul 15 15:34:36.591997 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:36.591768    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bfbcd898c-m4slz" event={"ID":"8fa4138a-c219-42e9-862d-f97de886e4bc","Type":"ContainerDied","Data":"6e5650112ae31d42d2ed0c5e9d6d157da0f71dd2941112f3a41364f83757bfb8"}
Jul 15 15:34:36.591997 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:36.591791    2564 scope.go:117] "RemoveContainer" containerID="fc704370833c9988bb40e1c32c365ac49f25dc2763fddb66e55b3c32d055bf17"
Jul 15 15:34:36.600293 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:36.600108    2564 scope.go:117] "RemoveContainer" containerID="fc704370833c9988bb40e1c32c365ac49f25dc2763fddb66e55b3c32d055bf17"
Jul 15 15:34:36.600385 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:34:36.600365    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc704370833c9988bb40e1c32c365ac49f25dc2763fddb66e55b3c32d055bf17\": container with ID starting with fc704370833c9988bb40e1c32c365ac49f25dc2763fddb66e55b3c32d055bf17 not found: ID does not exist" containerID="fc704370833c9988bb40e1c32c365ac49f25dc2763fddb66e55b3c32d055bf17"
Jul 15 15:34:36.600428 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:36.600394    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc704370833c9988bb40e1c32c365ac49f25dc2763fddb66e55b3c32d055bf17"} err="failed to get container status \"fc704370833c9988bb40e1c32c365ac49f25dc2763fddb66e55b3c32d055bf17\": rpc error: code = NotFound desc = could not find container \"fc704370833c9988bb40e1c32c365ac49f25dc2763fddb66e55b3c32d055bf17\": container with ID starting with fc704370833c9988bb40e1c32c365ac49f25dc2763fddb66e55b3c32d055bf17 not found: ID does not exist"
Jul 15 15:34:36.608050 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:36.608022    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7bfbcd898c-m4slz"]
Jul 15 15:34:36.612233 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:36.612213    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7bfbcd898c-m4slz"]
Jul 15 15:34:38.229895 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:38.229858    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8fa4138a-c219-42e9-862d-f97de886e4bc" path="/var/lib/kubelet/pods/8fa4138a-c219-42e9-862d-f97de886e4bc/volumes"
Jul 15 15:34:56.335028 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:56.334928    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:34:56.997462 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:56.997428    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-7f9fbcfccc-vt5w7"]
Jul 15 15:34:56.997744 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:56.997732    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fa4138a-c219-42e9-862d-f97de886e4bc" containerName="manager"
Jul 15 15:34:56.997789 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:56.997745    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fa4138a-c219-42e9-862d-f97de886e4bc" containerName="manager"
Jul 15 15:34:56.997825 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:56.997800    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="8fa4138a-c219-42e9-862d-f97de886e4bc" containerName="manager"
Jul 15 15:34:56.999651 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:56.999637    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7f9fbcfccc-vt5w7"
Jul 15 15:34:57.003674 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:57.003656    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 15 15:34:57.003810 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:57.003742    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-tkkc9\""
Jul 15 15:34:57.017350 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:57.017327    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7f9fbcfccc-vt5w7"]
Jul 15 15:34:57.179734 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:57.179697    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ed8a773-3c36-4963-8b3d-58133f7b3e28-openshift-service-ca\") pod \"maas-api-7f9fbcfccc-vt5w7\" (UID: \"2ed8a773-3c36-4963-8b3d-58133f7b3e28\") " pod="odh-ai-gateway-infra/maas-api-7f9fbcfccc-vt5w7"
Jul 15 15:34:57.179926 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:57.179805    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2ed8a773-3c36-4963-8b3d-58133f7b3e28-maas-api-tls\") pod \"maas-api-7f9fbcfccc-vt5w7\" (UID: \"2ed8a773-3c36-4963-8b3d-58133f7b3e28\") " pod="odh-ai-gateway-infra/maas-api-7f9fbcfccc-vt5w7"
Jul 15 15:34:57.179926 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:57.179850    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gg4h\" (UniqueName: \"kubernetes.io/projected/2ed8a773-3c36-4963-8b3d-58133f7b3e28-kube-api-access-7gg4h\") pod \"maas-api-7f9fbcfccc-vt5w7\" (UID: \"2ed8a773-3c36-4963-8b3d-58133f7b3e28\") " pod="odh-ai-gateway-infra/maas-api-7f9fbcfccc-vt5w7"
Jul 15 15:34:57.280548 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:57.280511    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2ed8a773-3c36-4963-8b3d-58133f7b3e28-maas-api-tls\") pod \"maas-api-7f9fbcfccc-vt5w7\" (UID: \"2ed8a773-3c36-4963-8b3d-58133f7b3e28\") " pod="odh-ai-gateway-infra/maas-api-7f9fbcfccc-vt5w7"
Jul 15 15:34:57.280720 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:57.280559    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gg4h\" (UniqueName: \"kubernetes.io/projected/2ed8a773-3c36-4963-8b3d-58133f7b3e28-kube-api-access-7gg4h\") pod \"maas-api-7f9fbcfccc-vt5w7\" (UID: \"2ed8a773-3c36-4963-8b3d-58133f7b3e28\") " pod="odh-ai-gateway-infra/maas-api-7f9fbcfccc-vt5w7"
Jul 15 15:34:57.280836 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:57.280812    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ed8a773-3c36-4963-8b3d-58133f7b3e28-openshift-service-ca\") pod \"maas-api-7f9fbcfccc-vt5w7\" (UID: \"2ed8a773-3c36-4963-8b3d-58133f7b3e28\") " pod="odh-ai-gateway-infra/maas-api-7f9fbcfccc-vt5w7"
Jul 15 15:34:57.281471 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:57.281450    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ed8a773-3c36-4963-8b3d-58133f7b3e28-openshift-service-ca\") pod \"maas-api-7f9fbcfccc-vt5w7\" (UID: \"2ed8a773-3c36-4963-8b3d-58133f7b3e28\") " pod="odh-ai-gateway-infra/maas-api-7f9fbcfccc-vt5w7"
Jul 15 15:34:57.283152 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:57.283131    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2ed8a773-3c36-4963-8b3d-58133f7b3e28-maas-api-tls\") pod \"maas-api-7f9fbcfccc-vt5w7\" (UID: \"2ed8a773-3c36-4963-8b3d-58133f7b3e28\") " pod="odh-ai-gateway-infra/maas-api-7f9fbcfccc-vt5w7"
Jul 15 15:34:57.289843 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:57.289818    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gg4h\" (UniqueName: \"kubernetes.io/projected/2ed8a773-3c36-4963-8b3d-58133f7b3e28-kube-api-access-7gg4h\") pod \"maas-api-7f9fbcfccc-vt5w7\" (UID: \"2ed8a773-3c36-4963-8b3d-58133f7b3e28\") " pod="odh-ai-gateway-infra/maas-api-7f9fbcfccc-vt5w7"
Jul 15 15:34:57.309557 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:57.309532    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7f9fbcfccc-vt5w7"
Jul 15 15:34:57.449325 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:57.449291    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7f9fbcfccc-vt5w7"]
Jul 15 15:34:57.452673 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:34:57.452645    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ed8a773_3c36_4963_8b3d_58133f7b3e28.slice/crio-220d05e43501b0288f06deaf50b06fe3d9c554cda435de03285a3c1b832ab684 WatchSource:0}: Error finding container 220d05e43501b0288f06deaf50b06fe3d9c554cda435de03285a3c1b832ab684: Status 404 returned error can't find the container with id 220d05e43501b0288f06deaf50b06fe3d9c554cda435de03285a3c1b832ab684
Jul 15 15:34:57.577324 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:57.577237    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-7fwng"]
Jul 15 15:34:57.613137 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:57.613086    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-7fwng"]
Jul 15 15:34:57.613300 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:57.613153    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-d479t"]
Jul 15 15:34:57.613300 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:57.613200    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-7fwng"
Jul 15 15:34:57.615624 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:57.615598    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 15 15:34:57.628540 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:57.628519    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-d479t"]
Jul 15 15:34:57.628658 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:57.628622    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-d479t"
Jul 15 15:34:57.631419 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:57.631402    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-kl2wt\""
Jul 15 15:34:57.683526 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:57.683500    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7f9fbcfccc-vt5w7" event={"ID":"2ed8a773-3c36-4963-8b3d-58133f7b3e28","Type":"ContainerStarted","Data":"220d05e43501b0288f06deaf50b06fe3d9c554cda435de03285a3c1b832ab684"}
Jul 15 15:34:57.785208 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:57.785181    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fa273192-872f-4d2d-bcdc-35e85bc99485-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-d479t\" (UID: \"fa273192-872f-4d2d-bcdc-35e85bc99485\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-d479t"
Jul 15 15:34:57.785345 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:57.785215    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9st7\" (UniqueName: \"kubernetes.io/projected/1871f089-c640-4943-a0fa-e1c448360d7a-kube-api-access-h9st7\") pod \"payload-pre-processing-74584bb9f8-7fwng\" (UID: \"1871f089-c640-4943-a0fa-e1c448360d7a\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-7fwng"
Jul 15 15:34:57.785345 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:57.785239    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vj2d\" (UniqueName: \"kubernetes.io/projected/fa273192-872f-4d2d-bcdc-35e85bc99485-kube-api-access-6vj2d\") pod \"payload-processing-f9b8d9b9b-d479t\" (UID: \"fa273192-872f-4d2d-bcdc-35e85bc99485\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-d479t"
Jul 15 15:34:57.785345 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:57.785300    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1871f089-c640-4943-a0fa-e1c448360d7a-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-7fwng\" (UID: \"1871f089-c640-4943-a0fa-e1c448360d7a\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-7fwng"
Jul 15 15:34:57.886712 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:57.886635    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fa273192-872f-4d2d-bcdc-35e85bc99485-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-d479t\" (UID: \"fa273192-872f-4d2d-bcdc-35e85bc99485\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-d479t"
Jul 15 15:34:57.886712 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:57.886678    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9st7\" (UniqueName: \"kubernetes.io/projected/1871f089-c640-4943-a0fa-e1c448360d7a-kube-api-access-h9st7\") pod \"payload-pre-processing-74584bb9f8-7fwng\" (UID: \"1871f089-c640-4943-a0fa-e1c448360d7a\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-7fwng"
Jul 15 15:34:57.886712 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:57.886710    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vj2d\" (UniqueName: \"kubernetes.io/projected/fa273192-872f-4d2d-bcdc-35e85bc99485-kube-api-access-6vj2d\") pod \"payload-processing-f9b8d9b9b-d479t\" (UID: \"fa273192-872f-4d2d-bcdc-35e85bc99485\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-d479t"
Jul 15 15:34:57.886966 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:57.886737    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1871f089-c640-4943-a0fa-e1c448360d7a-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-7fwng\" (UID: \"1871f089-c640-4943-a0fa-e1c448360d7a\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-7fwng"
Jul 15 15:34:57.887462 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:57.887438    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fa273192-872f-4d2d-bcdc-35e85bc99485-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-d479t\" (UID: \"fa273192-872f-4d2d-bcdc-35e85bc99485\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-d479t"
Jul 15 15:34:57.887554 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:57.887446    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1871f089-c640-4943-a0fa-e1c448360d7a-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-7fwng\" (UID: \"1871f089-c640-4943-a0fa-e1c448360d7a\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-7fwng"
Jul 15 15:34:57.895704 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:57.895677    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vj2d\" (UniqueName: \"kubernetes.io/projected/fa273192-872f-4d2d-bcdc-35e85bc99485-kube-api-access-6vj2d\") pod \"payload-processing-f9b8d9b9b-d479t\" (UID: \"fa273192-872f-4d2d-bcdc-35e85bc99485\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-d479t"
Jul 15 15:34:57.895704 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:57.895699    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9st7\" (UniqueName: \"kubernetes.io/projected/1871f089-c640-4943-a0fa-e1c448360d7a-kube-api-access-h9st7\") pod \"payload-pre-processing-74584bb9f8-7fwng\" (UID: \"1871f089-c640-4943-a0fa-e1c448360d7a\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-7fwng"
Jul 15 15:34:57.907713 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:57.907695    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:34:57.923651 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:57.923627    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-7fwng"
Jul 15 15:34:57.938665 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:57.938646    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-d479t"
Jul 15 15:34:58.067138 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:58.067107    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-7fwng"]
Jul 15 15:34:58.069822 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:34:58.069796    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1871f089_c640_4943_a0fa_e1c448360d7a.slice/crio-29079254d00183e1b668ce423dcaeac24bdcb51259f81d54f2d8ff7586198539 WatchSource:0}: Error finding container 29079254d00183e1b668ce423dcaeac24bdcb51259f81d54f2d8ff7586198539: Status 404 returned error can't find the container with id 29079254d00183e1b668ce423dcaeac24bdcb51259f81d54f2d8ff7586198539
Jul 15 15:34:58.085771 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:58.085751    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-d479t"]
Jul 15 15:34:58.087853 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:34:58.087832    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa273192_872f_4d2d_bcdc_35e85bc99485.slice/crio-4a7337bb8a103fe689e78a2cd0b8002cc16b3002aec1f16b96cc2627a646935a WatchSource:0}: Error finding container 4a7337bb8a103fe689e78a2cd0b8002cc16b3002aec1f16b96cc2627a646935a: Status 404 returned error can't find the container with id 4a7337bb8a103fe689e78a2cd0b8002cc16b3002aec1f16b96cc2627a646935a
Jul 15 15:34:58.690967 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:58.690927    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-7fwng" event={"ID":"1871f089-c640-4943-a0fa-e1c448360d7a","Type":"ContainerStarted","Data":"29079254d00183e1b668ce423dcaeac24bdcb51259f81d54f2d8ff7586198539"}
Jul 15 15:34:58.692257 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:34:58.692210    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-d479t" event={"ID":"fa273192-872f-4d2d-bcdc-35e85bc99485","Type":"ContainerStarted","Data":"4a7337bb8a103fe689e78a2cd0b8002cc16b3002aec1f16b96cc2627a646935a"}
Jul 15 15:35:00.703762 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:00.703725    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-d479t" event={"ID":"fa273192-872f-4d2d-bcdc-35e85bc99485","Type":"ContainerStarted","Data":"0e5efc289529800e0e56dbf65c1e1fb6fa726ad2e5d0ffb9f03c5fe553afecd0"}
Jul 15 15:35:00.704246 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:00.703798    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-d479t"
Jul 15 15:35:00.705364 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:00.705339    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7f9fbcfccc-vt5w7" event={"ID":"2ed8a773-3c36-4963-8b3d-58133f7b3e28","Type":"ContainerStarted","Data":"680cf7b72f2dcc6ee886dff2ea8ede1e109ffa7b40bb760a6be291d9f6fa5394"}
Jul 15 15:35:00.705499 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:00.705387    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-7f9fbcfccc-vt5w7"
Jul 15 15:35:00.706684 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:00.706667    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-7fwng" event={"ID":"1871f089-c640-4943-a0fa-e1c448360d7a","Type":"ContainerStarted","Data":"a2e89c2981f2d4a5042bf7bc7e3f63b15004069a40d4689be8a9f56a1260d0ee"}
Jul 15 15:35:00.706776 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:00.706729    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-7fwng"
Jul 15 15:35:00.725059 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:00.725023    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-f9b8d9b9b-d479t" podStartSLOduration=1.8623414139999999 podStartE2EDuration="3.724995837s" totalImagesPullingTime="1.862654423s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:34:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:35:00.722579623 +0000 UTC m=+631.068482817" watchObservedRunningTime="2026-07-15 15:35:00.724995837 +0000 UTC m=+631.070899079"
Jul 15 15:35:00.742029 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:00.741975    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-74584bb9f8-7fwng" podStartSLOduration=1.858499615 podStartE2EDuration="3.741961769s" totalImagesPullingTime="1.883462154s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:34:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:35:00.740625341 +0000 UTC m=+631.086528535" watchObservedRunningTime="2026-07-15 15:35:00.741961769 +0000 UTC m=+631.087864962"
Jul 15 15:35:05.730130 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:05.730094    2564 generic.go:356] "Generic (PLEG): container finished" podID="6305fffd-77fc-4b0f-8ea3-1cac9f591cf6" containerID="97714cf057b3818dfe77a9dc1232f7517f411d6f120620580255e50e20c3e7de" exitCode=0
Jul 15 15:35:05.730531 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:05.730165    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cvc9d" event={"ID":"6305fffd-77fc-4b0f-8ea3-1cac9f591cf6","Type":"ContainerDied","Data":"97714cf057b3818dfe77a9dc1232f7517f411d6f120620580255e50e20c3e7de"}
Jul 15 15:35:05.730573 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:05.730544    2564 scope.go:117] "RemoveContainer" containerID="97714cf057b3818dfe77a9dc1232f7517f411d6f120620580255e50e20c3e7de"
Jul 15 15:35:05.731458 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:05.731430    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 15:35:05.731511 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:05.731499    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 15:35:05.731544 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:05.731529    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 15:35:05.752679 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:05.752637    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-7f9fbcfccc-vt5w7" podStartSLOduration=7.254229611 podStartE2EDuration="9.752621849s" totalImagesPullingTime="2.498392238s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:34:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:35:00.763029441 +0000 UTC m=+631.108932630" watchObservedRunningTime="2026-07-15 15:35:05.752621849 +0000 UTC m=+636.098525092"
Jul 15 15:35:06.717400 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:06.717371    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-7f9fbcfccc-vt5w7"
Jul 15 15:35:06.736751 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:06.736720    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cvc9d" event={"ID":"6305fffd-77fc-4b0f-8ea3-1cac9f591cf6","Type":"ContainerStarted","Data":"d71e852be0276ab79bebe5f9256e249221a9ae33f02a09ac8a58d8e40f265b04"}
Jul 15 15:35:07.260231 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:07.260189    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cvc9d"
Jul 15 15:35:07.260445 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:07.260333    2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-cvc9d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" start-of-body=
Jul 15 15:35:07.260445 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:07.260418    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cvc9d" podUID="6305fffd-77fc-4b0f-8ea3-1cac9f591cf6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused"
Jul 15 15:35:08.023393 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:08.023363    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:35:08.100237 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:08.100204    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:35:08.259501 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:08.259466    2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-cvc9d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" start-of-body=
Jul 15 15:35:08.259796 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:08.259746    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cvc9d" podUID="6305fffd-77fc-4b0f-8ea3-1cac9f591cf6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused"
Jul 15 15:35:09.259498 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:09.259456    2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-cvc9d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" start-of-body=
Jul 15 15:35:09.259965 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:09.259525    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cvc9d" podUID="6305fffd-77fc-4b0f-8ea3-1cac9f591cf6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused"
Jul 15 15:35:10.266490 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:10.266441    2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-cvc9d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" start-of-body=
Jul 15 15:35:10.266963 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:10.266514    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cvc9d" podUID="6305fffd-77fc-4b0f-8ea3-1cac9f591cf6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused"
Jul 15 15:35:11.262764 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:11.262729    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cvc9d"
Jul 15 15:35:11.263054 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:11.263033    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cvc9d"
Jul 15 15:35:11.263739 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:11.263719    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cvc9d"
Jul 15 15:35:11.713525 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:11.713498    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-d479t"
Jul 15 15:35:11.713908 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:11.713566    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-7fwng"
Jul 15 15:35:23.286627 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:23.286591    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kxzrj"]
Jul 15 15:35:23.288866 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:23.288845    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kxzrj"
Jul 15 15:35:23.291607 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:23.291582    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 15 15:35:23.292649 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:23.292626    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 15 15:35:23.292649 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:23.292642    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 15 15:35:23.292649 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:23.292645    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-bwbrz\""
Jul 15 15:35:23.306595 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:23.306573    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kxzrj"]
Jul 15 15:35:23.315216 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:23.315172    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:35:23.401049 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:23.400996    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/361d3522-de9e-4e9a-8044-90870a465418-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kxzrj\" (UID: \"361d3522-de9e-4e9a-8044-90870a465418\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kxzrj"
Jul 15 15:35:23.401198 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:23.401058    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/361d3522-de9e-4e9a-8044-90870a465418-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kxzrj\" (UID: \"361d3522-de9e-4e9a-8044-90870a465418\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kxzrj"
Jul 15 15:35:23.401198 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:23.401104    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/361d3522-de9e-4e9a-8044-90870a465418-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kxzrj\" (UID: \"361d3522-de9e-4e9a-8044-90870a465418\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kxzrj"
Jul 15 15:35:23.401198 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:23.401126    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/361d3522-de9e-4e9a-8044-90870a465418-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kxzrj\" (UID: \"361d3522-de9e-4e9a-8044-90870a465418\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kxzrj"
Jul 15 15:35:23.401198 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:23.401142    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5b7dx\" (UniqueName: \"kubernetes.io/projected/361d3522-de9e-4e9a-8044-90870a465418-kube-api-access-5b7dx\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kxzrj\" (UID: \"361d3522-de9e-4e9a-8044-90870a465418\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kxzrj"
Jul 15 15:35:23.401198 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:23.401186    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/361d3522-de9e-4e9a-8044-90870a465418-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kxzrj\" (UID: \"361d3522-de9e-4e9a-8044-90870a465418\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kxzrj"
Jul 15 15:35:23.502331 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:23.502300    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/361d3522-de9e-4e9a-8044-90870a465418-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kxzrj\" (UID: \"361d3522-de9e-4e9a-8044-90870a465418\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kxzrj"
Jul 15 15:35:23.502483 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:23.502337    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/361d3522-de9e-4e9a-8044-90870a465418-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kxzrj\" (UID: \"361d3522-de9e-4e9a-8044-90870a465418\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kxzrj"
Jul 15 15:35:23.502483 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:23.502359    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/361d3522-de9e-4e9a-8044-90870a465418-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kxzrj\" (UID: \"361d3522-de9e-4e9a-8044-90870a465418\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kxzrj"
Jul 15 15:35:23.502483 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:23.502471    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/361d3522-de9e-4e9a-8044-90870a465418-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kxzrj\" (UID: \"361d3522-de9e-4e9a-8044-90870a465418\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kxzrj"
Jul 15 15:35:23.502607 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:23.502501    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5b7dx\" (UniqueName: \"kubernetes.io/projected/361d3522-de9e-4e9a-8044-90870a465418-kube-api-access-5b7dx\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kxzrj\" (UID: \"361d3522-de9e-4e9a-8044-90870a465418\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kxzrj"
Jul 15 15:35:23.502607 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:23.502521    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/361d3522-de9e-4e9a-8044-90870a465418-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kxzrj\" (UID: \"361d3522-de9e-4e9a-8044-90870a465418\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kxzrj"
Jul 15 15:35:23.502710 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:23.502653    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/361d3522-de9e-4e9a-8044-90870a465418-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kxzrj\" (UID: \"361d3522-de9e-4e9a-8044-90870a465418\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kxzrj"
Jul 15 15:35:23.502808 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:23.502788    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/361d3522-de9e-4e9a-8044-90870a465418-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kxzrj\" (UID: \"361d3522-de9e-4e9a-8044-90870a465418\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kxzrj"
Jul 15 15:35:23.502870 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:23.502855    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/361d3522-de9e-4e9a-8044-90870a465418-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kxzrj\" (UID: \"361d3522-de9e-4e9a-8044-90870a465418\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kxzrj"
Jul 15 15:35:23.504466 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:23.504449    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/361d3522-de9e-4e9a-8044-90870a465418-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kxzrj\" (UID: \"361d3522-de9e-4e9a-8044-90870a465418\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kxzrj"
Jul 15 15:35:23.504899 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:23.504883    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/361d3522-de9e-4e9a-8044-90870a465418-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kxzrj\" (UID: \"361d3522-de9e-4e9a-8044-90870a465418\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kxzrj"
Jul 15 15:35:23.514894 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:23.514868    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5b7dx\" (UniqueName: \"kubernetes.io/projected/361d3522-de9e-4e9a-8044-90870a465418-kube-api-access-5b7dx\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kxzrj\" (UID: \"361d3522-de9e-4e9a-8044-90870a465418\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kxzrj"
Jul 15 15:35:23.598567 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:23.598497    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kxzrj"
Jul 15 15:35:23.731399 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:23.731375    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kxzrj"]
Jul 15 15:35:23.733766 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:35:23.733739    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod361d3522_de9e_4e9a_8044_90870a465418.slice/crio-19e3153a50e23731284f01b6d0d08cfc08523c9d91c346951753870893a1dc7d WatchSource:0}: Error finding container 19e3153a50e23731284f01b6d0d08cfc08523c9d91c346951753870893a1dc7d: Status 404 returned error can't find the container with id 19e3153a50e23731284f01b6d0d08cfc08523c9d91c346951753870893a1dc7d
Jul 15 15:35:23.816185 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:23.816156    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kxzrj" event={"ID":"361d3522-de9e-4e9a-8044-90870a465418","Type":"ContainerStarted","Data":"19e3153a50e23731284f01b6d0d08cfc08523c9d91c346951753870893a1dc7d"}
Jul 15 15:35:25.827722 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:25.827686    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kxzrj" event={"ID":"361d3522-de9e-4e9a-8044-90870a465418","Type":"ContainerStarted","Data":"fb95141b19f68ec2189600b5d63d8a0ac516ccc9aea512e8a37fbac0ca01de9c"}
Jul 15 15:35:25.848546 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:25.848491    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kxzrj" podStartSLOduration=1.7301494389999998 podStartE2EDuration="2.848478729s" totalImagesPullingTime="1.11832929s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:35:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:35:25.846666246 +0000 UTC m=+656.192569439" watchObservedRunningTime="2026-07-15 15:35:25.848478729 +0000 UTC m=+656.194381922"
Jul 15 15:35:31.771132 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:31.771092    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-257b2"]
Jul 15 15:35:31.775604 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:31.775583    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-257b2"
Jul 15 15:35:31.778337 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:31.778302    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 15 15:35:31.788894 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:31.788869    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-257b2"]
Jul 15 15:35:31.831116 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:31.831088    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:35:31.863818 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:31.863790    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7aa492f4-8db2-42e2-8fc8-5c1dfb6c1389-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-257b2\" (UID: \"7aa492f4-8db2-42e2-8fc8-5c1dfb6c1389\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-257b2"
Jul 15 15:35:31.863968 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:31.863836    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6fp2\" (UniqueName: \"kubernetes.io/projected/7aa492f4-8db2-42e2-8fc8-5c1dfb6c1389-kube-api-access-d6fp2\") pod \"e2e-distinct-simulated-kserve-59975d69f9-257b2\" (UID: \"7aa492f4-8db2-42e2-8fc8-5c1dfb6c1389\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-257b2"
Jul 15 15:35:31.863968 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:31.863858    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7aa492f4-8db2-42e2-8fc8-5c1dfb6c1389-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-257b2\" (UID: \"7aa492f4-8db2-42e2-8fc8-5c1dfb6c1389\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-257b2"
Jul 15 15:35:31.863968 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:31.863926    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7aa492f4-8db2-42e2-8fc8-5c1dfb6c1389-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-257b2\" (UID: \"7aa492f4-8db2-42e2-8fc8-5c1dfb6c1389\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-257b2"
Jul 15 15:35:31.864192 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:31.863979    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7aa492f4-8db2-42e2-8fc8-5c1dfb6c1389-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-257b2\" (UID: \"7aa492f4-8db2-42e2-8fc8-5c1dfb6c1389\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-257b2"
Jul 15 15:35:31.864192 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:31.864004    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7aa492f4-8db2-42e2-8fc8-5c1dfb6c1389-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-257b2\" (UID: \"7aa492f4-8db2-42e2-8fc8-5c1dfb6c1389\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-257b2"
Jul 15 15:35:31.965287 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:31.965254    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7aa492f4-8db2-42e2-8fc8-5c1dfb6c1389-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-257b2\" (UID: \"7aa492f4-8db2-42e2-8fc8-5c1dfb6c1389\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-257b2"
Jul 15 15:35:31.965287 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:31.965292    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7aa492f4-8db2-42e2-8fc8-5c1dfb6c1389-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-257b2\" (UID: \"7aa492f4-8db2-42e2-8fc8-5c1dfb6c1389\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-257b2"
Jul 15 15:35:31.965482 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:31.965326    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7aa492f4-8db2-42e2-8fc8-5c1dfb6c1389-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-257b2\" (UID: \"7aa492f4-8db2-42e2-8fc8-5c1dfb6c1389\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-257b2"
Jul 15 15:35:31.965482 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:31.965350    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7aa492f4-8db2-42e2-8fc8-5c1dfb6c1389-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-257b2\" (UID: \"7aa492f4-8db2-42e2-8fc8-5c1dfb6c1389\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-257b2"
Jul 15 15:35:31.965482 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:31.965390    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7aa492f4-8db2-42e2-8fc8-5c1dfb6c1389-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-257b2\" (UID: \"7aa492f4-8db2-42e2-8fc8-5c1dfb6c1389\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-257b2"
Jul 15 15:35:31.965482 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:31.965443    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6fp2\" (UniqueName: \"kubernetes.io/projected/7aa492f4-8db2-42e2-8fc8-5c1dfb6c1389-kube-api-access-d6fp2\") pod \"e2e-distinct-simulated-kserve-59975d69f9-257b2\" (UID: \"7aa492f4-8db2-42e2-8fc8-5c1dfb6c1389\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-257b2"
Jul 15 15:35:31.965764 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:31.965738    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7aa492f4-8db2-42e2-8fc8-5c1dfb6c1389-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-257b2\" (UID: \"7aa492f4-8db2-42e2-8fc8-5c1dfb6c1389\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-257b2"
Jul 15 15:35:31.967788 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:31.965793    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7aa492f4-8db2-42e2-8fc8-5c1dfb6c1389-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-257b2\" (UID: \"7aa492f4-8db2-42e2-8fc8-5c1dfb6c1389\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-257b2"
Jul 15 15:35:31.967788 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:31.966219    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7aa492f4-8db2-42e2-8fc8-5c1dfb6c1389-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-257b2\" (UID: \"7aa492f4-8db2-42e2-8fc8-5c1dfb6c1389\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-257b2"
Jul 15 15:35:31.972143 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:31.968527    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7aa492f4-8db2-42e2-8fc8-5c1dfb6c1389-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-257b2\" (UID: \"7aa492f4-8db2-42e2-8fc8-5c1dfb6c1389\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-257b2"
Jul 15 15:35:31.973004 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:31.972982    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7aa492f4-8db2-42e2-8fc8-5c1dfb6c1389-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-257b2\" (UID: \"7aa492f4-8db2-42e2-8fc8-5c1dfb6c1389\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-257b2"
Jul 15 15:35:31.975272 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:31.975238    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6fp2\" (UniqueName: \"kubernetes.io/projected/7aa492f4-8db2-42e2-8fc8-5c1dfb6c1389-kube-api-access-d6fp2\") pod \"e2e-distinct-simulated-kserve-59975d69f9-257b2\" (UID: \"7aa492f4-8db2-42e2-8fc8-5c1dfb6c1389\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-257b2"
Jul 15 15:35:32.088161 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:32.088108    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-257b2"
Jul 15 15:35:32.217730 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:32.217706    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-257b2"]
Jul 15 15:35:32.219501 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:35:32.219476    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7aa492f4_8db2_42e2_8fc8_5c1dfb6c1389.slice/crio-f092313d656a9319e4cd9cf61a2f6da13d33c7d02663771e56b6325e54d6397b WatchSource:0}: Error finding container f092313d656a9319e4cd9cf61a2f6da13d33c7d02663771e56b6325e54d6397b: Status 404 returned error can't find the container with id f092313d656a9319e4cd9cf61a2f6da13d33c7d02663771e56b6325e54d6397b
Jul 15 15:35:32.860582 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:32.860547    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-257b2" event={"ID":"7aa492f4-8db2-42e2-8fc8-5c1dfb6c1389","Type":"ContainerStarted","Data":"710b5024fe091442d06e6d4a6a71355b7e72a21df9021a5dd9940c9ac77d70ae"}
Jul 15 15:35:32.860984 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:32.860597    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-257b2" event={"ID":"7aa492f4-8db2-42e2-8fc8-5c1dfb6c1389","Type":"ContainerStarted","Data":"f092313d656a9319e4cd9cf61a2f6da13d33c7d02663771e56b6325e54d6397b"}
Jul 15 15:35:32.885067 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:32.884997    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-257b2" podStartSLOduration=1.649959794 podStartE2EDuration="1.884980978s" totalImagesPullingTime="235.021184ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:35:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:35:32.883599267 +0000 UTC m=+663.229502461" watchObservedRunningTime="2026-07-15 15:35:32.884980978 +0000 UTC m=+663.230884171"
Jul 15 15:35:33.599080 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:33.599042    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kxzrj"
Jul 15 15:35:33.599254 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:33.599103    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kxzrj"
Jul 15 15:35:33.611502 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:33.611474    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kxzrj"
Jul 15 15:35:33.876201 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:33.876116    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kxzrj"
Jul 15 15:35:34.970552 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:34.970519    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-5l6c7"]
Jul 15 15:35:34.974744 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:34.974721    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5l6c7"
Jul 15 15:35:34.977394 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:34.977374    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 15 15:35:34.987239 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:34.987214    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-5l6c7"]
Jul 15 15:35:35.006283 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:35.006257    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:35:35.094392 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:35.094358    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b574fc8d-fe95-4449-a66f-2d506ccfc994-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5l6c7\" (UID: \"b574fc8d-fe95-4449-a66f-2d506ccfc994\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5l6c7"
Jul 15 15:35:35.094392 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:35.094391    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b574fc8d-fe95-4449-a66f-2d506ccfc994-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5l6c7\" (UID: \"b574fc8d-fe95-4449-a66f-2d506ccfc994\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5l6c7"
Jul 15 15:35:35.094614 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:35.094421    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b574fc8d-fe95-4449-a66f-2d506ccfc994-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5l6c7\" (UID: \"b574fc8d-fe95-4449-a66f-2d506ccfc994\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5l6c7"
Jul 15 15:35:35.094614 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:35.094500    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b574fc8d-fe95-4449-a66f-2d506ccfc994-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5l6c7\" (UID: \"b574fc8d-fe95-4449-a66f-2d506ccfc994\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5l6c7"
Jul 15 15:35:35.094614 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:35.094542    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckx9f\" (UniqueName: \"kubernetes.io/projected/b574fc8d-fe95-4449-a66f-2d506ccfc994-kube-api-access-ckx9f\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5l6c7\" (UID: \"b574fc8d-fe95-4449-a66f-2d506ccfc994\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5l6c7"
Jul 15 15:35:35.094727 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:35.094625    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b574fc8d-fe95-4449-a66f-2d506ccfc994-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5l6c7\" (UID: \"b574fc8d-fe95-4449-a66f-2d506ccfc994\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5l6c7"
Jul 15 15:35:35.195338 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:35.195308    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b574fc8d-fe95-4449-a66f-2d506ccfc994-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5l6c7\" (UID: \"b574fc8d-fe95-4449-a66f-2d506ccfc994\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5l6c7"
Jul 15 15:35:35.195505 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:35.195365    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b574fc8d-fe95-4449-a66f-2d506ccfc994-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5l6c7\" (UID: \"b574fc8d-fe95-4449-a66f-2d506ccfc994\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5l6c7"
Jul 15 15:35:35.195505 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:35.195385    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b574fc8d-fe95-4449-a66f-2d506ccfc994-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5l6c7\" (UID: \"b574fc8d-fe95-4449-a66f-2d506ccfc994\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5l6c7"
Jul 15 15:35:35.195505 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:35.195415    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b574fc8d-fe95-4449-a66f-2d506ccfc994-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5l6c7\" (UID: \"b574fc8d-fe95-4449-a66f-2d506ccfc994\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5l6c7"
Jul 15 15:35:35.195505 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:35.195447    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b574fc8d-fe95-4449-a66f-2d506ccfc994-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5l6c7\" (UID: \"b574fc8d-fe95-4449-a66f-2d506ccfc994\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5l6c7"
Jul 15 15:35:35.195505 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:35.195471    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckx9f\" (UniqueName: \"kubernetes.io/projected/b574fc8d-fe95-4449-a66f-2d506ccfc994-kube-api-access-ckx9f\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5l6c7\" (UID: \"b574fc8d-fe95-4449-a66f-2d506ccfc994\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5l6c7"
Jul 15 15:35:35.195801 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:35.195767    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b574fc8d-fe95-4449-a66f-2d506ccfc994-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5l6c7\" (UID: \"b574fc8d-fe95-4449-a66f-2d506ccfc994\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5l6c7"
Jul 15 15:35:35.195926 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:35.195814    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b574fc8d-fe95-4449-a66f-2d506ccfc994-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5l6c7\" (UID: \"b574fc8d-fe95-4449-a66f-2d506ccfc994\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5l6c7"
Jul 15 15:35:35.195926 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:35.195844    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b574fc8d-fe95-4449-a66f-2d506ccfc994-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5l6c7\" (UID: \"b574fc8d-fe95-4449-a66f-2d506ccfc994\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5l6c7"
Jul 15 15:35:35.197535 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:35.197515    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b574fc8d-fe95-4449-a66f-2d506ccfc994-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5l6c7\" (UID: \"b574fc8d-fe95-4449-a66f-2d506ccfc994\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5l6c7"
Jul 15 15:35:35.197761 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:35.197743    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b574fc8d-fe95-4449-a66f-2d506ccfc994-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5l6c7\" (UID: \"b574fc8d-fe95-4449-a66f-2d506ccfc994\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5l6c7"
Jul 15 15:35:35.203829 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:35.203803    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckx9f\" (UniqueName: \"kubernetes.io/projected/b574fc8d-fe95-4449-a66f-2d506ccfc994-kube-api-access-ckx9f\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5l6c7\" (UID: \"b574fc8d-fe95-4449-a66f-2d506ccfc994\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5l6c7"
Jul 15 15:35:35.286449 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:35.286421    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5l6c7"
Jul 15 15:35:35.417194 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:35.417159    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-5l6c7"]
Jul 15 15:35:35.419930 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:35:35.419902    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb574fc8d_fe95_4449_a66f_2d506ccfc994.slice/crio-c177dd2034d73189ad62cf1335eeaca3411c6d2b5bb2e85bb3092866c0e3dda5 WatchSource:0}: Error finding container c177dd2034d73189ad62cf1335eeaca3411c6d2b5bb2e85bb3092866c0e3dda5: Status 404 returned error can't find the container with id c177dd2034d73189ad62cf1335eeaca3411c6d2b5bb2e85bb3092866c0e3dda5
Jul 15 15:35:35.875162 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:35.875127    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5l6c7" event={"ID":"b574fc8d-fe95-4449-a66f-2d506ccfc994","Type":"ContainerStarted","Data":"ff758afd26d12f483e40b6af25a1ca5c70b5d1cd0922acb5c83b71efe2e8015a"}
Jul 15 15:35:35.875333 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:35.875178    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5l6c7" event={"ID":"b574fc8d-fe95-4449-a66f-2d506ccfc994","Type":"ContainerStarted","Data":"c177dd2034d73189ad62cf1335eeaca3411c6d2b5bb2e85bb3092866c0e3dda5"}
Jul 15 15:35:35.927279 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:35.927198    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5l6c7" podStartSLOduration=1.711934981 podStartE2EDuration="1.927184107s" totalImagesPullingTime="215.249126ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:35:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:35:35.924276911 +0000 UTC m=+666.270180104" watchObservedRunningTime="2026-07-15 15:35:35.927184107 +0000 UTC m=+666.273087300"
Jul 15 15:35:40.003429 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:40.003397    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:35:42.088440 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:42.088409    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-257b2"
Jul 15 15:35:42.088868 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:42.088461    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-257b2"
Jul 15 15:35:42.101039 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:42.101001    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-257b2"
Jul 15 15:35:42.921815 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:42.921788    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-257b2"
Jul 15 15:35:44.259465 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:44.259434    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-8s6gj"]
Jul 15 15:35:44.262996 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:44.262974    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8s6gj"
Jul 15 15:35:44.266681 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:44.266657    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 15 15:35:44.275615 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:44.275593    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-8s6gj"]
Jul 15 15:35:44.304932 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:44.304906    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:35:44.371226 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:44.371200    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6c6n\" (UniqueName: \"kubernetes.io/projected/3e02f457-254c-438b-9574-56b9d1cb2fd0-kube-api-access-g6c6n\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8s6gj\" (UID: \"3e02f457-254c-438b-9574-56b9d1cb2fd0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8s6gj"
Jul 15 15:35:44.371324 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:44.371242    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e02f457-254c-438b-9574-56b9d1cb2fd0-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8s6gj\" (UID: \"3e02f457-254c-438b-9574-56b9d1cb2fd0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8s6gj"
Jul 15 15:35:44.371324 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:44.371269    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e02f457-254c-438b-9574-56b9d1cb2fd0-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8s6gj\" (UID: \"3e02f457-254c-438b-9574-56b9d1cb2fd0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8s6gj"
Jul 15 15:35:44.371398 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:44.371326    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e02f457-254c-438b-9574-56b9d1cb2fd0-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8s6gj\" (UID: \"3e02f457-254c-438b-9574-56b9d1cb2fd0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8s6gj"
Jul 15 15:35:44.371398 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:44.371371    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e02f457-254c-438b-9574-56b9d1cb2fd0-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8s6gj\" (UID: \"3e02f457-254c-438b-9574-56b9d1cb2fd0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8s6gj"
Jul 15 15:35:44.371497 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:44.371402    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e02f457-254c-438b-9574-56b9d1cb2fd0-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8s6gj\" (UID: \"3e02f457-254c-438b-9574-56b9d1cb2fd0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8s6gj"
Jul 15 15:35:44.472541 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:44.472512    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6c6n\" (UniqueName: \"kubernetes.io/projected/3e02f457-254c-438b-9574-56b9d1cb2fd0-kube-api-access-g6c6n\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8s6gj\" (UID: \"3e02f457-254c-438b-9574-56b9d1cb2fd0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8s6gj"
Jul 15 15:35:44.472669 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:44.472569    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e02f457-254c-438b-9574-56b9d1cb2fd0-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8s6gj\" (UID: \"3e02f457-254c-438b-9574-56b9d1cb2fd0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8s6gj"
Jul 15 15:35:44.472669 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:44.472597    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e02f457-254c-438b-9574-56b9d1cb2fd0-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8s6gj\" (UID: \"3e02f457-254c-438b-9574-56b9d1cb2fd0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8s6gj"
Jul 15 15:35:44.472669 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:44.472628    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e02f457-254c-438b-9574-56b9d1cb2fd0-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8s6gj\" (UID: \"3e02f457-254c-438b-9574-56b9d1cb2fd0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8s6gj"
Jul 15 15:35:44.472841 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:44.472757    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e02f457-254c-438b-9574-56b9d1cb2fd0-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8s6gj\" (UID: \"3e02f457-254c-438b-9574-56b9d1cb2fd0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8s6gj"
Jul 15 15:35:44.472931 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:44.472905    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e02f457-254c-438b-9574-56b9d1cb2fd0-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8s6gj\" (UID: \"3e02f457-254c-438b-9574-56b9d1cb2fd0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8s6gj"
Jul 15 15:35:44.473100 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:44.473068    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e02f457-254c-438b-9574-56b9d1cb2fd0-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8s6gj\" (UID: \"3e02f457-254c-438b-9574-56b9d1cb2fd0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8s6gj"
Jul 15 15:35:44.473207 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:44.473120    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e02f457-254c-438b-9574-56b9d1cb2fd0-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8s6gj\" (UID: \"3e02f457-254c-438b-9574-56b9d1cb2fd0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8s6gj"
Jul 15 15:35:44.473207 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:44.473192    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e02f457-254c-438b-9574-56b9d1cb2fd0-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8s6gj\" (UID: \"3e02f457-254c-438b-9574-56b9d1cb2fd0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8s6gj"
Jul 15 15:35:44.474870 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:44.474845    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e02f457-254c-438b-9574-56b9d1cb2fd0-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8s6gj\" (UID: \"3e02f457-254c-438b-9574-56b9d1cb2fd0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8s6gj"
Jul 15 15:35:44.475158 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:44.475144    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e02f457-254c-438b-9574-56b9d1cb2fd0-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8s6gj\" (UID: \"3e02f457-254c-438b-9574-56b9d1cb2fd0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8s6gj"
Jul 15 15:35:44.480181 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:44.480162    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6c6n\" (UniqueName: \"kubernetes.io/projected/3e02f457-254c-438b-9574-56b9d1cb2fd0-kube-api-access-g6c6n\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8s6gj\" (UID: \"3e02f457-254c-438b-9574-56b9d1cb2fd0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8s6gj"
Jul 15 15:35:44.576288 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:44.576263    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8s6gj"
Jul 15 15:35:44.707952 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:44.707920    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-8s6gj"]
Jul 15 15:35:44.711426 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:35:44.711397    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e02f457_254c_438b_9574_56b9d1cb2fd0.slice/crio-4ac225f19eef9afde2177becb2611998e707c4b22796c53aa255f047c1328910 WatchSource:0}: Error finding container 4ac225f19eef9afde2177becb2611998e707c4b22796c53aa255f047c1328910: Status 404 returned error can't find the container with id 4ac225f19eef9afde2177becb2611998e707c4b22796c53aa255f047c1328910
Jul 15 15:35:44.712807 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:44.712790    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 15:35:44.919935 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:44.919879    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8s6gj" event={"ID":"3e02f457-254c-438b-9574-56b9d1cb2fd0","Type":"ContainerStarted","Data":"4ac225f19eef9afde2177becb2611998e707c4b22796c53aa255f047c1328910"}
Jul 15 15:35:45.287096 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:45.287071    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5l6c7"
Jul 15 15:35:45.287415 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:45.287129    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5l6c7"
Jul 15 15:35:45.299093 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:45.299074    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5l6c7"
Jul 15 15:35:45.926054 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:45.926018    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8s6gj" event={"ID":"3e02f457-254c-438b-9574-56b9d1cb2fd0","Type":"ContainerStarted","Data":"02391e88ebae1f530fbfd44766ea629e64a895bc37b89eb11712716ca3ec238b"}
Jul 15 15:35:45.937283 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:45.937257    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5l6c7"
Jul 15 15:35:45.944524 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:45.944460    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8s6gj" podStartSLOduration=1.620797176 podStartE2EDuration="1.94444669s" totalImagesPullingTime="323.649514ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:35:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:35:45.943849202 +0000 UTC m=+676.289752396" watchObservedRunningTime="2026-07-15 15:35:45.94444669 +0000 UTC m=+676.290349882"
Jul 15 15:35:54.576422 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:54.576390    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8s6gj"
Jul 15 15:35:54.576768 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:54.576460    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8s6gj"
Jul 15 15:35:54.588681 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:54.588661    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8s6gj"
Jul 15 15:35:54.977847 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:54.977767    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8s6gj"
Jul 15 15:35:58.237687 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:35:58.237652    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:21.238844 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:36:21.238812    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:56.871421 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:36:56.871343    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8895cdf46-r8qzc"]
Jul 15 15:36:56.874598 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:36:56.874576    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8895cdf46-r8qzc"
Jul 15 15:36:56.878390 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:36:56.878372    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 15 15:36:56.878482 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:36:56.878412    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-dwnh6\""
Jul 15 15:36:56.884108 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:36:56.884087    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8895cdf46-r8qzc"]
Jul 15 15:36:56.968152 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:36:56.968121    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7d663bc6-0c06-4a6b-b3ef-110c7dc102b2-tls-cert\") pod \"authorino-8895cdf46-r8qzc\" (UID: \"7d663bc6-0c06-4a6b-b3ef-110c7dc102b2\") " pod="kuadrant-system/authorino-8895cdf46-r8qzc"
Jul 15 15:36:56.968293 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:36:56.968158    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gblwz\" (UniqueName: \"kubernetes.io/projected/7d663bc6-0c06-4a6b-b3ef-110c7dc102b2-kube-api-access-gblwz\") pod \"authorino-8895cdf46-r8qzc\" (UID: \"7d663bc6-0c06-4a6b-b3ef-110c7dc102b2\") " pod="kuadrant-system/authorino-8895cdf46-r8qzc"
Jul 15 15:36:57.069503 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:36:57.069472    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7d663bc6-0c06-4a6b-b3ef-110c7dc102b2-tls-cert\") pod \"authorino-8895cdf46-r8qzc\" (UID: \"7d663bc6-0c06-4a6b-b3ef-110c7dc102b2\") " pod="kuadrant-system/authorino-8895cdf46-r8qzc"
Jul 15 15:36:57.069647 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:36:57.069509    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gblwz\" (UniqueName: \"kubernetes.io/projected/7d663bc6-0c06-4a6b-b3ef-110c7dc102b2-kube-api-access-gblwz\") pod \"authorino-8895cdf46-r8qzc\" (UID: \"7d663bc6-0c06-4a6b-b3ef-110c7dc102b2\") " pod="kuadrant-system/authorino-8895cdf46-r8qzc"
Jul 15 15:36:57.071930 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:36:57.071901    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7d663bc6-0c06-4a6b-b3ef-110c7dc102b2-tls-cert\") pod \"authorino-8895cdf46-r8qzc\" (UID: \"7d663bc6-0c06-4a6b-b3ef-110c7dc102b2\") " pod="kuadrant-system/authorino-8895cdf46-r8qzc"
Jul 15 15:36:57.076859 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:36:57.076841    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gblwz\" (UniqueName: \"kubernetes.io/projected/7d663bc6-0c06-4a6b-b3ef-110c7dc102b2-kube-api-access-gblwz\") pod \"authorino-8895cdf46-r8qzc\" (UID: \"7d663bc6-0c06-4a6b-b3ef-110c7dc102b2\") " pod="kuadrant-system/authorino-8895cdf46-r8qzc"
Jul 15 15:36:57.183316 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:36:57.183248    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8895cdf46-r8qzc"
Jul 15 15:36:57.326672 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:36:57.326652    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8895cdf46-r8qzc"]
Jul 15 15:36:57.328836 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:36:57.328801    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7d663bc6_0c06_4a6b_b3ef_110c7dc102b2.slice/crio-cf2fcba4a5843ec2db839a00d6a7fc58b0bcc04973fef5cd63fc804c9f379f7d WatchSource:0}: Error finding container cf2fcba4a5843ec2db839a00d6a7fc58b0bcc04973fef5cd63fc804c9f379f7d: Status 404 returned error can't find the container with id cf2fcba4a5843ec2db839a00d6a7fc58b0bcc04973fef5cd63fc804c9f379f7d
Jul 15 15:36:57.396915 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:36:57.396888    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:57.480236 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:36:57.480184    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:58.253403 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:36:58.253363    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8895cdf46-r8qzc" event={"ID":"7d663bc6-0c06-4a6b-b3ef-110c7dc102b2","Type":"ContainerStarted","Data":"74c20e2144dc15d1ece7ce501f927d60b03ec770984917b8c064c58021679175"}
Jul 15 15:36:58.253830 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:36:58.253415    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8895cdf46-r8qzc" event={"ID":"7d663bc6-0c06-4a6b-b3ef-110c7dc102b2","Type":"ContainerStarted","Data":"cf2fcba4a5843ec2db839a00d6a7fc58b0bcc04973fef5cd63fc804c9f379f7d"}
Jul 15 15:36:58.277820 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:36:58.277761    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-8895cdf46-r8qzc" podStartSLOduration=1.871279574 podStartE2EDuration="2.277739378s" totalImagesPullingTime="406.459804ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:36:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:36:58.276495296 +0000 UTC m=+748.622398490" watchObservedRunningTime="2026-07-15 15:36:58.277739378 +0000 UTC m=+748.623642573"
Jul 15 15:36:58.736709 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:36:58.736679    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:58.861558 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:36:58.861518    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:37:34.967439 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:37:34.967402    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:38:21.795470 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:38:21.795436    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:38:21.893881 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:38:21.893853    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5cd4d7f4b-62fft"]
Jul 15 15:38:21.894109 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:38:21.894086    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5cd4d7f4b-62fft" podUID="7a0f5477-066e-49f9-a153-a02bb6c719a9" containerName="manager" containerID="cri-o://b7ec4ae19eb0279a18acc742b728dba3c709cf1476b8ab50822197745e178377" gracePeriod=30
Jul 15 15:38:22.143341 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:38:22.143320    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5cd4d7f4b-62fft"
Jul 15 15:38:22.302064 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:38:22.302032    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7a0f5477-066e-49f9-a153-a02bb6c719a9-webhook-cert\") pod \"7a0f5477-066e-49f9-a153-a02bb6c719a9\" (UID: \"7a0f5477-066e-49f9-a153-a02bb6c719a9\") "
Jul 15 15:38:22.302245 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:38:22.302101    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4m9wz\" (UniqueName: \"kubernetes.io/projected/7a0f5477-066e-49f9-a153-a02bb6c719a9-kube-api-access-4m9wz\") pod \"7a0f5477-066e-49f9-a153-a02bb6c719a9\" (UID: \"7a0f5477-066e-49f9-a153-a02bb6c719a9\") "
Jul 15 15:38:22.304119 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:38:22.304094    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a0f5477-066e-49f9-a153-a02bb6c719a9-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "7a0f5477-066e-49f9-a153-a02bb6c719a9" (UID: "7a0f5477-066e-49f9-a153-a02bb6c719a9"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 15:38:22.304212 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:38:22.304156    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a0f5477-066e-49f9-a153-a02bb6c719a9-kube-api-access-4m9wz" (OuterVolumeSpecName: "kube-api-access-4m9wz") pod "7a0f5477-066e-49f9-a153-a02bb6c719a9" (UID: "7a0f5477-066e-49f9-a153-a02bb6c719a9"). InnerVolumeSpecName "kube-api-access-4m9wz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:38:22.402803 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:38:22.402711    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4m9wz\" (UniqueName: \"kubernetes.io/projected/7a0f5477-066e-49f9-a153-a02bb6c719a9-kube-api-access-4m9wz\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 15:38:22.402803 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:38:22.402743    2564 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7a0f5477-066e-49f9-a153-a02bb6c719a9-webhook-cert\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 15:38:22.629080 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:38:22.629046    2564 generic.go:356] "Generic (PLEG): container finished" podID="7a0f5477-066e-49f9-a153-a02bb6c719a9" containerID="b7ec4ae19eb0279a18acc742b728dba3c709cf1476b8ab50822197745e178377" exitCode=0
Jul 15 15:38:22.629249 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:38:22.629136    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5cd4d7f4b-62fft"
Jul 15 15:38:22.629249 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:38:22.629172    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5cd4d7f4b-62fft" event={"ID":"7a0f5477-066e-49f9-a153-a02bb6c719a9","Type":"ContainerDied","Data":"b7ec4ae19eb0279a18acc742b728dba3c709cf1476b8ab50822197745e178377"}
Jul 15 15:38:22.629249 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:38:22.629224    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5cd4d7f4b-62fft" event={"ID":"7a0f5477-066e-49f9-a153-a02bb6c719a9","Type":"ContainerDied","Data":"c29a72524859da2d3d343c9738e1024786d1562c0806c2fc8625eb9e412fb477"}
Jul 15 15:38:22.629249 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:38:22.629246    2564 scope.go:117] "RemoveContainer" containerID="b7ec4ae19eb0279a18acc742b728dba3c709cf1476b8ab50822197745e178377"
Jul 15 15:38:22.638233 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:38:22.638218    2564 scope.go:117] "RemoveContainer" containerID="b7ec4ae19eb0279a18acc742b728dba3c709cf1476b8ab50822197745e178377"
Jul 15 15:38:22.638468 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:38:22.638447    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7ec4ae19eb0279a18acc742b728dba3c709cf1476b8ab50822197745e178377\": container with ID starting with b7ec4ae19eb0279a18acc742b728dba3c709cf1476b8ab50822197745e178377 not found: ID does not exist" containerID="b7ec4ae19eb0279a18acc742b728dba3c709cf1476b8ab50822197745e178377"
Jul 15 15:38:22.638534 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:38:22.638475    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7ec4ae19eb0279a18acc742b728dba3c709cf1476b8ab50822197745e178377"} err="failed to get container status \"b7ec4ae19eb0279a18acc742b728dba3c709cf1476b8ab50822197745e178377\": rpc error: code = NotFound desc = could not find container \"b7ec4ae19eb0279a18acc742b728dba3c709cf1476b8ab50822197745e178377\": container with ID starting with b7ec4ae19eb0279a18acc742b728dba3c709cf1476b8ab50822197745e178377 not found: ID does not exist"
Jul 15 15:38:22.650715 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:38:22.650685    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5cd4d7f4b-62fft"]
Jul 15 15:38:22.656477 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:38:22.656430    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5cd4d7f4b-62fft"]
Jul 15 15:38:23.351629 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:38:23.351597    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:38:23.480910 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:38:23.480882    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5cd4d7f4b-8p4dt"]
Jul 15 15:38:23.481246 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:38:23.481232    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a0f5477-066e-49f9-a153-a02bb6c719a9" containerName="manager"
Jul 15 15:38:23.481307 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:38:23.481247    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a0f5477-066e-49f9-a153-a02bb6c719a9" containerName="manager"
Jul 15 15:38:23.481346 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:38:23.481317    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a0f5477-066e-49f9-a153-a02bb6c719a9" containerName="manager"
Jul 15 15:38:23.485616 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:38:23.485602    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5cd4d7f4b-8p4dt"
Jul 15 15:38:23.489379 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:38:23.489347    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 15 15:38:23.489379 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:38:23.489371    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 15 15:38:23.489551 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:38:23.489412    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-vwkk2\""
Jul 15 15:38:23.496044 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:38:23.496003    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5cd4d7f4b-8p4dt"]
Jul 15 15:38:23.612223 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:38:23.612119    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/08e4af4b-218a-4da1-89fd-70879c3f667e-webhook-cert\") pod \"maas-controller-5cd4d7f4b-8p4dt\" (UID: \"08e4af4b-218a-4da1-89fd-70879c3f667e\") " pod="opendatahub/maas-controller-5cd4d7f4b-8p4dt"
Jul 15 15:38:23.612223 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:38:23.612164    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrnwp\" (UniqueName: \"kubernetes.io/projected/08e4af4b-218a-4da1-89fd-70879c3f667e-kube-api-access-xrnwp\") pod \"maas-controller-5cd4d7f4b-8p4dt\" (UID: \"08e4af4b-218a-4da1-89fd-70879c3f667e\") " pod="opendatahub/maas-controller-5cd4d7f4b-8p4dt"
Jul 15 15:38:23.713106 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:38:23.713069    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/08e4af4b-218a-4da1-89fd-70879c3f667e-webhook-cert\") pod \"maas-controller-5cd4d7f4b-8p4dt\" (UID: \"08e4af4b-218a-4da1-89fd-70879c3f667e\") " pod="opendatahub/maas-controller-5cd4d7f4b-8p4dt"
Jul 15 15:38:23.713309 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:38:23.713124    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrnwp\" (UniqueName: \"kubernetes.io/projected/08e4af4b-218a-4da1-89fd-70879c3f667e-kube-api-access-xrnwp\") pod \"maas-controller-5cd4d7f4b-8p4dt\" (UID: \"08e4af4b-218a-4da1-89fd-70879c3f667e\") " pod="opendatahub/maas-controller-5cd4d7f4b-8p4dt"
Jul 15 15:38:23.715524 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:38:23.715500    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/08e4af4b-218a-4da1-89fd-70879c3f667e-webhook-cert\") pod \"maas-controller-5cd4d7f4b-8p4dt\" (UID: \"08e4af4b-218a-4da1-89fd-70879c3f667e\") " pod="opendatahub/maas-controller-5cd4d7f4b-8p4dt"
Jul 15 15:38:23.721645 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:38:23.721621    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrnwp\" (UniqueName: \"kubernetes.io/projected/08e4af4b-218a-4da1-89fd-70879c3f667e-kube-api-access-xrnwp\") pod \"maas-controller-5cd4d7f4b-8p4dt\" (UID: \"08e4af4b-218a-4da1-89fd-70879c3f667e\") " pod="opendatahub/maas-controller-5cd4d7f4b-8p4dt"
Jul 15 15:38:23.795562 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:38:23.795534    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5cd4d7f4b-8p4dt"
Jul 15 15:38:23.926311 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:38:23.926285    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5cd4d7f4b-8p4dt"]
Jul 15 15:38:23.928582 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:38:23.928551    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08e4af4b_218a_4da1_89fd_70879c3f667e.slice/crio-b836a9f36c5e81b15be6de6dd856ca717edab232c7af5b74c4ebee3120da6bf4 WatchSource:0}: Error finding container b836a9f36c5e81b15be6de6dd856ca717edab232c7af5b74c4ebee3120da6bf4: Status 404 returned error can't find the container with id b836a9f36c5e81b15be6de6dd856ca717edab232c7af5b74c4ebee3120da6bf4
Jul 15 15:38:24.229392 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:38:24.229315    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a0f5477-066e-49f9-a153-a02bb6c719a9" path="/var/lib/kubelet/pods/7a0f5477-066e-49f9-a153-a02bb6c719a9/volumes"
Jul 15 15:38:24.640278 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:38:24.640237    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5cd4d7f4b-8p4dt" event={"ID":"08e4af4b-218a-4da1-89fd-70879c3f667e","Type":"ContainerStarted","Data":"599f2fe0bfa4846f51f40be78a617c53242e6a05748214428349a9940bda5bb1"}
Jul 15 15:38:24.640653 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:38:24.640293    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5cd4d7f4b-8p4dt" event={"ID":"08e4af4b-218a-4da1-89fd-70879c3f667e","Type":"ContainerStarted","Data":"b836a9f36c5e81b15be6de6dd856ca717edab232c7af5b74c4ebee3120da6bf4"}
Jul 15 15:38:24.640653 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:38:24.640318    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5cd4d7f4b-8p4dt"
Jul 15 15:38:24.660278 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:38:24.660232    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5cd4d7f4b-8p4dt" podStartSLOduration=1.176949418 podStartE2EDuration="1.660217626s" totalImagesPullingTime="483.268208ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:38:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:38:24.658790839 +0000 UTC m=+835.004694028" watchObservedRunningTime="2026-07-15 15:38:24.660217626 +0000 UTC m=+835.006120852"
Jul 15 15:38:35.646779 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:38:35.646750    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5cd4d7f4b-8p4dt"
Jul 15 15:38:43.767192 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:38:43.767150    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:39:04.260468 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:39:04.260438    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:39:04.358891 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:39:04.358850    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:39:04.475933 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:39:04.475902    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:39:06.296126 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:39:06.296080    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:39:10.401472 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:39:10.401429    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:39:10.502042 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:39:10.501995    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:39:10.694697 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:39:10.694494    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:39:10.794955 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:39:10.794926    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:39:16.596764 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:39:16.596709    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:39:16.697636 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:39:16.697602    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:39:30.071909 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:39:30.071827    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfw7r_55d0e798-7e5a-4f3e-afc2-67dfb308d934/ovn-acl-logging/0.log"
Jul 15 15:39:30.071909 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:39:30.071863    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfw7r_55d0e798-7e5a-4f3e-afc2-67dfb308d934/ovn-acl-logging/0.log"
Jul 15 15:40:52.347121 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:40:52.347050    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:40:53.570584 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:40:53.570552    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:43:36.154326 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:43:36.154294    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:43:46.327370 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:43:46.327341    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:44:30.097758 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:44:30.097729    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfw7r_55d0e798-7e5a-4f3e-afc2-67dfb308d934/ovn-acl-logging/0.log"
Jul 15 15:44:30.099890 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:44:30.099870    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfw7r_55d0e798-7e5a-4f3e-afc2-67dfb308d934/ovn-acl-logging/0.log"
Jul 15 15:47:55.684194 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:47:55.684159    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:49:30.123003 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:49:30.122977    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfw7r_55d0e798-7e5a-4f3e-afc2-67dfb308d934/ovn-acl-logging/0.log"
Jul 15 15:49:30.126295 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:49:30.126276    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfw7r_55d0e798-7e5a-4f3e-afc2-67dfb308d934/ovn-acl-logging/0.log"
Jul 15 15:49:47.800361 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:49:47.800322    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:49:58.057412 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:49:58.057336    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:49:59.229204 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:49:59.229166    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:50:06.354593 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:06.354546    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:50:07.203740 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:07.203703    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:50:15.456560 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:15.456516    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:50:20.554997 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:20.554957    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:50:24.415592 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:24.415547    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:50:24.514753 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:24.514715    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:50:29.943646 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:29.943609    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:50:30.047881 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:30.047851    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:50:30.128179 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:30.128145    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j"]
Jul 15 15:50:30.132035 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:30.131996    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j"
Jul 15 15:50:30.134704 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:30.134680    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-38132c4d-openshift-default-dockercfg-hhlq2\""
Jul 15 15:50:30.164953 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:30.164927    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j"]
Jul 15 15:50:30.179530 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:30.179501    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:50:30.233891 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:30.233817    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/03fe0b9e-1e8d-4286-90c8-7181bac0b8e8-istio-envoy\") pod \"e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j\" (UID: \"03fe0b9e-1e8d-4286-90c8-7181bac0b8e8\") " pod="openshift-ingress/e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j"
Jul 15 15:50:30.233891 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:30.233844    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/03fe0b9e-1e8d-4286-90c8-7181bac0b8e8-istiod-ca-cert\") pod \"e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j\" (UID: \"03fe0b9e-1e8d-4286-90c8-7181bac0b8e8\") " pod="openshift-ingress/e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j"
Jul 15 15:50:30.233891 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:30.233869    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/03fe0b9e-1e8d-4286-90c8-7181bac0b8e8-workload-socket\") pod \"e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j\" (UID: \"03fe0b9e-1e8d-4286-90c8-7181bac0b8e8\") " pod="openshift-ingress/e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j"
Jul 15 15:50:30.234151 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:30.233912    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/03fe0b9e-1e8d-4286-90c8-7181bac0b8e8-istio-token\") pod \"e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j\" (UID: \"03fe0b9e-1e8d-4286-90c8-7181bac0b8e8\") " pod="openshift-ingress/e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j"
Jul 15 15:50:30.234151 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:30.233946    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/03fe0b9e-1e8d-4286-90c8-7181bac0b8e8-workload-certs\") pod \"e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j\" (UID: \"03fe0b9e-1e8d-4286-90c8-7181bac0b8e8\") " pod="openshift-ingress/e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j"
Jul 15 15:50:30.234151 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:30.233983    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/03fe0b9e-1e8d-4286-90c8-7181bac0b8e8-istio-podinfo\") pod \"e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j\" (UID: \"03fe0b9e-1e8d-4286-90c8-7181bac0b8e8\") " pod="openshift-ingress/e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j"
Jul 15 15:50:30.234151 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:30.234039    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/03fe0b9e-1e8d-4286-90c8-7181bac0b8e8-credential-socket\") pod \"e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j\" (UID: \"03fe0b9e-1e8d-4286-90c8-7181bac0b8e8\") " pod="openshift-ingress/e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j"
Jul 15 15:50:30.234151 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:30.234075    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/03fe0b9e-1e8d-4286-90c8-7181bac0b8e8-istio-data\") pod \"e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j\" (UID: \"03fe0b9e-1e8d-4286-90c8-7181bac0b8e8\") " pod="openshift-ingress/e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j"
Jul 15 15:50:30.234151 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:30.234092    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhxhf\" (UniqueName: \"kubernetes.io/projected/03fe0b9e-1e8d-4286-90c8-7181bac0b8e8-kube-api-access-hhxhf\") pod \"e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j\" (UID: \"03fe0b9e-1e8d-4286-90c8-7181bac0b8e8\") " pod="openshift-ingress/e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j"
Jul 15 15:50:30.276424 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:30.276393    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:50:30.334597 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:30.334571    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/03fe0b9e-1e8d-4286-90c8-7181bac0b8e8-istio-token\") pod \"e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j\" (UID: \"03fe0b9e-1e8d-4286-90c8-7181bac0b8e8\") " pod="openshift-ingress/e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j"
Jul 15 15:50:30.334704 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:30.334603    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/03fe0b9e-1e8d-4286-90c8-7181bac0b8e8-workload-certs\") pod \"e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j\" (UID: \"03fe0b9e-1e8d-4286-90c8-7181bac0b8e8\") " pod="openshift-ingress/e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j"
Jul 15 15:50:30.334704 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:30.334628    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/03fe0b9e-1e8d-4286-90c8-7181bac0b8e8-istio-podinfo\") pod \"e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j\" (UID: \"03fe0b9e-1e8d-4286-90c8-7181bac0b8e8\") " pod="openshift-ingress/e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j"
Jul 15 15:50:30.334704 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:30.334653    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/03fe0b9e-1e8d-4286-90c8-7181bac0b8e8-credential-socket\") pod \"e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j\" (UID: \"03fe0b9e-1e8d-4286-90c8-7181bac0b8e8\") " pod="openshift-ingress/e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j"
Jul 15 15:50:30.334704 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:30.334689    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/03fe0b9e-1e8d-4286-90c8-7181bac0b8e8-istio-data\") pod \"e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j\" (UID: \"03fe0b9e-1e8d-4286-90c8-7181bac0b8e8\") " pod="openshift-ingress/e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j"
Jul 15 15:50:30.334929 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:30.334707    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhxhf\" (UniqueName: \"kubernetes.io/projected/03fe0b9e-1e8d-4286-90c8-7181bac0b8e8-kube-api-access-hhxhf\") pod \"e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j\" (UID: \"03fe0b9e-1e8d-4286-90c8-7181bac0b8e8\") " pod="openshift-ingress/e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j"
Jul 15 15:50:30.334929 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:30.334754    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/03fe0b9e-1e8d-4286-90c8-7181bac0b8e8-istio-envoy\") pod \"e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j\" (UID: \"03fe0b9e-1e8d-4286-90c8-7181bac0b8e8\") " pod="openshift-ingress/e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j"
Jul 15 15:50:30.334929 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:30.334777    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/03fe0b9e-1e8d-4286-90c8-7181bac0b8e8-istiod-ca-cert\") pod \"e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j\" (UID: \"03fe0b9e-1e8d-4286-90c8-7181bac0b8e8\") " pod="openshift-ingress/e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j"
Jul 15 15:50:30.334929 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:30.334814    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/03fe0b9e-1e8d-4286-90c8-7181bac0b8e8-workload-socket\") pod \"e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j\" (UID: \"03fe0b9e-1e8d-4286-90c8-7181bac0b8e8\") " pod="openshift-ingress/e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j"
Jul 15 15:50:30.335155 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:30.335130    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/03fe0b9e-1e8d-4286-90c8-7181bac0b8e8-workload-certs\") pod \"e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j\" (UID: \"03fe0b9e-1e8d-4286-90c8-7181bac0b8e8\") " pod="openshift-ingress/e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j"
Jul 15 15:50:30.335323 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:30.335289    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/03fe0b9e-1e8d-4286-90c8-7181bac0b8e8-istio-data\") pod \"e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j\" (UID: \"03fe0b9e-1e8d-4286-90c8-7181bac0b8e8\") " pod="openshift-ingress/e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j"
Jul 15 15:50:30.335404 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:30.335330    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/03fe0b9e-1e8d-4286-90c8-7181bac0b8e8-credential-socket\") pod \"e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j\" (UID: \"03fe0b9e-1e8d-4286-90c8-7181bac0b8e8\") " pod="openshift-ingress/e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j"
Jul 15 15:50:30.335404 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:30.335348    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/03fe0b9e-1e8d-4286-90c8-7181bac0b8e8-workload-socket\") pod \"e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j\" (UID: \"03fe0b9e-1e8d-4286-90c8-7181bac0b8e8\") " pod="openshift-ingress/e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j"
Jul 15 15:50:30.335590 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:30.335572    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/03fe0b9e-1e8d-4286-90c8-7181bac0b8e8-istiod-ca-cert\") pod \"e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j\" (UID: \"03fe0b9e-1e8d-4286-90c8-7181bac0b8e8\") " pod="openshift-ingress/e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j"
Jul 15 15:50:30.337170 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:30.337139    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/03fe0b9e-1e8d-4286-90c8-7181bac0b8e8-istio-envoy\") pod \"e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j\" (UID: \"03fe0b9e-1e8d-4286-90c8-7181bac0b8e8\") " pod="openshift-ingress/e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j"
Jul 15 15:50:30.337274 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:30.337212    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/03fe0b9e-1e8d-4286-90c8-7181bac0b8e8-istio-podinfo\") pod \"e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j\" (UID: \"03fe0b9e-1e8d-4286-90c8-7181bac0b8e8\") " pod="openshift-ingress/e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j"
Jul 15 15:50:30.344086 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:30.344053    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/03fe0b9e-1e8d-4286-90c8-7181bac0b8e8-istio-token\") pod \"e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j\" (UID: \"03fe0b9e-1e8d-4286-90c8-7181bac0b8e8\") " pod="openshift-ingress/e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j"
Jul 15 15:50:30.344238 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:30.344215    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhxhf\" (UniqueName: \"kubernetes.io/projected/03fe0b9e-1e8d-4286-90c8-7181bac0b8e8-kube-api-access-hhxhf\") pod \"e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j\" (UID: \"03fe0b9e-1e8d-4286-90c8-7181bac0b8e8\") " pod="openshift-ingress/e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j"
Jul 15 15:50:30.442213 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:30.442184    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j"
Jul 15 15:50:30.580645 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:30.580624    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j"]
Jul 15 15:50:30.582974 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:50:30.582946    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03fe0b9e_1e8d_4286_90c8_7181bac0b8e8.slice/crio-fbd29261b39ca76592aaa33b3329b20928b3db9e5d6bcaf4a47a11a9c788f3a3 WatchSource:0}: Error finding container fbd29261b39ca76592aaa33b3329b20928b3db9e5d6bcaf4a47a11a9c788f3a3: Status 404 returned error can't find the container with id fbd29261b39ca76592aaa33b3329b20928b3db9e5d6bcaf4a47a11a9c788f3a3
Jul 15 15:50:30.585095 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:30.585059    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 15:50:30.585190 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:30.585149    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 15:50:30.585266 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:30.585194    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 15:50:30.932665 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:30.932626    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j" event={"ID":"03fe0b9e-1e8d-4286-90c8-7181bac0b8e8","Type":"ContainerStarted","Data":"8548a6e7809f494e326789415345a3c09a81bb74d9071b2705441c0a78eb03c0"}
Jul 15 15:50:30.932836 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:30.932696    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j" event={"ID":"03fe0b9e-1e8d-4286-90c8-7181bac0b8e8","Type":"ContainerStarted","Data":"fbd29261b39ca76592aaa33b3329b20928b3db9e5d6bcaf4a47a11a9c788f3a3"}
Jul 15 15:50:30.955249 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:30.955193    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j" podStartSLOduration=0.955173402 podStartE2EDuration="955.173402ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:50:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:50:30.952440473 +0000 UTC m=+1561.298343666" watchObservedRunningTime="2026-07-15 15:50:30.955173402 +0000 UTC m=+1561.301076597"
Jul 15 15:50:31.303305 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:31.303274    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:50:31.393278 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:31.393247    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-38132c4d-55f986778b-ddqlj"]
Jul 15 15:50:31.396762 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:31.396745    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-38132c4d-55f986778b-ddqlj"
Jul 15 15:50:31.400090 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:31.400067    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-38132c4d-serving-cert\""
Jul 15 15:50:31.409815 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:31.409794    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-38132c4d-55f986778b-ddqlj"]
Jul 15 15:50:31.415799 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:31.415775    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:50:31.442759 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:31.442734    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j"
Jul 15 15:50:31.447553 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:31.447535    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j"
Jul 15 15:50:31.524902 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:31.524869    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:50:31.544891 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:31.544870    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aa76e4f4-ddba-4423-ad4a-ccbc98f9e410-maas-api-tls\") pod \"maas-api-e2e-ait-38132c4d-55f986778b-ddqlj\" (UID: \"aa76e4f4-ddba-4423-ad4a-ccbc98f9e410\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-38132c4d-55f986778b-ddqlj"
Jul 15 15:50:31.545023 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:31.544899    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa76e4f4-ddba-4423-ad4a-ccbc98f9e410-openshift-service-ca\") pod \"maas-api-e2e-ait-38132c4d-55f986778b-ddqlj\" (UID: \"aa76e4f4-ddba-4423-ad4a-ccbc98f9e410\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-38132c4d-55f986778b-ddqlj"
Jul 15 15:50:31.545023 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:31.544924    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpb6d\" (UniqueName: \"kubernetes.io/projected/aa76e4f4-ddba-4423-ad4a-ccbc98f9e410-kube-api-access-gpb6d\") pod \"maas-api-e2e-ait-38132c4d-55f986778b-ddqlj\" (UID: \"aa76e4f4-ddba-4423-ad4a-ccbc98f9e410\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-38132c4d-55f986778b-ddqlj"
Jul 15 15:50:31.645455 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:31.645394    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aa76e4f4-ddba-4423-ad4a-ccbc98f9e410-maas-api-tls\") pod \"maas-api-e2e-ait-38132c4d-55f986778b-ddqlj\" (UID: \"aa76e4f4-ddba-4423-ad4a-ccbc98f9e410\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-38132c4d-55f986778b-ddqlj"
Jul 15 15:50:31.645455 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:31.645423    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa76e4f4-ddba-4423-ad4a-ccbc98f9e410-openshift-service-ca\") pod \"maas-api-e2e-ait-38132c4d-55f986778b-ddqlj\" (UID: \"aa76e4f4-ddba-4423-ad4a-ccbc98f9e410\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-38132c4d-55f986778b-ddqlj"
Jul 15 15:50:31.645455 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:31.645447    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpb6d\" (UniqueName: \"kubernetes.io/projected/aa76e4f4-ddba-4423-ad4a-ccbc98f9e410-kube-api-access-gpb6d\") pod \"maas-api-e2e-ait-38132c4d-55f986778b-ddqlj\" (UID: \"aa76e4f4-ddba-4423-ad4a-ccbc98f9e410\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-38132c4d-55f986778b-ddqlj"
Jul 15 15:50:31.645639 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:50:31.645532    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-38132c4d-serving-cert: secret "maas-api-e2e-ait-38132c4d-serving-cert" not found
Jul 15 15:50:31.645639 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:50:31.645587    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa76e4f4-ddba-4423-ad4a-ccbc98f9e410-maas-api-tls podName:aa76e4f4-ddba-4423-ad4a-ccbc98f9e410 nodeName:}" failed. No retries permitted until 2026-07-15 15:50:32.145572228 +0000 UTC m=+1562.491475405 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/aa76e4f4-ddba-4423-ad4a-ccbc98f9e410-maas-api-tls") pod "maas-api-e2e-ait-38132c4d-55f986778b-ddqlj" (UID: "aa76e4f4-ddba-4423-ad4a-ccbc98f9e410") : secret "maas-api-e2e-ait-38132c4d-serving-cert" not found
Jul 15 15:50:31.646075 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:31.646053    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa76e4f4-ddba-4423-ad4a-ccbc98f9e410-openshift-service-ca\") pod \"maas-api-e2e-ait-38132c4d-55f986778b-ddqlj\" (UID: \"aa76e4f4-ddba-4423-ad4a-ccbc98f9e410\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-38132c4d-55f986778b-ddqlj"
Jul 15 15:50:31.654915 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:31.654893    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpb6d\" (UniqueName: \"kubernetes.io/projected/aa76e4f4-ddba-4423-ad4a-ccbc98f9e410-kube-api-access-gpb6d\") pod \"maas-api-e2e-ait-38132c4d-55f986778b-ddqlj\" (UID: \"aa76e4f4-ddba-4423-ad4a-ccbc98f9e410\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-38132c4d-55f986778b-ddqlj"
Jul 15 15:50:31.805025 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:31.804984    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:50:31.938089 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:31.938003    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j"
Jul 15 15:50:31.938867 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:31.938849    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j"
Jul 15 15:50:32.004802 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:32.004761    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:50:32.108148 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:32.108119    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:50:32.150205 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:32.150182    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aa76e4f4-ddba-4423-ad4a-ccbc98f9e410-maas-api-tls\") pod \"maas-api-e2e-ait-38132c4d-55f986778b-ddqlj\" (UID: \"aa76e4f4-ddba-4423-ad4a-ccbc98f9e410\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-38132c4d-55f986778b-ddqlj"
Jul 15 15:50:32.152556 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:32.152523    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aa76e4f4-ddba-4423-ad4a-ccbc98f9e410-maas-api-tls\") pod \"maas-api-e2e-ait-38132c4d-55f986778b-ddqlj\" (UID: \"aa76e4f4-ddba-4423-ad4a-ccbc98f9e410\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-38132c4d-55f986778b-ddqlj"
Jul 15 15:50:32.307160 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:32.307129    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-38132c4d-55f986778b-ddqlj"
Jul 15 15:50:32.446684 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:32.446660    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-38132c4d-55f986778b-ddqlj"]
Jul 15 15:50:32.449345 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:50:32.449309    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa76e4f4_ddba_4423_ad4a_ccbc98f9e410.slice/crio-0b3ab8651b97cf9ac161ad7dbf871bf3efe065fa206a063ea11c93cbcbfd8a20 WatchSource:0}: Error finding container 0b3ab8651b97cf9ac161ad7dbf871bf3efe065fa206a063ea11c93cbcbfd8a20: Status 404 returned error can't find the container with id 0b3ab8651b97cf9ac161ad7dbf871bf3efe065fa206a063ea11c93cbcbfd8a20
Jul 15 15:50:32.450814 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:32.450798    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 15:50:32.944872 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:32.944847    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-38132c4d-55f986778b-ddqlj" event={"ID":"aa76e4f4-ddba-4423-ad4a-ccbc98f9e410","Type":"ContainerStarted","Data":"0b3ab8651b97cf9ac161ad7dbf871bf3efe065fa206a063ea11c93cbcbfd8a20"}
Jul 15 15:50:33.957638 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:33.957598    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-38132c4d-55f986778b-ddqlj" event={"ID":"aa76e4f4-ddba-4423-ad4a-ccbc98f9e410","Type":"ContainerStarted","Data":"3f760e07f049dd65626071c5fd3705c7231aa4dae254ebab9e1d9e25150fe2d8"}
Jul 15 15:50:33.983871 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:33.983826    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-38132c4d-55f986778b-ddqlj" podStartSLOduration=2.512083992 podStartE2EDuration="2.983812617s" totalImagesPullingTime="471.728625ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:50:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:50:33.980766363 +0000 UTC m=+1564.326669555" watchObservedRunningTime="2026-07-15 15:50:33.983812617 +0000 UTC m=+1564.329715809"
Jul 15 15:50:34.018167 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:34.018133    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:50:34.962060 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:34.962036    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-38132c4d-55f986778b-ddqlj"
Jul 15 15:50:40.982250 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:40.982216    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-38132c4d-55f986778b-ddqlj"
Jul 15 15:50:47.251258 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:47.251220    2564 patch_prober.go:28] interesting pod/e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": read tcp 10.133.0.2:39860->10.133.0.46:15021: read: connection reset by peer" start-of-body=
Jul 15 15:50:47.251673 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:47.251298    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j" podUID="03fe0b9e-1e8d-4286-90c8-7181bac0b8e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": read tcp 10.133.0.2:39860->10.133.0.46:15021: read: connection reset by peer"
Jul 15 15:50:48.024894 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:48.024862    2564 generic.go:356] "Generic (PLEG): container finished" podID="03fe0b9e-1e8d-4286-90c8-7181bac0b8e8" containerID="8548a6e7809f494e326789415345a3c09a81bb74d9071b2705441c0a78eb03c0" exitCode=0
Jul 15 15:50:48.025104 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:48.024930    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j" event={"ID":"03fe0b9e-1e8d-4286-90c8-7181bac0b8e8","Type":"ContainerDied","Data":"8548a6e7809f494e326789415345a3c09a81bb74d9071b2705441c0a78eb03c0"}
Jul 15 15:50:48.025358 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:48.025340    2564 scope.go:117] "RemoveContainer" containerID="8548a6e7809f494e326789415345a3c09a81bb74d9071b2705441c0a78eb03c0"
Jul 15 15:50:48.026479 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:48.026451    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 15:50:48.026587 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:48.026521    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 15:50:48.026587 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:48.026554    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 15:50:49.031744 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:49.031716    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j" event={"ID":"03fe0b9e-1e8d-4286-90c8-7181bac0b8e8","Type":"ContainerStarted","Data":"683c7bf9ab558365004956a90da7f1eee7c8a2deba26d8addc85870627c15cd0"}
Jul 15 15:50:49.443213 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:49.443141    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j"
Jul 15 15:50:49.443342 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:49.443311    2564 patch_prober.go:28] interesting pod/e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 15 15:50:49.443399 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:49.443378    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j" podUID="03fe0b9e-1e8d-4286-90c8-7181bac0b8e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 15 15:50:50.443622 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:50.443587    2564 patch_prober.go:28] interesting pod/e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 15 15:50:50.444034 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:50.443665    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j" podUID="03fe0b9e-1e8d-4286-90c8-7181bac0b8e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 15 15:50:51.442899 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:51.442864    2564 patch_prober.go:28] interesting pod/e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 15 15:50:51.443099 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:51.442918    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j" podUID="03fe0b9e-1e8d-4286-90c8-7181bac0b8e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 15 15:50:52.443460 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:52.443424    2564 patch_prober.go:28] interesting pod/e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 15 15:50:52.443830 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:52.443499    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j" podUID="03fe0b9e-1e8d-4286-90c8-7181bac0b8e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 15 15:50:53.443316 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:53.443280    2564 patch_prober.go:28] interesting pod/e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 15 15:50:53.443489 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:53.443335    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j" podUID="03fe0b9e-1e8d-4286-90c8-7181bac0b8e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 15 15:50:54.443295 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:54.443260    2564 patch_prober.go:28] interesting pod/e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 15 15:50:54.443477 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:54.443316    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j" podUID="03fe0b9e-1e8d-4286-90c8-7181bac0b8e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 15 15:50:55.447023 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:55.446988    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j"
Jul 15 15:50:55.447465 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:55.447442    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j"
Jul 15 15:50:55.448237 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:50:55.448220    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j"
Jul 15 15:51:09.645093 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:09.645054    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:51:09.702141 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:09.702104    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:51:36.936250 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:36.936167    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-38132c4d-55f986778b-ddqlj"]
Jul 15 15:51:36.936688 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:36.936388    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-38132c4d-55f986778b-ddqlj" podUID="aa76e4f4-ddba-4423-ad4a-ccbc98f9e410" containerName="maas-api" containerID="cri-o://3f760e07f049dd65626071c5fd3705c7231aa4dae254ebab9e1d9e25150fe2d8" gracePeriod=30
Jul 15 15:51:37.002842 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:37.002813    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:51:37.186516 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:37.186465    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-38132c4d-55f986778b-ddqlj"
Jul 15 15:51:37.261793 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:37.261759    2564 generic.go:356] "Generic (PLEG): container finished" podID="aa76e4f4-ddba-4423-ad4a-ccbc98f9e410" containerID="3f760e07f049dd65626071c5fd3705c7231aa4dae254ebab9e1d9e25150fe2d8" exitCode=0
Jul 15 15:51:37.261940 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:37.261804    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-38132c4d-55f986778b-ddqlj"
Jul 15 15:51:37.261940 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:37.261811    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-38132c4d-55f986778b-ddqlj" event={"ID":"aa76e4f4-ddba-4423-ad4a-ccbc98f9e410","Type":"ContainerDied","Data":"3f760e07f049dd65626071c5fd3705c7231aa4dae254ebab9e1d9e25150fe2d8"}
Jul 15 15:51:37.261940 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:37.261871    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-38132c4d-55f986778b-ddqlj" event={"ID":"aa76e4f4-ddba-4423-ad4a-ccbc98f9e410","Type":"ContainerDied","Data":"0b3ab8651b97cf9ac161ad7dbf871bf3efe065fa206a063ea11c93cbcbfd8a20"}
Jul 15 15:51:37.261940 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:37.261901    2564 scope.go:117] "RemoveContainer" containerID="3f760e07f049dd65626071c5fd3705c7231aa4dae254ebab9e1d9e25150fe2d8"
Jul 15 15:51:37.270179 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:37.270160    2564 scope.go:117] "RemoveContainer" containerID="3f760e07f049dd65626071c5fd3705c7231aa4dae254ebab9e1d9e25150fe2d8"
Jul 15 15:51:37.270435 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:51:37.270416    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f760e07f049dd65626071c5fd3705c7231aa4dae254ebab9e1d9e25150fe2d8\": container with ID starting with 3f760e07f049dd65626071c5fd3705c7231aa4dae254ebab9e1d9e25150fe2d8 not found: ID does not exist" containerID="3f760e07f049dd65626071c5fd3705c7231aa4dae254ebab9e1d9e25150fe2d8"
Jul 15 15:51:37.270482 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:37.270445    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f760e07f049dd65626071c5fd3705c7231aa4dae254ebab9e1d9e25150fe2d8"} err="failed to get container status \"3f760e07f049dd65626071c5fd3705c7231aa4dae254ebab9e1d9e25150fe2d8\": rpc error: code = NotFound desc = could not find container \"3f760e07f049dd65626071c5fd3705c7231aa4dae254ebab9e1d9e25150fe2d8\": container with ID starting with 3f760e07f049dd65626071c5fd3705c7231aa4dae254ebab9e1d9e25150fe2d8 not found: ID does not exist"
Jul 15 15:51:37.286863 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:37.286845    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aa76e4f4-ddba-4423-ad4a-ccbc98f9e410-maas-api-tls\") pod \"aa76e4f4-ddba-4423-ad4a-ccbc98f9e410\" (UID: \"aa76e4f4-ddba-4423-ad4a-ccbc98f9e410\") "
Jul 15 15:51:37.286928 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:37.286882    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa76e4f4-ddba-4423-ad4a-ccbc98f9e410-openshift-service-ca\") pod \"aa76e4f4-ddba-4423-ad4a-ccbc98f9e410\" (UID: \"aa76e4f4-ddba-4423-ad4a-ccbc98f9e410\") "
Jul 15 15:51:37.286928 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:37.286905    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gpb6d\" (UniqueName: \"kubernetes.io/projected/aa76e4f4-ddba-4423-ad4a-ccbc98f9e410-kube-api-access-gpb6d\") pod \"aa76e4f4-ddba-4423-ad4a-ccbc98f9e410\" (UID: \"aa76e4f4-ddba-4423-ad4a-ccbc98f9e410\") "
Jul 15 15:51:37.287174 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:37.287155    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa76e4f4-ddba-4423-ad4a-ccbc98f9e410-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "aa76e4f4-ddba-4423-ad4a-ccbc98f9e410" (UID: "aa76e4f4-ddba-4423-ad4a-ccbc98f9e410"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 15:51:37.288915 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:37.288893    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa76e4f4-ddba-4423-ad4a-ccbc98f9e410-kube-api-access-gpb6d" (OuterVolumeSpecName: "kube-api-access-gpb6d") pod "aa76e4f4-ddba-4423-ad4a-ccbc98f9e410" (UID: "aa76e4f4-ddba-4423-ad4a-ccbc98f9e410"). InnerVolumeSpecName "kube-api-access-gpb6d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:51:37.288979 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:37.288920    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa76e4f4-ddba-4423-ad4a-ccbc98f9e410-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "aa76e4f4-ddba-4423-ad4a-ccbc98f9e410" (UID: "aa76e4f4-ddba-4423-ad4a-ccbc98f9e410"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 15:51:37.387624 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:37.387602    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gpb6d\" (UniqueName: \"kubernetes.io/projected/aa76e4f4-ddba-4423-ad4a-ccbc98f9e410-kube-api-access-gpb6d\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 15:51:37.387624 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:37.387621    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aa76e4f4-ddba-4423-ad4a-ccbc98f9e410-maas-api-tls\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 15:51:37.387796 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:37.387629    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa76e4f4-ddba-4423-ad4a-ccbc98f9e410-openshift-service-ca\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 15:51:37.584595 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:37.584569    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-38132c4d-55f986778b-ddqlj"]
Jul 15 15:51:37.588597 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:37.588574    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-38132c4d-55f986778b-ddqlj"]
Jul 15 15:51:38.229954 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:38.229924    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa76e4f4-ddba-4423-ad4a-ccbc98f9e410" path="/var/lib/kubelet/pods/aa76e4f4-ddba-4423-ad4a-ccbc98f9e410/volumes"
Jul 15 15:51:38.534860 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:38.534827    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:51:41.512851 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:41.512815    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:51:47.388879 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:47.388840    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:51:47.488431 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:47.488399    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:51:51.684818 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:51.684784    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j"]
Jul 15 15:51:51.685277 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:51.684992    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j" podUID="03fe0b9e-1e8d-4286-90c8-7181bac0b8e8" containerName="istio-proxy" containerID="cri-o://683c7bf9ab558365004956a90da7f1eee7c8a2deba26d8addc85870627c15cd0" gracePeriod=30
Jul 15 15:51:51.713212 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:51.713184    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:51:52.090160 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:52.090129    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:51:52.180734 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:52.180692    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:51:52.272035 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:52.271991    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67"]
Jul 15 15:51:52.272570 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:52.272550    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa76e4f4-ddba-4423-ad4a-ccbc98f9e410" containerName="maas-api"
Jul 15 15:51:52.272570 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:52.272570    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa76e4f4-ddba-4423-ad4a-ccbc98f9e410" containerName="maas-api"
Jul 15 15:51:52.272712 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:52.272662    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa76e4f4-ddba-4423-ad4a-ccbc98f9e410" containerName="maas-api"
Jul 15 15:51:52.277585 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:52.277236    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67"
Jul 15 15:51:52.281092 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:52.281075    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-c7b34001-gw-openshift-default-dockercfg-qxbdb\""
Jul 15 15:51:52.290956 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:52.290935    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67"]
Jul 15 15:51:52.308211 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:52.308186    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60127949-e64e-4310-a21c-9cf5eb304089-istio-envoy\") pod \"e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67\" (UID: \"60127949-e64e-4310-a21c-9cf5eb304089\") " pod="openshift-ingress/e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67"
Jul 15 15:51:52.308364 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:52.308220    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60127949-e64e-4310-a21c-9cf5eb304089-workload-certs\") pod \"e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67\" (UID: \"60127949-e64e-4310-a21c-9cf5eb304089\") " pod="openshift-ingress/e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67"
Jul 15 15:51:52.308364 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:52.308245    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57gxj\" (UniqueName: \"kubernetes.io/projected/60127949-e64e-4310-a21c-9cf5eb304089-kube-api-access-57gxj\") pod \"e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67\" (UID: \"60127949-e64e-4310-a21c-9cf5eb304089\") " pod="openshift-ingress/e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67"
Jul 15 15:51:52.308482 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:52.308378    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60127949-e64e-4310-a21c-9cf5eb304089-credential-socket\") pod \"e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67\" (UID: \"60127949-e64e-4310-a21c-9cf5eb304089\") " pod="openshift-ingress/e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67"
Jul 15 15:51:52.308482 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:52.308418    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60127949-e64e-4310-a21c-9cf5eb304089-istiod-ca-cert\") pod \"e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67\" (UID: \"60127949-e64e-4310-a21c-9cf5eb304089\") " pod="openshift-ingress/e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67"
Jul 15 15:51:52.308482 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:52.308473    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60127949-e64e-4310-a21c-9cf5eb304089-workload-socket\") pod \"e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67\" (UID: \"60127949-e64e-4310-a21c-9cf5eb304089\") " pod="openshift-ingress/e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67"
Jul 15 15:51:52.308600 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:52.308511    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60127949-e64e-4310-a21c-9cf5eb304089-istio-podinfo\") pod \"e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67\" (UID: \"60127949-e64e-4310-a21c-9cf5eb304089\") " pod="openshift-ingress/e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67"
Jul 15 15:51:52.308600 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:52.308538    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60127949-e64e-4310-a21c-9cf5eb304089-istio-data\") pod \"e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67\" (UID: \"60127949-e64e-4310-a21c-9cf5eb304089\") " pod="openshift-ingress/e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67"
Jul 15 15:51:52.308600 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:52.308576    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60127949-e64e-4310-a21c-9cf5eb304089-istio-token\") pod \"e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67\" (UID: \"60127949-e64e-4310-a21c-9cf5eb304089\") " pod="openshift-ingress/e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67"
Jul 15 15:51:52.331503 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:52.331477    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:51:52.409944 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:52.409863    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60127949-e64e-4310-a21c-9cf5eb304089-istio-envoy\") pod \"e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67\" (UID: \"60127949-e64e-4310-a21c-9cf5eb304089\") " pod="openshift-ingress/e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67"
Jul 15 15:51:52.409944 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:52.409904    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60127949-e64e-4310-a21c-9cf5eb304089-workload-certs\") pod \"e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67\" (UID: \"60127949-e64e-4310-a21c-9cf5eb304089\") " pod="openshift-ingress/e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67"
Jul 15 15:51:52.409944 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:52.409939    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57gxj\" (UniqueName: \"kubernetes.io/projected/60127949-e64e-4310-a21c-9cf5eb304089-kube-api-access-57gxj\") pod \"e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67\" (UID: \"60127949-e64e-4310-a21c-9cf5eb304089\") " pod="openshift-ingress/e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67"
Jul 15 15:51:52.410216 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:52.410002    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60127949-e64e-4310-a21c-9cf5eb304089-credential-socket\") pod \"e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67\" (UID: \"60127949-e64e-4310-a21c-9cf5eb304089\") " pod="openshift-ingress/e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67"
Jul 15 15:51:52.410216 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:52.410045    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60127949-e64e-4310-a21c-9cf5eb304089-istiod-ca-cert\") pod \"e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67\" (UID: \"60127949-e64e-4310-a21c-9cf5eb304089\") " pod="openshift-ingress/e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67"
Jul 15 15:51:52.410216 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:52.410076    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60127949-e64e-4310-a21c-9cf5eb304089-workload-socket\") pod \"e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67\" (UID: \"60127949-e64e-4310-a21c-9cf5eb304089\") " pod="openshift-ingress/e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67"
Jul 15 15:51:52.410216 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:52.410113    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60127949-e64e-4310-a21c-9cf5eb304089-istio-podinfo\") pod \"e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67\" (UID: \"60127949-e64e-4310-a21c-9cf5eb304089\") " pod="openshift-ingress/e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67"
Jul 15 15:51:52.410216 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:52.410140    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60127949-e64e-4310-a21c-9cf5eb304089-istio-data\") pod \"e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67\" (UID: \"60127949-e64e-4310-a21c-9cf5eb304089\") " pod="openshift-ingress/e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67"
Jul 15 15:51:52.410487 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:52.410345    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60127949-e64e-4310-a21c-9cf5eb304089-istio-token\") pod \"e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67\" (UID: \"60127949-e64e-4310-a21c-9cf5eb304089\") " pod="openshift-ingress/e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67"
Jul 15 15:51:52.410487 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:52.410381    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60127949-e64e-4310-a21c-9cf5eb304089-workload-certs\") pod \"e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67\" (UID: \"60127949-e64e-4310-a21c-9cf5eb304089\") " pod="openshift-ingress/e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67"
Jul 15 15:51:52.410842 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:52.410816    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60127949-e64e-4310-a21c-9cf5eb304089-credential-socket\") pod \"e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67\" (UID: \"60127949-e64e-4310-a21c-9cf5eb304089\") " pod="openshift-ingress/e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67"
Jul 15 15:51:52.410938 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:52.410920    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60127949-e64e-4310-a21c-9cf5eb304089-istiod-ca-cert\") pod \"e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67\" (UID: \"60127949-e64e-4310-a21c-9cf5eb304089\") " pod="openshift-ingress/e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67"
Jul 15 15:51:52.411000 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:52.410980    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60127949-e64e-4310-a21c-9cf5eb304089-workload-socket\") pod \"e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67\" (UID: \"60127949-e64e-4310-a21c-9cf5eb304089\") " pod="openshift-ingress/e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67"
Jul 15 15:51:52.411189 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:52.411164    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60127949-e64e-4310-a21c-9cf5eb304089-istio-data\") pod \"e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67\" (UID: \"60127949-e64e-4310-a21c-9cf5eb304089\") " pod="openshift-ingress/e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67"
Jul 15 15:51:52.413029 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:52.412984    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60127949-e64e-4310-a21c-9cf5eb304089-istio-podinfo\") pod \"e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67\" (UID: \"60127949-e64e-4310-a21c-9cf5eb304089\") " pod="openshift-ingress/e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67"
Jul 15 15:51:52.413224 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:52.413068    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60127949-e64e-4310-a21c-9cf5eb304089-istio-envoy\") pod \"e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67\" (UID: \"60127949-e64e-4310-a21c-9cf5eb304089\") " pod="openshift-ingress/e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67"
Jul 15 15:51:52.419423 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:52.419400    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-57gxj\" (UniqueName: \"kubernetes.io/projected/60127949-e64e-4310-a21c-9cf5eb304089-kube-api-access-57gxj\") pod \"e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67\" (UID: \"60127949-e64e-4310-a21c-9cf5eb304089\") " pod="openshift-ingress/e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67"
Jul 15 15:51:52.419823 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:52.419805    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60127949-e64e-4310-a21c-9cf5eb304089-istio-token\") pod \"e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67\" (UID: \"60127949-e64e-4310-a21c-9cf5eb304089\") " pod="openshift-ingress/e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67"
Jul 15 15:51:52.588935 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:52.588912    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67"
Jul 15 15:51:52.769925 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:52.769899    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67"]
Jul 15 15:51:52.771994 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:51:52.771966    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60127949_e64e_4310_a21c_9cf5eb304089.slice/crio-79199d5cbbf42686c6fc8b88b10879268e389b6f6665fe86e7edf121373cdf66 WatchSource:0}: Error finding container 79199d5cbbf42686c6fc8b88b10879268e389b6f6665fe86e7edf121373cdf66: Status 404 returned error can't find the container with id 79199d5cbbf42686c6fc8b88b10879268e389b6f6665fe86e7edf121373cdf66
Jul 15 15:51:52.774122 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:52.774085    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 15:51:52.774216 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:52.774161    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 15:51:52.774216 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:52.774195    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 15:51:53.340879 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:53.340845    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67" event={"ID":"60127949-e64e-4310-a21c-9cf5eb304089","Type":"ContainerStarted","Data":"a486f230c8290ae187639815c48c5e0a76177e8020f91c2018734ef1670cfa00"}
Jul 15 15:51:53.341071 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:53.340895    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67" event={"ID":"60127949-e64e-4310-a21c-9cf5eb304089","Type":"ContainerStarted","Data":"79199d5cbbf42686c6fc8b88b10879268e389b6f6665fe86e7edf121373cdf66"}
Jul 15 15:51:53.364069 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:53.364027    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67" podStartSLOduration=1.363994985 podStartE2EDuration="1.363994985s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:51:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:51:53.361930484 +0000 UTC m=+1643.707833677" watchObservedRunningTime="2026-07-15 15:51:53.363994985 +0000 UTC m=+1643.709898254"
Jul 15 15:51:53.527557 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:53.527525    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:51:53.589793 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:53.589770    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67"
Jul 15 15:51:53.594798 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:53.594722    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67"
Jul 15 15:51:53.689222 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:53.689185    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:51:53.893332 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:53.893248    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:51:54.261380 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:54.261289    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:51:54.344862 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:54.344840    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67"
Jul 15 15:51:54.345824 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:54.345804    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67"
Jul 15 15:51:54.364913 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:54.364889    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:51:55.449774 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:55.449740    2564 patch_prober.go:28] interesting pod/e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 15 15:51:55.450192 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:55.449796    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j" podUID="03fe0b9e-1e8d-4286-90c8-7181bac0b8e8" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 15:51:56.939694 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:56.939669    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j"
Jul 15 15:51:57.053165 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:57.053139    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/03fe0b9e-1e8d-4286-90c8-7181bac0b8e8-istio-podinfo\") pod \"03fe0b9e-1e8d-4286-90c8-7181bac0b8e8\" (UID: \"03fe0b9e-1e8d-4286-90c8-7181bac0b8e8\") "
Jul 15 15:51:57.053303 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:57.053171    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/03fe0b9e-1e8d-4286-90c8-7181bac0b8e8-istiod-ca-cert\") pod \"03fe0b9e-1e8d-4286-90c8-7181bac0b8e8\" (UID: \"03fe0b9e-1e8d-4286-90c8-7181bac0b8e8\") "
Jul 15 15:51:57.053303 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:57.053197    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/03fe0b9e-1e8d-4286-90c8-7181bac0b8e8-credential-socket\") pod \"03fe0b9e-1e8d-4286-90c8-7181bac0b8e8\" (UID: \"03fe0b9e-1e8d-4286-90c8-7181bac0b8e8\") "
Jul 15 15:51:57.053303 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:57.053231    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/03fe0b9e-1e8d-4286-90c8-7181bac0b8e8-istio-token\") pod \"03fe0b9e-1e8d-4286-90c8-7181bac0b8e8\" (UID: \"03fe0b9e-1e8d-4286-90c8-7181bac0b8e8\") "
Jul 15 15:51:57.053470 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:57.053314    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/03fe0b9e-1e8d-4286-90c8-7181bac0b8e8-workload-socket\") pod \"03fe0b9e-1e8d-4286-90c8-7181bac0b8e8\" (UID: \"03fe0b9e-1e8d-4286-90c8-7181bac0b8e8\") "
Jul 15 15:51:57.053470 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:57.053341    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/03fe0b9e-1e8d-4286-90c8-7181bac0b8e8-istio-data\") pod \"03fe0b9e-1e8d-4286-90c8-7181bac0b8e8\" (UID: \"03fe0b9e-1e8d-4286-90c8-7181bac0b8e8\") "
Jul 15 15:51:57.053470 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:57.053372    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/03fe0b9e-1e8d-4286-90c8-7181bac0b8e8-istio-envoy\") pod \"03fe0b9e-1e8d-4286-90c8-7181bac0b8e8\" (UID: \"03fe0b9e-1e8d-4286-90c8-7181bac0b8e8\") "
Jul 15 15:51:57.053470 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:57.053396    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/03fe0b9e-1e8d-4286-90c8-7181bac0b8e8-workload-certs\") pod \"03fe0b9e-1e8d-4286-90c8-7181bac0b8e8\" (UID: \"03fe0b9e-1e8d-4286-90c8-7181bac0b8e8\") "
Jul 15 15:51:57.053470 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:57.053438    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hhxhf\" (UniqueName: \"kubernetes.io/projected/03fe0b9e-1e8d-4286-90c8-7181bac0b8e8-kube-api-access-hhxhf\") pod \"03fe0b9e-1e8d-4286-90c8-7181bac0b8e8\" (UID: \"03fe0b9e-1e8d-4286-90c8-7181bac0b8e8\") "
Jul 15 15:51:57.053719 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:57.053495    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03fe0b9e-1e8d-4286-90c8-7181bac0b8e8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "03fe0b9e-1e8d-4286-90c8-7181bac0b8e8" (UID: "03fe0b9e-1e8d-4286-90c8-7181bac0b8e8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:51:57.053719 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:57.053580    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03fe0b9e-1e8d-4286-90c8-7181bac0b8e8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "03fe0b9e-1e8d-4286-90c8-7181bac0b8e8" (UID: "03fe0b9e-1e8d-4286-90c8-7181bac0b8e8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:51:57.053719 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:57.053593    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03fe0b9e-1e8d-4286-90c8-7181bac0b8e8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "03fe0b9e-1e8d-4286-90c8-7181bac0b8e8" (UID: "03fe0b9e-1e8d-4286-90c8-7181bac0b8e8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 15:51:57.053719 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:57.053701    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03fe0b9e-1e8d-4286-90c8-7181bac0b8e8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "03fe0b9e-1e8d-4286-90c8-7181bac0b8e8" (UID: "03fe0b9e-1e8d-4286-90c8-7181bac0b8e8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:51:57.053872 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:57.053747    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/03fe0b9e-1e8d-4286-90c8-7181bac0b8e8-workload-socket\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 15:51:57.053872 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:57.053765    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/03fe0b9e-1e8d-4286-90c8-7181bac0b8e8-istiod-ca-cert\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 15:51:57.053872 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:57.053779    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/03fe0b9e-1e8d-4286-90c8-7181bac0b8e8-credential-socket\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 15:51:57.054417 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:57.054393    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03fe0b9e-1e8d-4286-90c8-7181bac0b8e8-istio-data" (OuterVolumeSpecName: "istio-data") pod "03fe0b9e-1e8d-4286-90c8-7181bac0b8e8" (UID: "03fe0b9e-1e8d-4286-90c8-7181bac0b8e8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:51:57.055530 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:57.055511    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03fe0b9e-1e8d-4286-90c8-7181bac0b8e8-kube-api-access-hhxhf" (OuterVolumeSpecName: "kube-api-access-hhxhf") pod "03fe0b9e-1e8d-4286-90c8-7181bac0b8e8" (UID: "03fe0b9e-1e8d-4286-90c8-7181bac0b8e8"). InnerVolumeSpecName "kube-api-access-hhxhf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:51:57.055613 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:57.055525    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03fe0b9e-1e8d-4286-90c8-7181bac0b8e8-istio-token" (OuterVolumeSpecName: "istio-token") pod "03fe0b9e-1e8d-4286-90c8-7181bac0b8e8" (UID: "03fe0b9e-1e8d-4286-90c8-7181bac0b8e8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:51:57.055766 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:57.055749    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03fe0b9e-1e8d-4286-90c8-7181bac0b8e8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "03fe0b9e-1e8d-4286-90c8-7181bac0b8e8" (UID: "03fe0b9e-1e8d-4286-90c8-7181bac0b8e8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:51:57.055838 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:57.055770    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/03fe0b9e-1e8d-4286-90c8-7181bac0b8e8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "03fe0b9e-1e8d-4286-90c8-7181bac0b8e8" (UID: "03fe0b9e-1e8d-4286-90c8-7181bac0b8e8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 15:51:57.154296 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:57.154265    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/03fe0b9e-1e8d-4286-90c8-7181bac0b8e8-istio-token\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 15:51:57.154296 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:57.154295    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/03fe0b9e-1e8d-4286-90c8-7181bac0b8e8-istio-data\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 15:51:57.154296 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:57.154304    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/03fe0b9e-1e8d-4286-90c8-7181bac0b8e8-istio-envoy\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 15:51:57.154462 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:57.154314    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/03fe0b9e-1e8d-4286-90c8-7181bac0b8e8-workload-certs\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 15:51:57.154462 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:57.154322    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hhxhf\" (UniqueName: \"kubernetes.io/projected/03fe0b9e-1e8d-4286-90c8-7181bac0b8e8-kube-api-access-hhxhf\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 15:51:57.154462 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:57.154330    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/03fe0b9e-1e8d-4286-90c8-7181bac0b8e8-istio-podinfo\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 15:51:57.360138 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:57.360105    2564 generic.go:356] "Generic (PLEG): container finished" podID="03fe0b9e-1e8d-4286-90c8-7181bac0b8e8" containerID="683c7bf9ab558365004956a90da7f1eee7c8a2deba26d8addc85870627c15cd0" exitCode=0
Jul 15 15:51:57.360283 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:57.360146    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j"
Jul 15 15:51:57.360283 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:57.360191    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j" event={"ID":"03fe0b9e-1e8d-4286-90c8-7181bac0b8e8","Type":"ContainerDied","Data":"683c7bf9ab558365004956a90da7f1eee7c8a2deba26d8addc85870627c15cd0"}
Jul 15 15:51:57.360283 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:57.360246    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j" event={"ID":"03fe0b9e-1e8d-4286-90c8-7181bac0b8e8","Type":"ContainerDied","Data":"fbd29261b39ca76592aaa33b3329b20928b3db9e5d6bcaf4a47a11a9c788f3a3"}
Jul 15 15:51:57.360283 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:57.360269    2564 scope.go:117] "RemoveContainer" containerID="683c7bf9ab558365004956a90da7f1eee7c8a2deba26d8addc85870627c15cd0"
Jul 15 15:51:57.369561 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:57.369547    2564 scope.go:117] "RemoveContainer" containerID="8548a6e7809f494e326789415345a3c09a81bb74d9071b2705441c0a78eb03c0"
Jul 15 15:51:57.377397 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:57.377378    2564 scope.go:117] "RemoveContainer" containerID="683c7bf9ab558365004956a90da7f1eee7c8a2deba26d8addc85870627c15cd0"
Jul 15 15:51:57.377651 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:51:57.377631    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"683c7bf9ab558365004956a90da7f1eee7c8a2deba26d8addc85870627c15cd0\": container with ID starting with 683c7bf9ab558365004956a90da7f1eee7c8a2deba26d8addc85870627c15cd0 not found: ID does not exist" containerID="683c7bf9ab558365004956a90da7f1eee7c8a2deba26d8addc85870627c15cd0"
Jul 15 15:51:57.377711 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:57.377661    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"683c7bf9ab558365004956a90da7f1eee7c8a2deba26d8addc85870627c15cd0"} err="failed to get container status \"683c7bf9ab558365004956a90da7f1eee7c8a2deba26d8addc85870627c15cd0\": rpc error: code = NotFound desc = could not find container \"683c7bf9ab558365004956a90da7f1eee7c8a2deba26d8addc85870627c15cd0\": container with ID starting with 683c7bf9ab558365004956a90da7f1eee7c8a2deba26d8addc85870627c15cd0 not found: ID does not exist"
Jul 15 15:51:57.377711 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:57.377679    2564 scope.go:117] "RemoveContainer" containerID="8548a6e7809f494e326789415345a3c09a81bb74d9071b2705441c0a78eb03c0"
Jul 15 15:51:57.377860 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:51:57.377846    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8548a6e7809f494e326789415345a3c09a81bb74d9071b2705441c0a78eb03c0\": container with ID starting with 8548a6e7809f494e326789415345a3c09a81bb74d9071b2705441c0a78eb03c0 not found: ID does not exist" containerID="8548a6e7809f494e326789415345a3c09a81bb74d9071b2705441c0a78eb03c0"
Jul 15 15:51:57.377907 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:57.377863    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8548a6e7809f494e326789415345a3c09a81bb74d9071b2705441c0a78eb03c0"} err="failed to get container status \"8548a6e7809f494e326789415345a3c09a81bb74d9071b2705441c0a78eb03c0\": rpc error: code = NotFound desc = could not find container \"8548a6e7809f494e326789415345a3c09a81bb74d9071b2705441c0a78eb03c0\": container with ID starting with 8548a6e7809f494e326789415345a3c09a81bb74d9071b2705441c0a78eb03c0 not found: ID does not exist"
Jul 15 15:51:57.381647 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:57.381624    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j"]
Jul 15 15:51:57.386124 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:57.386103    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-38132c4d-openshift-default-6f96ff48ff-qn92j"]
Jul 15 15:51:58.230092 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:58.230052    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03fe0b9e-1e8d-4286-90c8-7181bac0b8e8" path="/var/lib/kubelet/pods/03fe0b9e-1e8d-4286-90c8-7181bac0b8e8/volumes"
Jul 15 15:51:58.463085 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:58.463046    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:51:58.563662 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:51:58.563633    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:52:01.779811 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:52:01.779762    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:52:09.551977 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:52:09.551941    2564 patch_prober.go:28] interesting pod/e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": read tcp 10.133.0.2:50314->10.133.0.48:15021: read: connection reset by peer" start-of-body=
Jul 15 15:52:09.552427 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:52:09.552026    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67" podUID="60127949-e64e-4310-a21c-9cf5eb304089" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": read tcp 10.133.0.2:50314->10.133.0.48:15021: read: connection reset by peer"
Jul 15 15:52:10.427083 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:52:10.427045    2564 generic.go:356] "Generic (PLEG): container finished" podID="60127949-e64e-4310-a21c-9cf5eb304089" containerID="a486f230c8290ae187639815c48c5e0a76177e8020f91c2018734ef1670cfa00" exitCode=0
Jul 15 15:52:10.427291 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:52:10.427126    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67" event={"ID":"60127949-e64e-4310-a21c-9cf5eb304089","Type":"ContainerDied","Data":"a486f230c8290ae187639815c48c5e0a76177e8020f91c2018734ef1670cfa00"}
Jul 15 15:52:10.427588 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:52:10.427569    2564 scope.go:117] "RemoveContainer" containerID="a486f230c8290ae187639815c48c5e0a76177e8020f91c2018734ef1670cfa00"
Jul 15 15:52:10.428691 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:52:10.428657    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 15:52:10.428827 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:52:10.428738    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 15:52:10.428827 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:52:10.428786    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 15:52:11.434786 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:52:11.434755    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67" event={"ID":"60127949-e64e-4310-a21c-9cf5eb304089","Type":"ContainerStarted","Data":"2846c78c4b86ba390ae29fa7d6cf0b97d2e879fb30c251528d846a2ec0b44355"}
Jul 15 15:52:11.589771 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:52:11.589734    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67"
Jul 15 15:52:11.589969 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:52:11.589949    2564 patch_prober.go:28] interesting pod/e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 15 15:52:11.590073 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:52:11.589994    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67" podUID="60127949-e64e-4310-a21c-9cf5eb304089" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 15 15:52:12.590278 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:52:12.590235    2564 patch_prober.go:28] interesting pod/e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 15 15:52:12.590691 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:52:12.590295    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67" podUID="60127949-e64e-4310-a21c-9cf5eb304089" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 15 15:52:13.589768 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:52:13.589735    2564 patch_prober.go:28] interesting pod/e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 15 15:52:13.589943 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:52:13.589789    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67" podUID="60127949-e64e-4310-a21c-9cf5eb304089" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 15 15:52:14.590214 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:52:14.590174    2564 patch_prober.go:28] interesting pod/e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 15 15:52:14.590593 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:52:14.590242    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67" podUID="60127949-e64e-4310-a21c-9cf5eb304089" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 15 15:52:15.593092 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:52:15.593064    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67"
Jul 15 15:52:15.593458 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:52:15.593431    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67"
Jul 15 15:52:15.594065 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:52:15.594045    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67"
Jul 15 15:52:33.599253 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:52:33.599215    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:52:58.238767 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:52:58.238691    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67"]
Jul 15 15:52:58.239182 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:52:58.238854    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67" podUID="60127949-e64e-4310-a21c-9cf5eb304089" containerName="istio-proxy" containerID="cri-o://2846c78c4b86ba390ae29fa7d6cf0b97d2e879fb30c251528d846a2ec0b44355" gracePeriod=30
Jul 15 15:52:58.274778 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:52:58.274751    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:53:00.595682 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:00.595646    2564 patch_prober.go:28] interesting pod/e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Jul 15 15:53:00.596108 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:00.595711    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67" podUID="60127949-e64e-4310-a21c-9cf5eb304089" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 15:53:03.495056 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:03.495029    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67"
Jul 15 15:53:03.623765 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:03.623740    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-57gxj\" (UniqueName: \"kubernetes.io/projected/60127949-e64e-4310-a21c-9cf5eb304089-kube-api-access-57gxj\") pod \"60127949-e64e-4310-a21c-9cf5eb304089\" (UID: \"60127949-e64e-4310-a21c-9cf5eb304089\") "
Jul 15 15:53:03.623903 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:03.623775    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60127949-e64e-4310-a21c-9cf5eb304089-istio-data\") pod \"60127949-e64e-4310-a21c-9cf5eb304089\" (UID: \"60127949-e64e-4310-a21c-9cf5eb304089\") "
Jul 15 15:53:03.623903 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:03.623795    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60127949-e64e-4310-a21c-9cf5eb304089-istio-podinfo\") pod \"60127949-e64e-4310-a21c-9cf5eb304089\" (UID: \"60127949-e64e-4310-a21c-9cf5eb304089\") "
Jul 15 15:53:03.623903 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:03.623819    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60127949-e64e-4310-a21c-9cf5eb304089-credential-socket\") pod \"60127949-e64e-4310-a21c-9cf5eb304089\" (UID: \"60127949-e64e-4310-a21c-9cf5eb304089\") "
Jul 15 15:53:03.624095 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:03.623941    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60127949-e64e-4310-a21c-9cf5eb304089-workload-socket\") pod \"60127949-e64e-4310-a21c-9cf5eb304089\" (UID: \"60127949-e64e-4310-a21c-9cf5eb304089\") "
Jul 15 15:53:03.624095 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:03.624049    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60127949-e64e-4310-a21c-9cf5eb304089-istio-envoy\") pod \"60127949-e64e-4310-a21c-9cf5eb304089\" (UID: \"60127949-e64e-4310-a21c-9cf5eb304089\") "
Jul 15 15:53:03.624211 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:03.624102    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60127949-e64e-4310-a21c-9cf5eb304089-istio-token\") pod \"60127949-e64e-4310-a21c-9cf5eb304089\" (UID: \"60127949-e64e-4310-a21c-9cf5eb304089\") "
Jul 15 15:53:03.624211 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:03.624103    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60127949-e64e-4310-a21c-9cf5eb304089-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "60127949-e64e-4310-a21c-9cf5eb304089" (UID: "60127949-e64e-4310-a21c-9cf5eb304089"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:53:03.624211 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:03.624132    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60127949-e64e-4310-a21c-9cf5eb304089-istiod-ca-cert\") pod \"60127949-e64e-4310-a21c-9cf5eb304089\" (UID: \"60127949-e64e-4310-a21c-9cf5eb304089\") "
Jul 15 15:53:03.624211 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:03.624172    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60127949-e64e-4310-a21c-9cf5eb304089-workload-certs\") pod \"60127949-e64e-4310-a21c-9cf5eb304089\" (UID: \"60127949-e64e-4310-a21c-9cf5eb304089\") "
Jul 15 15:53:03.624211 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:03.624180    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60127949-e64e-4310-a21c-9cf5eb304089-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "60127949-e64e-4310-a21c-9cf5eb304089" (UID: "60127949-e64e-4310-a21c-9cf5eb304089"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:53:03.624472 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:03.624461    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60127949-e64e-4310-a21c-9cf5eb304089-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "60127949-e64e-4310-a21c-9cf5eb304089" (UID: "60127949-e64e-4310-a21c-9cf5eb304089"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 15:53:03.624573 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:03.624538    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60127949-e64e-4310-a21c-9cf5eb304089-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "60127949-e64e-4310-a21c-9cf5eb304089" (UID: "60127949-e64e-4310-a21c-9cf5eb304089"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:53:03.624631 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:03.624612    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60127949-e64e-4310-a21c-9cf5eb304089-credential-socket\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 15:53:03.624631 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:03.624608    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60127949-e64e-4310-a21c-9cf5eb304089-istio-data" (OuterVolumeSpecName: "istio-data") pod "60127949-e64e-4310-a21c-9cf5eb304089" (UID: "60127949-e64e-4310-a21c-9cf5eb304089"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:53:03.624746 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:03.624630    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60127949-e64e-4310-a21c-9cf5eb304089-workload-socket\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 15:53:03.624746 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:03.624650    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60127949-e64e-4310-a21c-9cf5eb304089-istiod-ca-cert\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 15:53:03.626103 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:03.626082    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/60127949-e64e-4310-a21c-9cf5eb304089-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "60127949-e64e-4310-a21c-9cf5eb304089" (UID: "60127949-e64e-4310-a21c-9cf5eb304089"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 15:53:03.626193 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:03.626095    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60127949-e64e-4310-a21c-9cf5eb304089-kube-api-access-57gxj" (OuterVolumeSpecName: "kube-api-access-57gxj") pod "60127949-e64e-4310-a21c-9cf5eb304089" (UID: "60127949-e64e-4310-a21c-9cf5eb304089"). InnerVolumeSpecName "kube-api-access-57gxj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:53:03.626193 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:03.626126    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60127949-e64e-4310-a21c-9cf5eb304089-istio-token" (OuterVolumeSpecName: "istio-token") pod "60127949-e64e-4310-a21c-9cf5eb304089" (UID: "60127949-e64e-4310-a21c-9cf5eb304089"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:53:03.626308 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:03.626287    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60127949-e64e-4310-a21c-9cf5eb304089-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "60127949-e64e-4310-a21c-9cf5eb304089" (UID: "60127949-e64e-4310-a21c-9cf5eb304089"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:53:03.681064 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:03.681037    2564 generic.go:356] "Generic (PLEG): container finished" podID="60127949-e64e-4310-a21c-9cf5eb304089" containerID="2846c78c4b86ba390ae29fa7d6cf0b97d2e879fb30c251528d846a2ec0b44355" exitCode=0
Jul 15 15:53:03.681177 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:03.681088    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67"
Jul 15 15:53:03.681177 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:03.681118    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67" event={"ID":"60127949-e64e-4310-a21c-9cf5eb304089","Type":"ContainerDied","Data":"2846c78c4b86ba390ae29fa7d6cf0b97d2e879fb30c251528d846a2ec0b44355"}
Jul 15 15:53:03.681177 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:03.681173    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67" event={"ID":"60127949-e64e-4310-a21c-9cf5eb304089","Type":"ContainerDied","Data":"79199d5cbbf42686c6fc8b88b10879268e389b6f6665fe86e7edf121373cdf66"}
Jul 15 15:53:03.681335 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:03.681194    2564 scope.go:117] "RemoveContainer" containerID="2846c78c4b86ba390ae29fa7d6cf0b97d2e879fb30c251528d846a2ec0b44355"
Jul 15 15:53:03.689878 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:03.689860    2564 scope.go:117] "RemoveContainer" containerID="a486f230c8290ae187639815c48c5e0a76177e8020f91c2018734ef1670cfa00"
Jul 15 15:53:03.697096 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:03.697077    2564 scope.go:117] "RemoveContainer" containerID="2846c78c4b86ba390ae29fa7d6cf0b97d2e879fb30c251528d846a2ec0b44355"
Jul 15 15:53:03.697346 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:53:03.697330    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2846c78c4b86ba390ae29fa7d6cf0b97d2e879fb30c251528d846a2ec0b44355\": container with ID starting with 2846c78c4b86ba390ae29fa7d6cf0b97d2e879fb30c251528d846a2ec0b44355 not found: ID does not exist" containerID="2846c78c4b86ba390ae29fa7d6cf0b97d2e879fb30c251528d846a2ec0b44355"
Jul 15 15:53:03.697401 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:03.697355    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2846c78c4b86ba390ae29fa7d6cf0b97d2e879fb30c251528d846a2ec0b44355"} err="failed to get container status \"2846c78c4b86ba390ae29fa7d6cf0b97d2e879fb30c251528d846a2ec0b44355\": rpc error: code = NotFound desc = could not find container \"2846c78c4b86ba390ae29fa7d6cf0b97d2e879fb30c251528d846a2ec0b44355\": container with ID starting with 2846c78c4b86ba390ae29fa7d6cf0b97d2e879fb30c251528d846a2ec0b44355 not found: ID does not exist"
Jul 15 15:53:03.697401 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:03.697371    2564 scope.go:117] "RemoveContainer" containerID="a486f230c8290ae187639815c48c5e0a76177e8020f91c2018734ef1670cfa00"
Jul 15 15:53:03.697611 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:53:03.697594    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a486f230c8290ae187639815c48c5e0a76177e8020f91c2018734ef1670cfa00\": container with ID starting with a486f230c8290ae187639815c48c5e0a76177e8020f91c2018734ef1670cfa00 not found: ID does not exist" containerID="a486f230c8290ae187639815c48c5e0a76177e8020f91c2018734ef1670cfa00"
Jul 15 15:53:03.697649 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:03.697618    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a486f230c8290ae187639815c48c5e0a76177e8020f91c2018734ef1670cfa00"} err="failed to get container status \"a486f230c8290ae187639815c48c5e0a76177e8020f91c2018734ef1670cfa00\": rpc error: code = NotFound desc = could not find container \"a486f230c8290ae187639815c48c5e0a76177e8020f91c2018734ef1670cfa00\": container with ID starting with a486f230c8290ae187639815c48c5e0a76177e8020f91c2018734ef1670cfa00 not found: ID does not exist"
Jul 15 15:53:03.703111 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:03.703089    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67"]
Jul 15 15:53:03.706987 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:03.706967    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-c7b34001-gw-openshift-default-5ffcffd89f-2vc67"]
Jul 15 15:53:03.725398 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:03.725378    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60127949-e64e-4310-a21c-9cf5eb304089-istio-envoy\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 15:53:03.725398 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:03.725397    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60127949-e64e-4310-a21c-9cf5eb304089-istio-token\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 15:53:03.725517 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:03.725407    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60127949-e64e-4310-a21c-9cf5eb304089-workload-certs\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 15:53:03.725517 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:03.725415    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-57gxj\" (UniqueName: \"kubernetes.io/projected/60127949-e64e-4310-a21c-9cf5eb304089-kube-api-access-57gxj\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 15:53:03.725517 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:03.725424    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60127949-e64e-4310-a21c-9cf5eb304089-istio-data\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 15:53:03.725517 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:03.725434    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60127949-e64e-4310-a21c-9cf5eb304089-istio-podinfo\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 15:53:04.229367 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:04.229336    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60127949-e64e-4310-a21c-9cf5eb304089" path="/var/lib/kubelet/pods/60127949-e64e-4310-a21c-9cf5eb304089/volumes"
Jul 15 15:53:04.401138 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:04.401107    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-c020b6bf-openshift-default-b76855749-flxbc"]
Jul 15 15:53:04.401470 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:04.401458    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03fe0b9e-1e8d-4286-90c8-7181bac0b8e8" containerName="istio-proxy"
Jul 15 15:53:04.401516 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:04.401471    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="03fe0b9e-1e8d-4286-90c8-7181bac0b8e8" containerName="istio-proxy"
Jul 15 15:53:04.401516 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:04.401483    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60127949-e64e-4310-a21c-9cf5eb304089" containerName="istio-proxy"
Jul 15 15:53:04.401516 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:04.401488    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="60127949-e64e-4310-a21c-9cf5eb304089" containerName="istio-proxy"
Jul 15 15:53:04.401611 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:04.401545    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="60127949-e64e-4310-a21c-9cf5eb304089" containerName="istio-proxy"
Jul 15 15:53:04.401611 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:04.401554    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="60127949-e64e-4310-a21c-9cf5eb304089" containerName="istio-proxy"
Jul 15 15:53:04.401611 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:04.401559    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="03fe0b9e-1e8d-4286-90c8-7181bac0b8e8" containerName="istio-proxy"
Jul 15 15:53:04.401611 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:04.401566    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="03fe0b9e-1e8d-4286-90c8-7181bac0b8e8" containerName="istio-proxy"
Jul 15 15:53:04.405925 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:04.405905    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c020b6bf-openshift-default-b76855749-flxbc"
Jul 15 15:53:04.410003 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:04.409984    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-c020b6bf-openshift-default-dockercfg-gz9jw\""
Jul 15 15:53:04.418984 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:04.418963    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-c020b6bf-openshift-default-b76855749-flxbc"]
Jul 15 15:53:04.532225 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:04.532196    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e314fafc-be79-4f59-a2c5-de99de7eb6fc-credential-socket\") pod \"e2e-ait-c020b6bf-openshift-default-b76855749-flxbc\" (UID: \"e314fafc-be79-4f59-a2c5-de99de7eb6fc\") " pod="openshift-ingress/e2e-ait-c020b6bf-openshift-default-b76855749-flxbc"
Jul 15 15:53:04.532607 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:04.532248    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e314fafc-be79-4f59-a2c5-de99de7eb6fc-workload-socket\") pod \"e2e-ait-c020b6bf-openshift-default-b76855749-flxbc\" (UID: \"e314fafc-be79-4f59-a2c5-de99de7eb6fc\") " pod="openshift-ingress/e2e-ait-c020b6bf-openshift-default-b76855749-flxbc"
Jul 15 15:53:04.532607 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:04.532272    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwhgp\" (UniqueName: \"kubernetes.io/projected/e314fafc-be79-4f59-a2c5-de99de7eb6fc-kube-api-access-lwhgp\") pod \"e2e-ait-c020b6bf-openshift-default-b76855749-flxbc\" (UID: \"e314fafc-be79-4f59-a2c5-de99de7eb6fc\") " pod="openshift-ingress/e2e-ait-c020b6bf-openshift-default-b76855749-flxbc"
Jul 15 15:53:04.532607 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:04.532320    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e314fafc-be79-4f59-a2c5-de99de7eb6fc-workload-certs\") pod \"e2e-ait-c020b6bf-openshift-default-b76855749-flxbc\" (UID: \"e314fafc-be79-4f59-a2c5-de99de7eb6fc\") " pod="openshift-ingress/e2e-ait-c020b6bf-openshift-default-b76855749-flxbc"
Jul 15 15:53:04.532607 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:04.532335    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e314fafc-be79-4f59-a2c5-de99de7eb6fc-istio-podinfo\") pod \"e2e-ait-c020b6bf-openshift-default-b76855749-flxbc\" (UID: \"e314fafc-be79-4f59-a2c5-de99de7eb6fc\") " pod="openshift-ingress/e2e-ait-c020b6bf-openshift-default-b76855749-flxbc"
Jul 15 15:53:04.532607 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:04.532392    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e314fafc-be79-4f59-a2c5-de99de7eb6fc-istiod-ca-cert\") pod \"e2e-ait-c020b6bf-openshift-default-b76855749-flxbc\" (UID: \"e314fafc-be79-4f59-a2c5-de99de7eb6fc\") " pod="openshift-ingress/e2e-ait-c020b6bf-openshift-default-b76855749-flxbc"
Jul 15 15:53:04.532607 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:04.532424    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e314fafc-be79-4f59-a2c5-de99de7eb6fc-istio-data\") pod \"e2e-ait-c020b6bf-openshift-default-b76855749-flxbc\" (UID: \"e314fafc-be79-4f59-a2c5-de99de7eb6fc\") " pod="openshift-ingress/e2e-ait-c020b6bf-openshift-default-b76855749-flxbc"
Jul 15 15:53:04.532607 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:04.532462    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e314fafc-be79-4f59-a2c5-de99de7eb6fc-istio-envoy\") pod \"e2e-ait-c020b6bf-openshift-default-b76855749-flxbc\" (UID: \"e314fafc-be79-4f59-a2c5-de99de7eb6fc\") " pod="openshift-ingress/e2e-ait-c020b6bf-openshift-default-b76855749-flxbc"
Jul 15 15:53:04.532607 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:04.532482    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e314fafc-be79-4f59-a2c5-de99de7eb6fc-istio-token\") pod \"e2e-ait-c020b6bf-openshift-default-b76855749-flxbc\" (UID: \"e314fafc-be79-4f59-a2c5-de99de7eb6fc\") " pod="openshift-ingress/e2e-ait-c020b6bf-openshift-default-b76855749-flxbc"
Jul 15 15:53:04.545455 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:04.545421    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:53:04.633656 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:04.633628    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e314fafc-be79-4f59-a2c5-de99de7eb6fc-workload-socket\") pod \"e2e-ait-c020b6bf-openshift-default-b76855749-flxbc\" (UID: \"e314fafc-be79-4f59-a2c5-de99de7eb6fc\") " pod="openshift-ingress/e2e-ait-c020b6bf-openshift-default-b76855749-flxbc"
Jul 15 15:53:04.633756 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:04.633662    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwhgp\" (UniqueName: \"kubernetes.io/projected/e314fafc-be79-4f59-a2c5-de99de7eb6fc-kube-api-access-lwhgp\") pod \"e2e-ait-c020b6bf-openshift-default-b76855749-flxbc\" (UID: \"e314fafc-be79-4f59-a2c5-de99de7eb6fc\") " pod="openshift-ingress/e2e-ait-c020b6bf-openshift-default-b76855749-flxbc"
Jul 15 15:53:04.633756 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:04.633686    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e314fafc-be79-4f59-a2c5-de99de7eb6fc-workload-certs\") pod \"e2e-ait-c020b6bf-openshift-default-b76855749-flxbc\" (UID: \"e314fafc-be79-4f59-a2c5-de99de7eb6fc\") " pod="openshift-ingress/e2e-ait-c020b6bf-openshift-default-b76855749-flxbc"
Jul 15 15:53:04.633756 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:04.633710    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e314fafc-be79-4f59-a2c5-de99de7eb6fc-istio-podinfo\") pod \"e2e-ait-c020b6bf-openshift-default-b76855749-flxbc\" (UID: \"e314fafc-be79-4f59-a2c5-de99de7eb6fc\") " pod="openshift-ingress/e2e-ait-c020b6bf-openshift-default-b76855749-flxbc"
Jul 15 15:53:04.633756 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:04.633740    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e314fafc-be79-4f59-a2c5-de99de7eb6fc-istiod-ca-cert\") pod \"e2e-ait-c020b6bf-openshift-default-b76855749-flxbc\" (UID: \"e314fafc-be79-4f59-a2c5-de99de7eb6fc\") " pod="openshift-ingress/e2e-ait-c020b6bf-openshift-default-b76855749-flxbc"
Jul 15 15:53:04.633920 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:04.633771    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e314fafc-be79-4f59-a2c5-de99de7eb6fc-istio-data\") pod \"e2e-ait-c020b6bf-openshift-default-b76855749-flxbc\" (UID: \"e314fafc-be79-4f59-a2c5-de99de7eb6fc\") " pod="openshift-ingress/e2e-ait-c020b6bf-openshift-default-b76855749-flxbc"
Jul 15 15:53:04.633920 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:04.633799    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e314fafc-be79-4f59-a2c5-de99de7eb6fc-istio-envoy\") pod \"e2e-ait-c020b6bf-openshift-default-b76855749-flxbc\" (UID: \"e314fafc-be79-4f59-a2c5-de99de7eb6fc\") " pod="openshift-ingress/e2e-ait-c020b6bf-openshift-default-b76855749-flxbc"
Jul 15 15:53:04.633920 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:04.633821    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e314fafc-be79-4f59-a2c5-de99de7eb6fc-istio-token\") pod \"e2e-ait-c020b6bf-openshift-default-b76855749-flxbc\" (UID: \"e314fafc-be79-4f59-a2c5-de99de7eb6fc\") " pod="openshift-ingress/e2e-ait-c020b6bf-openshift-default-b76855749-flxbc"
Jul 15 15:53:04.633920 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:04.633862    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e314fafc-be79-4f59-a2c5-de99de7eb6fc-credential-socket\") pod \"e2e-ait-c020b6bf-openshift-default-b76855749-flxbc\" (UID: \"e314fafc-be79-4f59-a2c5-de99de7eb6fc\") " pod="openshift-ingress/e2e-ait-c020b6bf-openshift-default-b76855749-flxbc"
Jul 15 15:53:04.634457 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:04.634429    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e314fafc-be79-4f59-a2c5-de99de7eb6fc-workload-socket\") pod \"e2e-ait-c020b6bf-openshift-default-b76855749-flxbc\" (UID: \"e314fafc-be79-4f59-a2c5-de99de7eb6fc\") " pod="openshift-ingress/e2e-ait-c020b6bf-openshift-default-b76855749-flxbc"
Jul 15 15:53:04.634579 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:04.634500    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e314fafc-be79-4f59-a2c5-de99de7eb6fc-workload-certs\") pod \"e2e-ait-c020b6bf-openshift-default-b76855749-flxbc\" (UID: \"e314fafc-be79-4f59-a2c5-de99de7eb6fc\") " pod="openshift-ingress/e2e-ait-c020b6bf-openshift-default-b76855749-flxbc"
Jul 15 15:53:04.634579 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:04.634562    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e314fafc-be79-4f59-a2c5-de99de7eb6fc-istiod-ca-cert\") pod \"e2e-ait-c020b6bf-openshift-default-b76855749-flxbc\" (UID: \"e314fafc-be79-4f59-a2c5-de99de7eb6fc\") " pod="openshift-ingress/e2e-ait-c020b6bf-openshift-default-b76855749-flxbc"
Jul 15 15:53:04.634702 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:04.634624    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e314fafc-be79-4f59-a2c5-de99de7eb6fc-istio-data\") pod \"e2e-ait-c020b6bf-openshift-default-b76855749-flxbc\" (UID: \"e314fafc-be79-4f59-a2c5-de99de7eb6fc\") " pod="openshift-ingress/e2e-ait-c020b6bf-openshift-default-b76855749-flxbc"
Jul 15 15:53:04.634702 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:04.634675    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e314fafc-be79-4f59-a2c5-de99de7eb6fc-credential-socket\") pod \"e2e-ait-c020b6bf-openshift-default-b76855749-flxbc\" (UID: \"e314fafc-be79-4f59-a2c5-de99de7eb6fc\") " pod="openshift-ingress/e2e-ait-c020b6bf-openshift-default-b76855749-flxbc"
Jul 15 15:53:04.636257 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:04.636238    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e314fafc-be79-4f59-a2c5-de99de7eb6fc-istio-envoy\") pod \"e2e-ait-c020b6bf-openshift-default-b76855749-flxbc\" (UID: \"e314fafc-be79-4f59-a2c5-de99de7eb6fc\") " pod="openshift-ingress/e2e-ait-c020b6bf-openshift-default-b76855749-flxbc"
Jul 15 15:53:04.636398 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:04.636383    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e314fafc-be79-4f59-a2c5-de99de7eb6fc-istio-podinfo\") pod \"e2e-ait-c020b6bf-openshift-default-b76855749-flxbc\" (UID: \"e314fafc-be79-4f59-a2c5-de99de7eb6fc\") " pod="openshift-ingress/e2e-ait-c020b6bf-openshift-default-b76855749-flxbc"
Jul 15 15:53:04.642391 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:04.642362    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwhgp\" (UniqueName: \"kubernetes.io/projected/e314fafc-be79-4f59-a2c5-de99de7eb6fc-kube-api-access-lwhgp\") pod \"e2e-ait-c020b6bf-openshift-default-b76855749-flxbc\" (UID: \"e314fafc-be79-4f59-a2c5-de99de7eb6fc\") " pod="openshift-ingress/e2e-ait-c020b6bf-openshift-default-b76855749-flxbc"
Jul 15 15:53:04.642639 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:04.642621    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e314fafc-be79-4f59-a2c5-de99de7eb6fc-istio-token\") pod \"e2e-ait-c020b6bf-openshift-default-b76855749-flxbc\" (UID: \"e314fafc-be79-4f59-a2c5-de99de7eb6fc\") " pod="openshift-ingress/e2e-ait-c020b6bf-openshift-default-b76855749-flxbc"
Jul 15 15:53:04.702345 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:04.702312    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:53:04.716197 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:04.716173    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c020b6bf-openshift-default-b76855749-flxbc"
Jul 15 15:53:04.880436 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:04.880412    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-c020b6bf-openshift-default-b76855749-flxbc"]
Jul 15 15:53:04.881393 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:53:04.881365    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode314fafc_be79_4f59_a2c5_de99de7eb6fc.slice/crio-12e5fb50c65af5c7296aa9bd506cc7dbfb62d649a8b72d842e45c41dcac602b4 WatchSource:0}: Error finding container 12e5fb50c65af5c7296aa9bd506cc7dbfb62d649a8b72d842e45c41dcac602b4: Status 404 returned error can't find the container with id 12e5fb50c65af5c7296aa9bd506cc7dbfb62d649a8b72d842e45c41dcac602b4
Jul 15 15:53:04.883452 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:04.883419    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 15:53:04.883534 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:04.883481    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 15:53:04.883534 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:04.883511    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 15:53:04.910117 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:04.910080    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:53:05.638923 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:05.638886    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:53:05.694546 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:05.694513    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c020b6bf-openshift-default-b76855749-flxbc" event={"ID":"e314fafc-be79-4f59-a2c5-de99de7eb6fc","Type":"ContainerStarted","Data":"98257b0333618c99e4c2a4698a9a07e3c53de342c00fbcd34ce893fc61e7b624"}
Jul 15 15:53:05.694714 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:05.694566    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c020b6bf-openshift-default-b76855749-flxbc" event={"ID":"e314fafc-be79-4f59-a2c5-de99de7eb6fc","Type":"ContainerStarted","Data":"12e5fb50c65af5c7296aa9bd506cc7dbfb62d649a8b72d842e45c41dcac602b4"}
Jul 15 15:53:05.716600 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:05.716569    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-c020b6bf-openshift-default-b76855749-flxbc"
Jul 15 15:53:05.718174 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:05.718128    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-c020b6bf-openshift-default-b76855749-flxbc" podStartSLOduration=1.71811115 podStartE2EDuration="1.71811115s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:53:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:53:05.716442676 +0000 UTC m=+1716.062345871" watchObservedRunningTime="2026-07-15 15:53:05.71811115 +0000 UTC m=+1716.064014344"
Jul 15 15:53:05.721510 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:05.721484    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-c020b6bf-openshift-default-b76855749-flxbc"
Jul 15 15:53:05.722250 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:05.722227    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:53:05.877785 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:05.877753    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:53:06.186029 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:06.185969    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:53:06.439187 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:06.439095    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:53:06.540108 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:06.540061    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:53:06.699820 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:06.699744    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-c020b6bf-openshift-default-b76855749-flxbc"
Jul 15 15:53:06.700649 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:06.700627    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-c020b6bf-openshift-default-b76855749-flxbc"
Jul 15 15:53:08.130171 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:08.130142    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:53:20.763296 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:20.763263    2564 generic.go:356] "Generic (PLEG): container finished" podID="e314fafc-be79-4f59-a2c5-de99de7eb6fc" containerID="98257b0333618c99e4c2a4698a9a07e3c53de342c00fbcd34ce893fc61e7b624" exitCode=0
Jul 15 15:53:20.763704 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:20.763343    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c020b6bf-openshift-default-b76855749-flxbc" event={"ID":"e314fafc-be79-4f59-a2c5-de99de7eb6fc","Type":"ContainerDied","Data":"98257b0333618c99e4c2a4698a9a07e3c53de342c00fbcd34ce893fc61e7b624"}
Jul 15 15:53:20.763747 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:20.763717    2564 scope.go:117] "RemoveContainer" containerID="98257b0333618c99e4c2a4698a9a07e3c53de342c00fbcd34ce893fc61e7b624"
Jul 15 15:53:20.764751 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:20.764714    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 15:53:20.764864 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:20.764803    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 15:53:20.764864 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:20.764851    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 15:53:21.700483 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:21.700437    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-c020b6bf-openshift-default-b76855749-flxbc"
Jul 15 15:53:21.773285 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:21.773242    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c020b6bf-openshift-default-b76855749-flxbc" event={"ID":"e314fafc-be79-4f59-a2c5-de99de7eb6fc","Type":"ContainerStarted","Data":"66baa31cf2fa68f16449b8fd6e0ede74b32fca3cd0d76f6fa6179193fcb231f7"}
Jul 15 15:53:22.717225 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:22.717190    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-c020b6bf-openshift-default-b76855749-flxbc"
Jul 15 15:53:22.718158 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:22.718134    2564 patch_prober.go:28] interesting pod/e2e-ait-c020b6bf-openshift-default-b76855749-flxbc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 15 15:53:22.718277 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:22.718189    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c020b6bf-openshift-default-b76855749-flxbc" podUID="e314fafc-be79-4f59-a2c5-de99de7eb6fc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 15 15:53:23.717080 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:23.717045    2564 patch_prober.go:28] interesting pod/e2e-ait-c020b6bf-openshift-default-b76855749-flxbc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 15 15:53:23.717488 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:23.717117    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c020b6bf-openshift-default-b76855749-flxbc" podUID="e314fafc-be79-4f59-a2c5-de99de7eb6fc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 15 15:53:24.716991 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:24.716954    2564 patch_prober.go:28] interesting pod/e2e-ait-c020b6bf-openshift-default-b76855749-flxbc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 15 15:53:24.717193 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:24.717041    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c020b6bf-openshift-default-b76855749-flxbc" podUID="e314fafc-be79-4f59-a2c5-de99de7eb6fc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 15 15:53:25.720983 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:25.720947    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-c020b6bf-openshift-default-b76855749-flxbc"
Jul 15 15:53:25.721389 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:25.721369    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-c020b6bf-openshift-default-b76855749-flxbc"
Jul 15 15:53:25.722034 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:25.722001    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-c020b6bf-openshift-default-b76855749-flxbc"
Jul 15 15:53:45.757077 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:45.757040    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:53:45.859988 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:53:45.859951    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:54:11.250833 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:11.250798    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:54:11.348668 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:11.348631    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:54:21.317836 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:21.317804    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:54:25.785000 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:25.784915    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:54:30.151858 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:30.151825    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfw7r_55d0e798-7e5a-4f3e-afc2-67dfb308d934/ovn-acl-logging/0.log"
Jul 15 15:54:30.157132 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:30.157112    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfw7r_55d0e798-7e5a-4f3e-afc2-67dfb308d934/ovn-acl-logging/0.log"
Jul 15 15:54:32.030706 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:32.030671    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:54:32.131406 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:32.131377    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:54:36.807094 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:36.807056    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-c020b6bf-openshift-default-b76855749-flxbc"]
Jul 15 15:54:36.807565 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:36.807258    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-c020b6bf-openshift-default-b76855749-flxbc" podUID="e314fafc-be79-4f59-a2c5-de99de7eb6fc" containerName="istio-proxy" containerID="cri-o://66baa31cf2fa68f16449b8fd6e0ede74b32fca3cd0d76f6fa6179193fcb231f7" gracePeriod=30
Jul 15 15:54:36.843306 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:36.843253    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:54:37.108658 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:37.108583    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7"]
Jul 15 15:54:37.108949 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:37.108936    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60127949-e64e-4310-a21c-9cf5eb304089" containerName="istio-proxy"
Jul 15 15:54:37.108991 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:37.108950    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="60127949-e64e-4310-a21c-9cf5eb304089" containerName="istio-proxy"
Jul 15 15:54:37.108991 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:37.108975    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03fe0b9e-1e8d-4286-90c8-7181bac0b8e8" containerName="istio-proxy"
Jul 15 15:54:37.108991 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:37.108980    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="03fe0b9e-1e8d-4286-90c8-7181bac0b8e8" containerName="istio-proxy"
Jul 15 15:54:37.112225 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:37.112198    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7"
Jul 15 15:54:37.114923 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:37.114898    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-4d69cf00-openshift-default-dockercfg-8zndn\""
Jul 15 15:54:37.127687 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:37.127664    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7"]
Jul 15 15:54:37.198457 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:37.198422    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:54:37.202814 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:37.202793    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e4092b22-a4fd-46b4-a177-086b0a8da544-istio-token\") pod \"e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7\" (UID: \"e4092b22-a4fd-46b4-a177-086b0a8da544\") " pod="openshift-ingress/e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7"
Jul 15 15:54:37.202906 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:37.202827    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e4092b22-a4fd-46b4-a177-086b0a8da544-workload-certs\") pod \"e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7\" (UID: \"e4092b22-a4fd-46b4-a177-086b0a8da544\") " pod="openshift-ingress/e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7"
Jul 15 15:54:37.202906 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:37.202854    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4092b22-a4fd-46b4-a177-086b0a8da544-workload-socket\") pod \"e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7\" (UID: \"e4092b22-a4fd-46b4-a177-086b0a8da544\") " pod="openshift-ingress/e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7"
Jul 15 15:54:37.202906 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:37.202881    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e4092b22-a4fd-46b4-a177-086b0a8da544-istio-envoy\") pod \"e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7\" (UID: \"e4092b22-a4fd-46b4-a177-086b0a8da544\") " pod="openshift-ingress/e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7"
Jul 15 15:54:37.202906 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:37.202896    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e4092b22-a4fd-46b4-a177-086b0a8da544-istio-podinfo\") pod \"e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7\" (UID: \"e4092b22-a4fd-46b4-a177-086b0a8da544\") " pod="openshift-ingress/e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7"
Jul 15 15:54:37.203071 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:37.202916    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqn4h\" (UniqueName: \"kubernetes.io/projected/e4092b22-a4fd-46b4-a177-086b0a8da544-kube-api-access-vqn4h\") pod \"e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7\" (UID: \"e4092b22-a4fd-46b4-a177-086b0a8da544\") " pod="openshift-ingress/e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7"
Jul 15 15:54:37.203071 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:37.202992    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e4092b22-a4fd-46b4-a177-086b0a8da544-istio-data\") pod \"e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7\" (UID: \"e4092b22-a4fd-46b4-a177-086b0a8da544\") " pod="openshift-ingress/e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7"
Jul 15 15:54:37.203071 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:37.203044    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4092b22-a4fd-46b4-a177-086b0a8da544-credential-socket\") pod \"e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7\" (UID: \"e4092b22-a4fd-46b4-a177-086b0a8da544\") " pod="openshift-ingress/e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7"
Jul 15 15:54:37.203170 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:37.203073    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e4092b22-a4fd-46b4-a177-086b0a8da544-istiod-ca-cert\") pod \"e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7\" (UID: \"e4092b22-a4fd-46b4-a177-086b0a8da544\") " pod="openshift-ingress/e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7"
Jul 15 15:54:37.303947 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:37.303910    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e4092b22-a4fd-46b4-a177-086b0a8da544-istio-token\") pod \"e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7\" (UID: \"e4092b22-a4fd-46b4-a177-086b0a8da544\") " pod="openshift-ingress/e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7"
Jul 15 15:54:37.303947 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:37.303951    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e4092b22-a4fd-46b4-a177-086b0a8da544-workload-certs\") pod \"e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7\" (UID: \"e4092b22-a4fd-46b4-a177-086b0a8da544\") " pod="openshift-ingress/e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7"
Jul 15 15:54:37.304186 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:37.304129    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4092b22-a4fd-46b4-a177-086b0a8da544-workload-socket\") pod \"e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7\" (UID: \"e4092b22-a4fd-46b4-a177-086b0a8da544\") " pod="openshift-ingress/e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7"
Jul 15 15:54:37.304186 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:37.304160    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e4092b22-a4fd-46b4-a177-086b0a8da544-istio-envoy\") pod \"e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7\" (UID: \"e4092b22-a4fd-46b4-a177-086b0a8da544\") " pod="openshift-ingress/e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7"
Jul 15 15:54:37.304186 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:37.304182    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e4092b22-a4fd-46b4-a177-086b0a8da544-istio-podinfo\") pod \"e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7\" (UID: \"e4092b22-a4fd-46b4-a177-086b0a8da544\") " pod="openshift-ingress/e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7"
Jul 15 15:54:37.304324 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:37.304291    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e4092b22-a4fd-46b4-a177-086b0a8da544-workload-certs\") pod \"e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7\" (UID: \"e4092b22-a4fd-46b4-a177-086b0a8da544\") " pod="openshift-ingress/e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7"
Jul 15 15:54:37.304379 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:37.304315    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqn4h\" (UniqueName: \"kubernetes.io/projected/e4092b22-a4fd-46b4-a177-086b0a8da544-kube-api-access-vqn4h\") pod \"e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7\" (UID: \"e4092b22-a4fd-46b4-a177-086b0a8da544\") " pod="openshift-ingress/e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7"
Jul 15 15:54:37.304433 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:37.304411    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e4092b22-a4fd-46b4-a177-086b0a8da544-istio-data\") pod \"e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7\" (UID: \"e4092b22-a4fd-46b4-a177-086b0a8da544\") " pod="openshift-ingress/e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7"
Jul 15 15:54:37.304491 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:37.304445    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4092b22-a4fd-46b4-a177-086b0a8da544-credential-socket\") pod \"e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7\" (UID: \"e4092b22-a4fd-46b4-a177-086b0a8da544\") " pod="openshift-ingress/e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7"
Jul 15 15:54:37.304491 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:37.304475    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e4092b22-a4fd-46b4-a177-086b0a8da544-istiod-ca-cert\") pod \"e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7\" (UID: \"e4092b22-a4fd-46b4-a177-086b0a8da544\") " pod="openshift-ingress/e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7"
Jul 15 15:54:37.304491 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:37.304484    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4092b22-a4fd-46b4-a177-086b0a8da544-workload-socket\") pod \"e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7\" (UID: \"e4092b22-a4fd-46b4-a177-086b0a8da544\") " pod="openshift-ingress/e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7"
Jul 15 15:54:37.304774 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:37.304752    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e4092b22-a4fd-46b4-a177-086b0a8da544-istio-data\") pod \"e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7\" (UID: \"e4092b22-a4fd-46b4-a177-086b0a8da544\") " pod="openshift-ingress/e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7"
Jul 15 15:54:37.304851 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:37.304803    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4092b22-a4fd-46b4-a177-086b0a8da544-credential-socket\") pod \"e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7\" (UID: \"e4092b22-a4fd-46b4-a177-086b0a8da544\") " pod="openshift-ingress/e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7"
Jul 15 15:54:37.305092 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:37.305073    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e4092b22-a4fd-46b4-a177-086b0a8da544-istiod-ca-cert\") pod \"e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7\" (UID: \"e4092b22-a4fd-46b4-a177-086b0a8da544\") " pod="openshift-ingress/e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7"
Jul 15 15:54:37.306529 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:37.306505    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e4092b22-a4fd-46b4-a177-086b0a8da544-istio-envoy\") pod \"e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7\" (UID: \"e4092b22-a4fd-46b4-a177-086b0a8da544\") " pod="openshift-ingress/e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7"
Jul 15 15:54:37.306673 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:37.306656    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e4092b22-a4fd-46b4-a177-086b0a8da544-istio-podinfo\") pod \"e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7\" (UID: \"e4092b22-a4fd-46b4-a177-086b0a8da544\") " pod="openshift-ingress/e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7"
Jul 15 15:54:37.313159 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:37.313130    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e4092b22-a4fd-46b4-a177-086b0a8da544-istio-token\") pod \"e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7\" (UID: \"e4092b22-a4fd-46b4-a177-086b0a8da544\") " pod="openshift-ingress/e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7"
Jul 15 15:54:37.313281 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:37.313264    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqn4h\" (UniqueName: \"kubernetes.io/projected/e4092b22-a4fd-46b4-a177-086b0a8da544-kube-api-access-vqn4h\") pod \"e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7\" (UID: \"e4092b22-a4fd-46b4-a177-086b0a8da544\") " pod="openshift-ingress/e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7"
Jul 15 15:54:37.423047 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:37.422952    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7"
Jul 15 15:54:37.558323 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:37.558299    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7"]
Jul 15 15:54:37.560592 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:54:37.560565    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4092b22_a4fd_46b4_a177_086b0a8da544.slice/crio-05b6281a3ddf003c185c559a7c801de6c4dea7a379832e7386cd02308027ec1d WatchSource:0}: Error finding container 05b6281a3ddf003c185c559a7c801de6c4dea7a379832e7386cd02308027ec1d: Status 404 returned error can't find the container with id 05b6281a3ddf003c185c559a7c801de6c4dea7a379832e7386cd02308027ec1d
Jul 15 15:54:37.562861 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:37.562820    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 15:54:37.562940 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:37.562922    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 15:54:37.562982 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:37.562969    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 15:54:38.128715 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:38.128626    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7" event={"ID":"e4092b22-a4fd-46b4-a177-086b0a8da544","Type":"ContainerStarted","Data":"e7fe9d665e4a8a64de4d0febfaa5fb01eb378ce0bac5af701882b64e9e9fc15a"}
Jul 15 15:54:38.128715 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:38.128690    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7" event={"ID":"e4092b22-a4fd-46b4-a177-086b0a8da544","Type":"ContainerStarted","Data":"05b6281a3ddf003c185c559a7c801de6c4dea7a379832e7386cd02308027ec1d"}
Jul 15 15:54:38.153165 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:38.153112    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7" podStartSLOduration=1.153096492 podStartE2EDuration="1.153096492s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:54:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:54:38.15245938 +0000 UTC m=+1808.498362574" watchObservedRunningTime="2026-07-15 15:54:38.153096492 +0000 UTC m=+1808.498999684"
Jul 15 15:54:38.273346 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:38.273298    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:54:38.377474 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:38.377435    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:54:38.423828 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:38.423749    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7"
Jul 15 15:54:38.428318 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:38.428294    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7"
Jul 15 15:54:38.600823 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:38.600785    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:54:38.900224 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:38.900186    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:54:39.133504 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:39.133476    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7"
Jul 15 15:54:39.134425 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:39.134409    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7"
Jul 15 15:54:39.167797 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:39.167736    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:54:39.301534 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:39.301506    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:54:40.723403 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:40.723370    2564 patch_prober.go:28] interesting pod/e2e-ait-c020b6bf-openshift-default-b76855749-flxbc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 15 15:54:40.723865 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:40.723424    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-c020b6bf-openshift-default-b76855749-flxbc" podUID="e314fafc-be79-4f59-a2c5-de99de7eb6fc" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 15:54:42.063144 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:42.063119    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c020b6bf-openshift-default-b76855749-flxbc"
Jul 15 15:54:42.140907 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:42.140883    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e314fafc-be79-4f59-a2c5-de99de7eb6fc-credential-socket\") pod \"e314fafc-be79-4f59-a2c5-de99de7eb6fc\" (UID: \"e314fafc-be79-4f59-a2c5-de99de7eb6fc\") "
Jul 15 15:54:42.141054 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:42.140912    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e314fafc-be79-4f59-a2c5-de99de7eb6fc-istio-data\") pod \"e314fafc-be79-4f59-a2c5-de99de7eb6fc\" (UID: \"e314fafc-be79-4f59-a2c5-de99de7eb6fc\") "
Jul 15 15:54:42.141054 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:42.140948    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e314fafc-be79-4f59-a2c5-de99de7eb6fc-istio-token\") pod \"e314fafc-be79-4f59-a2c5-de99de7eb6fc\" (UID: \"e314fafc-be79-4f59-a2c5-de99de7eb6fc\") "
Jul 15 15:54:42.141160 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:42.141131    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e314fafc-be79-4f59-a2c5-de99de7eb6fc-workload-socket\") pod \"e314fafc-be79-4f59-a2c5-de99de7eb6fc\" (UID: \"e314fafc-be79-4f59-a2c5-de99de7eb6fc\") "
Jul 15 15:54:42.141209 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:42.141164    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e314fafc-be79-4f59-a2c5-de99de7eb6fc-istio-podinfo\") pod \"e314fafc-be79-4f59-a2c5-de99de7eb6fc\" (UID: \"e314fafc-be79-4f59-a2c5-de99de7eb6fc\") "
Jul 15 15:54:42.141209 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:42.141189    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e314fafc-be79-4f59-a2c5-de99de7eb6fc-istio-envoy\") pod \"e314fafc-be79-4f59-a2c5-de99de7eb6fc\" (UID: \"e314fafc-be79-4f59-a2c5-de99de7eb6fc\") "
Jul 15 15:54:42.141209 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:42.141198    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e314fafc-be79-4f59-a2c5-de99de7eb6fc-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e314fafc-be79-4f59-a2c5-de99de7eb6fc" (UID: "e314fafc-be79-4f59-a2c5-de99de7eb6fc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:54:42.141359 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:42.141230    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lwhgp\" (UniqueName: \"kubernetes.io/projected/e314fafc-be79-4f59-a2c5-de99de7eb6fc-kube-api-access-lwhgp\") pod \"e314fafc-be79-4f59-a2c5-de99de7eb6fc\" (UID: \"e314fafc-be79-4f59-a2c5-de99de7eb6fc\") "
Jul 15 15:54:42.141359 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:42.141265    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e314fafc-be79-4f59-a2c5-de99de7eb6fc-workload-certs\") pod \"e314fafc-be79-4f59-a2c5-de99de7eb6fc\" (UID: \"e314fafc-be79-4f59-a2c5-de99de7eb6fc\") "
Jul 15 15:54:42.141359 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:42.141314    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e314fafc-be79-4f59-a2c5-de99de7eb6fc-istiod-ca-cert\") pod \"e314fafc-be79-4f59-a2c5-de99de7eb6fc\" (UID: \"e314fafc-be79-4f59-a2c5-de99de7eb6fc\") "
Jul 15 15:54:42.141515 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:42.141412    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e314fafc-be79-4f59-a2c5-de99de7eb6fc-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e314fafc-be79-4f59-a2c5-de99de7eb6fc" (UID: "e314fafc-be79-4f59-a2c5-de99de7eb6fc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:54:42.141625 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:42.141605    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e314fafc-be79-4f59-a2c5-de99de7eb6fc-workload-socket\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 15:54:42.141695 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:42.141619    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e314fafc-be79-4f59-a2c5-de99de7eb6fc-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e314fafc-be79-4f59-a2c5-de99de7eb6fc" (UID: "e314fafc-be79-4f59-a2c5-de99de7eb6fc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:54:42.141695 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:42.141632    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e314fafc-be79-4f59-a2c5-de99de7eb6fc-credential-socket\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 15:54:42.141786 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:42.141688    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e314fafc-be79-4f59-a2c5-de99de7eb6fc-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e314fafc-be79-4f59-a2c5-de99de7eb6fc" (UID: "e314fafc-be79-4f59-a2c5-de99de7eb6fc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 15:54:42.141942 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:42.141916    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e314fafc-be79-4f59-a2c5-de99de7eb6fc-istio-data" (OuterVolumeSpecName: "istio-data") pod "e314fafc-be79-4f59-a2c5-de99de7eb6fc" (UID: "e314fafc-be79-4f59-a2c5-de99de7eb6fc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:54:42.143226 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:42.143206    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e314fafc-be79-4f59-a2c5-de99de7eb6fc-istio-token" (OuterVolumeSpecName: "istio-token") pod "e314fafc-be79-4f59-a2c5-de99de7eb6fc" (UID: "e314fafc-be79-4f59-a2c5-de99de7eb6fc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:54:42.143611 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:42.143590    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e314fafc-be79-4f59-a2c5-de99de7eb6fc-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e314fafc-be79-4f59-a2c5-de99de7eb6fc" (UID: "e314fafc-be79-4f59-a2c5-de99de7eb6fc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:54:42.143818 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:42.143783    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e314fafc-be79-4f59-a2c5-de99de7eb6fc-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e314fafc-be79-4f59-a2c5-de99de7eb6fc" (UID: "e314fafc-be79-4f59-a2c5-de99de7eb6fc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 15:54:42.143938 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:42.143920    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e314fafc-be79-4f59-a2c5-de99de7eb6fc-kube-api-access-lwhgp" (OuterVolumeSpecName: "kube-api-access-lwhgp") pod "e314fafc-be79-4f59-a2c5-de99de7eb6fc" (UID: "e314fafc-be79-4f59-a2c5-de99de7eb6fc"). InnerVolumeSpecName "kube-api-access-lwhgp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:54:42.149187 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:42.149162    2564 generic.go:356] "Generic (PLEG): container finished" podID="e314fafc-be79-4f59-a2c5-de99de7eb6fc" containerID="66baa31cf2fa68f16449b8fd6e0ede74b32fca3cd0d76f6fa6179193fcb231f7" exitCode=0
Jul 15 15:54:42.149286 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:42.149216    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c020b6bf-openshift-default-b76855749-flxbc"
Jul 15 15:54:42.149286 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:42.149245    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c020b6bf-openshift-default-b76855749-flxbc" event={"ID":"e314fafc-be79-4f59-a2c5-de99de7eb6fc","Type":"ContainerDied","Data":"66baa31cf2fa68f16449b8fd6e0ede74b32fca3cd0d76f6fa6179193fcb231f7"}
Jul 15 15:54:42.149398 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:42.149302    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c020b6bf-openshift-default-b76855749-flxbc" event={"ID":"e314fafc-be79-4f59-a2c5-de99de7eb6fc","Type":"ContainerDied","Data":"12e5fb50c65af5c7296aa9bd506cc7dbfb62d649a8b72d842e45c41dcac602b4"}
Jul 15 15:54:42.149398 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:42.149327    2564 scope.go:117] "RemoveContainer" containerID="66baa31cf2fa68f16449b8fd6e0ede74b32fca3cd0d76f6fa6179193fcb231f7"
Jul 15 15:54:42.167442 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:42.167425    2564 scope.go:117] "RemoveContainer" containerID="98257b0333618c99e4c2a4698a9a07e3c53de342c00fbcd34ce893fc61e7b624"
Jul 15 15:54:42.174817 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:42.174803    2564 scope.go:117] "RemoveContainer" containerID="66baa31cf2fa68f16449b8fd6e0ede74b32fca3cd0d76f6fa6179193fcb231f7"
Jul 15 15:54:42.175079 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:54:42.175061    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66baa31cf2fa68f16449b8fd6e0ede74b32fca3cd0d76f6fa6179193fcb231f7\": container with ID starting with 66baa31cf2fa68f16449b8fd6e0ede74b32fca3cd0d76f6fa6179193fcb231f7 not found: ID does not exist" containerID="66baa31cf2fa68f16449b8fd6e0ede74b32fca3cd0d76f6fa6179193fcb231f7"
Jul 15 15:54:42.175164 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:42.175086    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66baa31cf2fa68f16449b8fd6e0ede74b32fca3cd0d76f6fa6179193fcb231f7"} err="failed to get container status \"66baa31cf2fa68f16449b8fd6e0ede74b32fca3cd0d76f6fa6179193fcb231f7\": rpc error: code = NotFound desc = could not find container \"66baa31cf2fa68f16449b8fd6e0ede74b32fca3cd0d76f6fa6179193fcb231f7\": container with ID starting with 66baa31cf2fa68f16449b8fd6e0ede74b32fca3cd0d76f6fa6179193fcb231f7 not found: ID does not exist"
Jul 15 15:54:42.175164 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:42.175101    2564 scope.go:117] "RemoveContainer" containerID="98257b0333618c99e4c2a4698a9a07e3c53de342c00fbcd34ce893fc61e7b624"
Jul 15 15:54:42.175338 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:54:42.175320    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98257b0333618c99e4c2a4698a9a07e3c53de342c00fbcd34ce893fc61e7b624\": container with ID starting with 98257b0333618c99e4c2a4698a9a07e3c53de342c00fbcd34ce893fc61e7b624 not found: ID does not exist" containerID="98257b0333618c99e4c2a4698a9a07e3c53de342c00fbcd34ce893fc61e7b624"
Jul 15 15:54:42.175390 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:42.175343    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98257b0333618c99e4c2a4698a9a07e3c53de342c00fbcd34ce893fc61e7b624"} err="failed to get container status \"98257b0333618c99e4c2a4698a9a07e3c53de342c00fbcd34ce893fc61e7b624\": rpc error: code = NotFound desc = could not find container \"98257b0333618c99e4c2a4698a9a07e3c53de342c00fbcd34ce893fc61e7b624\": container with ID starting with 98257b0333618c99e4c2a4698a9a07e3c53de342c00fbcd34ce893fc61e7b624 not found: ID does not exist"
Jul 15 15:54:42.178449 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:42.178426    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-c020b6bf-openshift-default-b76855749-flxbc"]
Jul 15 15:54:42.182591 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:42.182572    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-c020b6bf-openshift-default-b76855749-flxbc"]
Jul 15 15:54:42.234151 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:42.230215    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e314fafc-be79-4f59-a2c5-de99de7eb6fc" path="/var/lib/kubelet/pods/e314fafc-be79-4f59-a2c5-de99de7eb6fc/volumes"
Jul 15 15:54:42.242373 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:42.242354    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e314fafc-be79-4f59-a2c5-de99de7eb6fc-istiod-ca-cert\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 15:54:42.242450 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:42.242376    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e314fafc-be79-4f59-a2c5-de99de7eb6fc-istio-data\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 15:54:42.242450 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:42.242384    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e314fafc-be79-4f59-a2c5-de99de7eb6fc-istio-token\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 15:54:42.242450 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:42.242392    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e314fafc-be79-4f59-a2c5-de99de7eb6fc-istio-podinfo\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 15:54:42.242450 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:42.242400    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e314fafc-be79-4f59-a2c5-de99de7eb6fc-istio-envoy\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 15:54:42.242450 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:42.242409    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lwhgp\" (UniqueName: \"kubernetes.io/projected/e314fafc-be79-4f59-a2c5-de99de7eb6fc-kube-api-access-lwhgp\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 15:54:42.242450 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:42.242418    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e314fafc-be79-4f59-a2c5-de99de7eb6fc-workload-certs\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 15:54:49.220789 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:49.220740    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:54:49.352499 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:49.352463    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:54:52.371555 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:52.371511    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:54:54.135528 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:54.135492    2564 patch_prober.go:28] interesting pod/e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 15 15:54:54.135991 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:54.135549    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7" podUID="e4092b22-a4fd-46b4-a177-086b0a8da544" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 15 15:54:54.217344 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:54.217314    2564 generic.go:356] "Generic (PLEG): container finished" podID="e4092b22-a4fd-46b4-a177-086b0a8da544" containerID="e7fe9d665e4a8a64de4d0febfaa5fb01eb378ce0bac5af701882b64e9e9fc15a" exitCode=0
Jul 15 15:54:54.217485 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:54.217388    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7" event={"ID":"e4092b22-a4fd-46b4-a177-086b0a8da544","Type":"ContainerDied","Data":"e7fe9d665e4a8a64de4d0febfaa5fb01eb378ce0bac5af701882b64e9e9fc15a"}
Jul 15 15:54:54.217732 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:54.217717    2564 scope.go:117] "RemoveContainer" containerID="e7fe9d665e4a8a64de4d0febfaa5fb01eb378ce0bac5af701882b64e9e9fc15a"
Jul 15 15:54:54.218667 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:54.218641    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 15:54:54.218720 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:54.218711    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 15:54:54.218756 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:54.218747    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 15:54:55.223943 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:55.223905    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7" event={"ID":"e4092b22-a4fd-46b4-a177-086b0a8da544","Type":"ContainerStarted","Data":"ea64c4db56bea6a63c16d0140b8d12f98e9be30541a351a6a0f0406ba835524a"}
Jul 15 15:54:55.423737 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:55.423701    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7"
Jul 15 15:54:55.423938 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:55.423916    2564 patch_prober.go:28] interesting pod/e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 15 15:54:55.423987 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:55.423965    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7" podUID="e4092b22-a4fd-46b4-a177-086b0a8da544" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 15 15:54:56.424084 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:56.424051    2564 patch_prober.go:28] interesting pod/e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 15 15:54:56.424477 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:56.424100    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7" podUID="e4092b22-a4fd-46b4-a177-086b0a8da544" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 15 15:54:57.423310 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:57.423273    2564 patch_prober.go:28] interesting pod/e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 15 15:54:57.423462 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:57.423337    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7" podUID="e4092b22-a4fd-46b4-a177-086b0a8da544" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 15 15:54:58.423744 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:58.423706    2564 patch_prober.go:28] interesting pod/e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 15 15:54:58.424243 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:58.423763    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7" podUID="e4092b22-a4fd-46b4-a177-086b0a8da544" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 15 15:54:59.427895 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:59.427863    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7"
Jul 15 15:54:59.428300 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:59.428191    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7"
Jul 15 15:54:59.428850 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:54:59.428829    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7"
Jul 15 15:55:43.218105 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:55:43.218069    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:55:47.826180 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:55:47.826141    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:55:54.339256 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:55:54.339167    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:55:54.437159 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:55:54.437119    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:55:58.007199 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:55:58.007166    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7"]
Jul 15 15:55:58.007625 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:55:58.007344    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7" podUID="e4092b22-a4fd-46b4-a177-086b0a8da544" containerName="istio-proxy" containerID="cri-o://ea64c4db56bea6a63c16d0140b8d12f98e9be30541a351a6a0f0406ba835524a" gracePeriod=30
Jul 15 15:55:58.041822 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:55:58.041785    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:55:58.633470 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:55:58.633439    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:55:59.109268 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:55:59.109235    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:55:59.208523 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:55:59.208495    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:55:59.430646 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:55:59.430570    2564 patch_prober.go:28] interesting pod/e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 15 15:55:59.430777 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:55:59.430640    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7" podUID="e4092b22-a4fd-46b4-a177-086b0a8da544" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 15:56:00.288766 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:56:00.288723    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:56:03.255171 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:56:03.255147    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7"
Jul 15 15:56:03.346290 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:56:03.346267    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4092b22-a4fd-46b4-a177-086b0a8da544-credential-socket\") pod \"e4092b22-a4fd-46b4-a177-086b0a8da544\" (UID: \"e4092b22-a4fd-46b4-a177-086b0a8da544\") "
Jul 15 15:56:03.346390 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:56:03.346320    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e4092b22-a4fd-46b4-a177-086b0a8da544-istiod-ca-cert\") pod \"e4092b22-a4fd-46b4-a177-086b0a8da544\" (UID: \"e4092b22-a4fd-46b4-a177-086b0a8da544\") "
Jul 15 15:56:03.346390 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:56:03.346341    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e4092b22-a4fd-46b4-a177-086b0a8da544-istio-envoy\") pod \"e4092b22-a4fd-46b4-a177-086b0a8da544\" (UID: \"e4092b22-a4fd-46b4-a177-086b0a8da544\") "
Jul 15 15:56:03.346390 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:56:03.346368    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e4092b22-a4fd-46b4-a177-086b0a8da544-istio-podinfo\") pod \"e4092b22-a4fd-46b4-a177-086b0a8da544\" (UID: \"e4092b22-a4fd-46b4-a177-086b0a8da544\") "
Jul 15 15:56:03.346390 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:56:03.346386    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e4092b22-a4fd-46b4-a177-086b0a8da544-istio-data\") pod \"e4092b22-a4fd-46b4-a177-086b0a8da544\" (UID: \"e4092b22-a4fd-46b4-a177-086b0a8da544\") "
Jul 15 15:56:03.346555 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:56:03.346419    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e4092b22-a4fd-46b4-a177-086b0a8da544-workload-certs\") pod \"e4092b22-a4fd-46b4-a177-086b0a8da544\" (UID: \"e4092b22-a4fd-46b4-a177-086b0a8da544\") "
Jul 15 15:56:03.346555 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:56:03.346447    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e4092b22-a4fd-46b4-a177-086b0a8da544-istio-token\") pod \"e4092b22-a4fd-46b4-a177-086b0a8da544\" (UID: \"e4092b22-a4fd-46b4-a177-086b0a8da544\") "
Jul 15 15:56:03.346555 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:56:03.346490    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4092b22-a4fd-46b4-a177-086b0a8da544-workload-socket\") pod \"e4092b22-a4fd-46b4-a177-086b0a8da544\" (UID: \"e4092b22-a4fd-46b4-a177-086b0a8da544\") "
Jul 15 15:56:03.346555 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:56:03.346529    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vqn4h\" (UniqueName: \"kubernetes.io/projected/e4092b22-a4fd-46b4-a177-086b0a8da544-kube-api-access-vqn4h\") pod \"e4092b22-a4fd-46b4-a177-086b0a8da544\" (UID: \"e4092b22-a4fd-46b4-a177-086b0a8da544\") "
Jul 15 15:56:03.346555 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:56:03.346528    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4092b22-a4fd-46b4-a177-086b0a8da544-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e4092b22-a4fd-46b4-a177-086b0a8da544" (UID: "e4092b22-a4fd-46b4-a177-086b0a8da544"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:56:03.346894 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:56:03.346780    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4092b22-a4fd-46b4-a177-086b0a8da544-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e4092b22-a4fd-46b4-a177-086b0a8da544" (UID: "e4092b22-a4fd-46b4-a177-086b0a8da544"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 15:56:03.346894 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:56:03.346834    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4092b22-a4fd-46b4-a177-086b0a8da544-credential-socket\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 15:56:03.347002 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:56:03.346914    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4092b22-a4fd-46b4-a177-086b0a8da544-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e4092b22-a4fd-46b4-a177-086b0a8da544" (UID: "e4092b22-a4fd-46b4-a177-086b0a8da544"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:56:03.347002 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:56:03.346978    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4092b22-a4fd-46b4-a177-086b0a8da544-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e4092b22-a4fd-46b4-a177-086b0a8da544" (UID: "e4092b22-a4fd-46b4-a177-086b0a8da544"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:56:03.347626 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:56:03.347593    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4092b22-a4fd-46b4-a177-086b0a8da544-istio-data" (OuterVolumeSpecName: "istio-data") pod "e4092b22-a4fd-46b4-a177-086b0a8da544" (UID: "e4092b22-a4fd-46b4-a177-086b0a8da544"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:56:03.348675 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:56:03.348642    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e4092b22-a4fd-46b4-a177-086b0a8da544-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e4092b22-a4fd-46b4-a177-086b0a8da544" (UID: "e4092b22-a4fd-46b4-a177-086b0a8da544"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 15:56:03.348773 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:56:03.348687    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4092b22-a4fd-46b4-a177-086b0a8da544-kube-api-access-vqn4h" (OuterVolumeSpecName: "kube-api-access-vqn4h") pod "e4092b22-a4fd-46b4-a177-086b0a8da544" (UID: "e4092b22-a4fd-46b4-a177-086b0a8da544"). InnerVolumeSpecName "kube-api-access-vqn4h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:56:03.348947 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:56:03.348919    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4092b22-a4fd-46b4-a177-086b0a8da544-istio-token" (OuterVolumeSpecName: "istio-token") pod "e4092b22-a4fd-46b4-a177-086b0a8da544" (UID: "e4092b22-a4fd-46b4-a177-086b0a8da544"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:56:03.348947 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:56:03.348917    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4092b22-a4fd-46b4-a177-086b0a8da544-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e4092b22-a4fd-46b4-a177-086b0a8da544" (UID: "e4092b22-a4fd-46b4-a177-086b0a8da544"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:56:03.447765 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:56:03.447733    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e4092b22-a4fd-46b4-a177-086b0a8da544-istio-podinfo\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 15:56:03.447765 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:56:03.447759    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e4092b22-a4fd-46b4-a177-086b0a8da544-istio-data\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 15:56:03.447943 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:56:03.447772    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e4092b22-a4fd-46b4-a177-086b0a8da544-workload-certs\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 15:56:03.447943 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:56:03.447783    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e4092b22-a4fd-46b4-a177-086b0a8da544-istio-token\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 15:56:03.447943 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:56:03.447795    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4092b22-a4fd-46b4-a177-086b0a8da544-workload-socket\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 15:56:03.447943 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:56:03.447808    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vqn4h\" (UniqueName: \"kubernetes.io/projected/e4092b22-a4fd-46b4-a177-086b0a8da544-kube-api-access-vqn4h\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 15:56:03.447943 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:56:03.447820    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e4092b22-a4fd-46b4-a177-086b0a8da544-istiod-ca-cert\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 15:56:03.447943 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:56:03.447832    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e4092b22-a4fd-46b4-a177-086b0a8da544-istio-envoy\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 15:56:03.538350 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:56:03.538317    2564 generic.go:356] "Generic (PLEG): container finished" podID="e4092b22-a4fd-46b4-a177-086b0a8da544" containerID="ea64c4db56bea6a63c16d0140b8d12f98e9be30541a351a6a0f0406ba835524a" exitCode=0
Jul 15 15:56:03.538550 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:56:03.538389    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7"
Jul 15 15:56:03.538550 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:56:03.538392    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7" event={"ID":"e4092b22-a4fd-46b4-a177-086b0a8da544","Type":"ContainerDied","Data":"ea64c4db56bea6a63c16d0140b8d12f98e9be30541a351a6a0f0406ba835524a"}
Jul 15 15:56:03.538550 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:56:03.538445    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7" event={"ID":"e4092b22-a4fd-46b4-a177-086b0a8da544","Type":"ContainerDied","Data":"05b6281a3ddf003c185c559a7c801de6c4dea7a379832e7386cd02308027ec1d"}
Jul 15 15:56:03.538550 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:56:03.538466    2564 scope.go:117] "RemoveContainer" containerID="ea64c4db56bea6a63c16d0140b8d12f98e9be30541a351a6a0f0406ba835524a"
Jul 15 15:56:03.547789 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:56:03.547774    2564 scope.go:117] "RemoveContainer" containerID="e7fe9d665e4a8a64de4d0febfaa5fb01eb378ce0bac5af701882b64e9e9fc15a"
Jul 15 15:56:03.557695 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:56:03.557675    2564 scope.go:117] "RemoveContainer" containerID="ea64c4db56bea6a63c16d0140b8d12f98e9be30541a351a6a0f0406ba835524a"
Jul 15 15:56:03.557933 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:56:03.557916    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea64c4db56bea6a63c16d0140b8d12f98e9be30541a351a6a0f0406ba835524a\": container with ID starting with ea64c4db56bea6a63c16d0140b8d12f98e9be30541a351a6a0f0406ba835524a not found: ID does not exist" containerID="ea64c4db56bea6a63c16d0140b8d12f98e9be30541a351a6a0f0406ba835524a"
Jul 15 15:56:03.557977 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:56:03.557943    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea64c4db56bea6a63c16d0140b8d12f98e9be30541a351a6a0f0406ba835524a"} err="failed to get container status \"ea64c4db56bea6a63c16d0140b8d12f98e9be30541a351a6a0f0406ba835524a\": rpc error: code = NotFound desc = could not find container \"ea64c4db56bea6a63c16d0140b8d12f98e9be30541a351a6a0f0406ba835524a\": container with ID starting with ea64c4db56bea6a63c16d0140b8d12f98e9be30541a351a6a0f0406ba835524a not found: ID does not exist"
Jul 15 15:56:03.557977 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:56:03.557959    2564 scope.go:117] "RemoveContainer" containerID="e7fe9d665e4a8a64de4d0febfaa5fb01eb378ce0bac5af701882b64e9e9fc15a"
Jul 15 15:56:03.558196 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:56:03.558175    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7fe9d665e4a8a64de4d0febfaa5fb01eb378ce0bac5af701882b64e9e9fc15a\": container with ID starting with e7fe9d665e4a8a64de4d0febfaa5fb01eb378ce0bac5af701882b64e9e9fc15a not found: ID does not exist" containerID="e7fe9d665e4a8a64de4d0febfaa5fb01eb378ce0bac5af701882b64e9e9fc15a"
Jul 15 15:56:03.558250 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:56:03.558205    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7fe9d665e4a8a64de4d0febfaa5fb01eb378ce0bac5af701882b64e9e9fc15a"} err="failed to get container status \"e7fe9d665e4a8a64de4d0febfaa5fb01eb378ce0bac5af701882b64e9e9fc15a\": rpc error: code = NotFound desc = could not find container \"e7fe9d665e4a8a64de4d0febfaa5fb01eb378ce0bac5af701882b64e9e9fc15a\": container with ID starting with e7fe9d665e4a8a64de4d0febfaa5fb01eb378ce0bac5af701882b64e9e9fc15a not found: ID does not exist"
Jul 15 15:56:03.563393 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:56:03.563374    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7"]
Jul 15 15:56:03.574809 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:56:03.574762    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-4d69cf00-openshift-default-5f574b6cff-snmb7"]
Jul 15 15:56:04.230579 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:56:04.230538    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4092b22-a4fd-46b4-a177-086b0a8da544" path="/var/lib/kubelet/pods/e4092b22-a4fd-46b4-a177-086b0a8da544/volumes"
Jul 15 15:56:05.008479 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:56:05.008447    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:56:06.545749 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:56:06.545707    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:56:06.648224 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:56:06.648187    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:56:06.749345 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:56:06.749309    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:56:06.847398 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:56:06.847328    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:56:07.256511 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:56:07.256418    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:56:28.781750 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:56:28.781709    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:56:33.288842 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:56:33.288787    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:56:39.209291 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:56:39.209251    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:56:39.326624 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:56:39.326596    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:56:39.432444 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:56:39.432419    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:56:56.188179 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:56:56.188145    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:57:01.413622 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:01.413513    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:57:01.539744 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:01.539697    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:57:01.639336 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:01.639299    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:57:12.181396 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:12.181361    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:57:12.968108 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:12.968062    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:57:19.017721 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:19.017675    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:57:19.149058 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:19.148996    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:57:19.242061 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:19.241998    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:57:19.343920 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:19.343840    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:57:20.155002 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:20.154960    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:57:20.263861 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:20.263829    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:57:20.356806 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:20.356777    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:57:22.024075 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:22.023979    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:57:28.042681 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:28.042650    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:57:28.650049 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:28.649985    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:57:28.828905 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:28.828863    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:57:35.118000 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:35.117964    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:57:35.218291 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:35.218254    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:57:35.329840 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:35.329811    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:57:35.643416 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:35.643390    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-7258970a-openshift-default-7cd87566c5-hg9rf"]
Jul 15 15:57:35.643874 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:35.643855    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4092b22-a4fd-46b4-a177-086b0a8da544" containerName="istio-proxy"
Jul 15 15:57:35.643940 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:35.643878    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4092b22-a4fd-46b4-a177-086b0a8da544" containerName="istio-proxy"
Jul 15 15:57:35.643940 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:35.643899    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e314fafc-be79-4f59-a2c5-de99de7eb6fc" containerName="istio-proxy"
Jul 15 15:57:35.643940 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:35.643907    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e314fafc-be79-4f59-a2c5-de99de7eb6fc" containerName="istio-proxy"
Jul 15 15:57:35.643940 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:35.643930    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e314fafc-be79-4f59-a2c5-de99de7eb6fc" containerName="istio-proxy"
Jul 15 15:57:35.643940 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:35.643938    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e314fafc-be79-4f59-a2c5-de99de7eb6fc" containerName="istio-proxy"
Jul 15 15:57:35.644232 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:35.644081    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4092b22-a4fd-46b4-a177-086b0a8da544" containerName="istio-proxy"
Jul 15 15:57:35.644232 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:35.644092    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4092b22-a4fd-46b4-a177-086b0a8da544" containerName="istio-proxy"
Jul 15 15:57:35.644232 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:35.644099    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e314fafc-be79-4f59-a2c5-de99de7eb6fc" containerName="istio-proxy"
Jul 15 15:57:35.644232 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:35.644105    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e314fafc-be79-4f59-a2c5-de99de7eb6fc" containerName="istio-proxy"
Jul 15 15:57:35.646908 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:35.646889    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-7258970a-openshift-default-7cd87566c5-hg9rf"
Jul 15 15:57:35.650034 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:35.649995    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-7258970a-openshift-default-dockercfg-s74hx\""
Jul 15 15:57:35.671956 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:35.671934    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-7258970a-openshift-default-7cd87566c5-hg9rf"]
Jul 15 15:57:35.678418 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:35.678394    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:57:35.698374 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:35.698352    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1109ce0d-9693-4224-867c-90092c9216be-workload-certs\") pod \"e2e-mt-7258970a-openshift-default-7cd87566c5-hg9rf\" (UID: \"1109ce0d-9693-4224-867c-90092c9216be\") " pod="openshift-ingress/e2e-mt-7258970a-openshift-default-7cd87566c5-hg9rf"
Jul 15 15:57:35.698457 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:35.698391    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1109ce0d-9693-4224-867c-90092c9216be-istio-podinfo\") pod \"e2e-mt-7258970a-openshift-default-7cd87566c5-hg9rf\" (UID: \"1109ce0d-9693-4224-867c-90092c9216be\") " pod="openshift-ingress/e2e-mt-7258970a-openshift-default-7cd87566c5-hg9rf"
Jul 15 15:57:35.698457 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:35.698441    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1109ce0d-9693-4224-867c-90092c9216be-istio-data\") pod \"e2e-mt-7258970a-openshift-default-7cd87566c5-hg9rf\" (UID: \"1109ce0d-9693-4224-867c-90092c9216be\") " pod="openshift-ingress/e2e-mt-7258970a-openshift-default-7cd87566c5-hg9rf"
Jul 15 15:57:35.698529 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:35.698470    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9xmk\" (UniqueName: \"kubernetes.io/projected/1109ce0d-9693-4224-867c-90092c9216be-kube-api-access-k9xmk\") pod \"e2e-mt-7258970a-openshift-default-7cd87566c5-hg9rf\" (UID: \"1109ce0d-9693-4224-867c-90092c9216be\") " pod="openshift-ingress/e2e-mt-7258970a-openshift-default-7cd87566c5-hg9rf"
Jul 15 15:57:35.698529 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:35.698506    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1109ce0d-9693-4224-867c-90092c9216be-istio-token\") pod \"e2e-mt-7258970a-openshift-default-7cd87566c5-hg9rf\" (UID: \"1109ce0d-9693-4224-867c-90092c9216be\") " pod="openshift-ingress/e2e-mt-7258970a-openshift-default-7cd87566c5-hg9rf"
Jul 15 15:57:35.698597 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:35.698555    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1109ce0d-9693-4224-867c-90092c9216be-istiod-ca-cert\") pod \"e2e-mt-7258970a-openshift-default-7cd87566c5-hg9rf\" (UID: \"1109ce0d-9693-4224-867c-90092c9216be\") " pod="openshift-ingress/e2e-mt-7258970a-openshift-default-7cd87566c5-hg9rf"
Jul 15 15:57:35.698597 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:35.698577    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1109ce0d-9693-4224-867c-90092c9216be-istio-envoy\") pod \"e2e-mt-7258970a-openshift-default-7cd87566c5-hg9rf\" (UID: \"1109ce0d-9693-4224-867c-90092c9216be\") " pod="openshift-ingress/e2e-mt-7258970a-openshift-default-7cd87566c5-hg9rf"
Jul 15 15:57:35.698670 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:35.698612    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1109ce0d-9693-4224-867c-90092c9216be-workload-socket\") pod \"e2e-mt-7258970a-openshift-default-7cd87566c5-hg9rf\" (UID: \"1109ce0d-9693-4224-867c-90092c9216be\") " pod="openshift-ingress/e2e-mt-7258970a-openshift-default-7cd87566c5-hg9rf"
Jul 15 15:57:35.698670 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:35.698657    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1109ce0d-9693-4224-867c-90092c9216be-credential-socket\") pod \"e2e-mt-7258970a-openshift-default-7cd87566c5-hg9rf\" (UID: \"1109ce0d-9693-4224-867c-90092c9216be\") " pod="openshift-ingress/e2e-mt-7258970a-openshift-default-7cd87566c5-hg9rf"
Jul 15 15:57:35.799382 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:35.799321    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1109ce0d-9693-4224-867c-90092c9216be-workload-certs\") pod \"e2e-mt-7258970a-openshift-default-7cd87566c5-hg9rf\" (UID: \"1109ce0d-9693-4224-867c-90092c9216be\") " pod="openshift-ingress/e2e-mt-7258970a-openshift-default-7cd87566c5-hg9rf"
Jul 15 15:57:35.799382 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:35.799356    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1109ce0d-9693-4224-867c-90092c9216be-istio-podinfo\") pod \"e2e-mt-7258970a-openshift-default-7cd87566c5-hg9rf\" (UID: \"1109ce0d-9693-4224-867c-90092c9216be\") " pod="openshift-ingress/e2e-mt-7258970a-openshift-default-7cd87566c5-hg9rf"
Jul 15 15:57:35.799382 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:35.799378    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1109ce0d-9693-4224-867c-90092c9216be-istio-data\") pod \"e2e-mt-7258970a-openshift-default-7cd87566c5-hg9rf\" (UID: \"1109ce0d-9693-4224-867c-90092c9216be\") " pod="openshift-ingress/e2e-mt-7258970a-openshift-default-7cd87566c5-hg9rf"
Jul 15 15:57:35.799651 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:35.799396    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9xmk\" (UniqueName: \"kubernetes.io/projected/1109ce0d-9693-4224-867c-90092c9216be-kube-api-access-k9xmk\") pod \"e2e-mt-7258970a-openshift-default-7cd87566c5-hg9rf\" (UID: \"1109ce0d-9693-4224-867c-90092c9216be\") " pod="openshift-ingress/e2e-mt-7258970a-openshift-default-7cd87566c5-hg9rf"
Jul 15 15:57:35.799651 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:35.799419    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1109ce0d-9693-4224-867c-90092c9216be-istio-token\") pod \"e2e-mt-7258970a-openshift-default-7cd87566c5-hg9rf\" (UID: \"1109ce0d-9693-4224-867c-90092c9216be\") " pod="openshift-ingress/e2e-mt-7258970a-openshift-default-7cd87566c5-hg9rf"
Jul 15 15:57:35.799651 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:35.799476    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1109ce0d-9693-4224-867c-90092c9216be-istiod-ca-cert\") pod \"e2e-mt-7258970a-openshift-default-7cd87566c5-hg9rf\" (UID: \"1109ce0d-9693-4224-867c-90092c9216be\") " pod="openshift-ingress/e2e-mt-7258970a-openshift-default-7cd87566c5-hg9rf"
Jul 15 15:57:35.799651 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:35.799511    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1109ce0d-9693-4224-867c-90092c9216be-istio-envoy\") pod \"e2e-mt-7258970a-openshift-default-7cd87566c5-hg9rf\" (UID: \"1109ce0d-9693-4224-867c-90092c9216be\") " pod="openshift-ingress/e2e-mt-7258970a-openshift-default-7cd87566c5-hg9rf"
Jul 15 15:57:35.799651 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:35.799564    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1109ce0d-9693-4224-867c-90092c9216be-workload-socket\") pod \"e2e-mt-7258970a-openshift-default-7cd87566c5-hg9rf\" (UID: \"1109ce0d-9693-4224-867c-90092c9216be\") " pod="openshift-ingress/e2e-mt-7258970a-openshift-default-7cd87566c5-hg9rf"
Jul 15 15:57:35.799651 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:35.799595    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1109ce0d-9693-4224-867c-90092c9216be-credential-socket\") pod \"e2e-mt-7258970a-openshift-default-7cd87566c5-hg9rf\" (UID: \"1109ce0d-9693-4224-867c-90092c9216be\") " pod="openshift-ingress/e2e-mt-7258970a-openshift-default-7cd87566c5-hg9rf"
Jul 15 15:57:35.799971 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:35.799747    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1109ce0d-9693-4224-867c-90092c9216be-workload-certs\") pod \"e2e-mt-7258970a-openshift-default-7cd87566c5-hg9rf\" (UID: \"1109ce0d-9693-4224-867c-90092c9216be\") " pod="openshift-ingress/e2e-mt-7258970a-openshift-default-7cd87566c5-hg9rf"
Jul 15 15:57:35.799971 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:35.799919    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1109ce0d-9693-4224-867c-90092c9216be-credential-socket\") pod \"e2e-mt-7258970a-openshift-default-7cd87566c5-hg9rf\" (UID: \"1109ce0d-9693-4224-867c-90092c9216be\") " pod="openshift-ingress/e2e-mt-7258970a-openshift-default-7cd87566c5-hg9rf"
Jul 15 15:57:35.800105 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:35.800083    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1109ce0d-9693-4224-867c-90092c9216be-istio-data\") pod \"e2e-mt-7258970a-openshift-default-7cd87566c5-hg9rf\" (UID: \"1109ce0d-9693-4224-867c-90092c9216be\") " pod="openshift-ingress/e2e-mt-7258970a-openshift-default-7cd87566c5-hg9rf"
Jul 15 15:57:35.800180 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:35.800159    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1109ce0d-9693-4224-867c-90092c9216be-workload-socket\") pod \"e2e-mt-7258970a-openshift-default-7cd87566c5-hg9rf\" (UID: \"1109ce0d-9693-4224-867c-90092c9216be\") " pod="openshift-ingress/e2e-mt-7258970a-openshift-default-7cd87566c5-hg9rf"
Jul 15 15:57:35.800536 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:35.800509    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1109ce0d-9693-4224-867c-90092c9216be-istiod-ca-cert\") pod \"e2e-mt-7258970a-openshift-default-7cd87566c5-hg9rf\" (UID: \"1109ce0d-9693-4224-867c-90092c9216be\") " pod="openshift-ingress/e2e-mt-7258970a-openshift-default-7cd87566c5-hg9rf"
Jul 15 15:57:35.801923 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:35.801901    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1109ce0d-9693-4224-867c-90092c9216be-istio-envoy\") pod \"e2e-mt-7258970a-openshift-default-7cd87566c5-hg9rf\" (UID: \"1109ce0d-9693-4224-867c-90092c9216be\") " pod="openshift-ingress/e2e-mt-7258970a-openshift-default-7cd87566c5-hg9rf"
Jul 15 15:57:35.802054 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:35.801985    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1109ce0d-9693-4224-867c-90092c9216be-istio-podinfo\") pod \"e2e-mt-7258970a-openshift-default-7cd87566c5-hg9rf\" (UID: \"1109ce0d-9693-4224-867c-90092c9216be\") " pod="openshift-ingress/e2e-mt-7258970a-openshift-default-7cd87566c5-hg9rf"
Jul 15 15:57:35.808609 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:35.808588    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9xmk\" (UniqueName: \"kubernetes.io/projected/1109ce0d-9693-4224-867c-90092c9216be-kube-api-access-k9xmk\") pod \"e2e-mt-7258970a-openshift-default-7cd87566c5-hg9rf\" (UID: \"1109ce0d-9693-4224-867c-90092c9216be\") " pod="openshift-ingress/e2e-mt-7258970a-openshift-default-7cd87566c5-hg9rf"
Jul 15 15:57:35.808737 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:35.808719    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1109ce0d-9693-4224-867c-90092c9216be-istio-token\") pod \"e2e-mt-7258970a-openshift-default-7cd87566c5-hg9rf\" (UID: \"1109ce0d-9693-4224-867c-90092c9216be\") " pod="openshift-ingress/e2e-mt-7258970a-openshift-default-7cd87566c5-hg9rf"
Jul 15 15:57:35.958856 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:35.958768    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-7258970a-openshift-default-7cd87566c5-hg9rf"
Jul 15 15:57:36.114168 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:36.114140    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-7258970a-openshift-default-7cd87566c5-hg9rf"]
Jul 15 15:57:36.116695 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:57:36.116667    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1109ce0d_9693_4224_867c_90092c9216be.slice/crio-ed96e3456d56d546325d4d2b3baf15e523843a03f238ef4f4af196cc0e2e73eb WatchSource:0}: Error finding container ed96e3456d56d546325d4d2b3baf15e523843a03f238ef4f4af196cc0e2e73eb: Status 404 returned error can't find the container with id ed96e3456d56d546325d4d2b3baf15e523843a03f238ef4f4af196cc0e2e73eb
Jul 15 15:57:36.119071 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:36.119032    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 15:57:36.119432 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:36.119111    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 15:57:36.119432 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:36.119140    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 15:57:36.144339 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:36.144314    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:57:36.967980 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:36.967946    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7258970a-openshift-default-7cd87566c5-hg9rf" event={"ID":"1109ce0d-9693-4224-867c-90092c9216be","Type":"ContainerStarted","Data":"c0f3717bbe832a357cd5ad0336cfa281eec24291a64d6eb8bc3751f28b756777"}
Jul 15 15:57:36.968166 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:36.967998    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7258970a-openshift-default-7cd87566c5-hg9rf" event={"ID":"1109ce0d-9693-4224-867c-90092c9216be","Type":"ContainerStarted","Data":"ed96e3456d56d546325d4d2b3baf15e523843a03f238ef4f4af196cc0e2e73eb"}
Jul 15 15:57:37.959108 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:37.959071    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-7258970a-openshift-default-7cd87566c5-hg9rf"
Jul 15 15:57:37.963907 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:37.963883    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-7258970a-openshift-default-7cd87566c5-hg9rf"
Jul 15 15:57:37.972235 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:37.972215    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-7258970a-openshift-default-7cd87566c5-hg9rf"
Jul 15 15:57:37.972953 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:37.972937    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-7258970a-openshift-default-7cd87566c5-hg9rf"
Jul 15 15:57:37.986620 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:37.986577    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-7258970a-openshift-default-7cd87566c5-hg9rf" podStartSLOduration=2.986563943 podStartE2EDuration="2.986563943s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:57:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:57:37.002034698 +0000 UTC m=+1987.347937882" watchObservedRunningTime="2026-07-15 15:57:37.986563943 +0000 UTC m=+1988.332467135"
Jul 15 15:57:38.982094 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:38.982048    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:57:39.093604 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:39.093570    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:57:39.180774 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:39.180740    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:57:39.391573 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:39.391537    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:57:39.739687 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:39.739598    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:57:39.844114 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:39.844080    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:57:43.481429 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:43.481387    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:57:44.192168 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:44.192134    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:57:44.297025 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:44.296976    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:57:44.597163 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:44.597132    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:57:50.782966 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:50.782924    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:57:50.883422 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:50.883384    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:57:52.974187 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:52.974153    2564 patch_prober.go:28] interesting pod/e2e-mt-7258970a-openshift-default-7cd87566c5-hg9rf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 15 15:57:52.974588 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:52.974212    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-7258970a-openshift-default-7cd87566c5-hg9rf" podUID="1109ce0d-9693-4224-867c-90092c9216be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 15 15:57:53.047980 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:53.047952    2564 generic.go:356] "Generic (PLEG): container finished" podID="1109ce0d-9693-4224-867c-90092c9216be" containerID="c0f3717bbe832a357cd5ad0336cfa281eec24291a64d6eb8bc3751f28b756777" exitCode=0
Jul 15 15:57:53.048103 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:53.048029    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7258970a-openshift-default-7cd87566c5-hg9rf" event={"ID":"1109ce0d-9693-4224-867c-90092c9216be","Type":"ContainerDied","Data":"c0f3717bbe832a357cd5ad0336cfa281eec24291a64d6eb8bc3751f28b756777"}
Jul 15 15:57:53.048364 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:53.048352    2564 scope.go:117] "RemoveContainer" containerID="c0f3717bbe832a357cd5ad0336cfa281eec24291a64d6eb8bc3751f28b756777"
Jul 15 15:57:53.049260 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:53.049234    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 15:57:53.049357 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:53.049305    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 15:57:53.049357 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:53.049336    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 15:57:54.054367 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:54.054328    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7258970a-openshift-default-7cd87566c5-hg9rf" event={"ID":"1109ce0d-9693-4224-867c-90092c9216be","Type":"ContainerStarted","Data":"67174de16378db604e07f542406335a9366ea515b1bea1c95329df35c5ff174e"}
Jul 15 15:57:54.959806 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:54.959771    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-7258970a-openshift-default-7cd87566c5-hg9rf"
Jul 15 15:57:54.960221 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:54.960139    2564 patch_prober.go:28] interesting pod/e2e-mt-7258970a-openshift-default-7cd87566c5-hg9rf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 15 15:57:54.960416 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:54.960389    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-7258970a-openshift-default-7cd87566c5-hg9rf" podUID="1109ce0d-9693-4224-867c-90092c9216be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 15 15:57:55.959436 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:55.959397    2564 patch_prober.go:28] interesting pod/e2e-mt-7258970a-openshift-default-7cd87566c5-hg9rf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 15 15:57:55.960078 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:55.960041    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-7258970a-openshift-default-7cd87566c5-hg9rf" podUID="1109ce0d-9693-4224-867c-90092c9216be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 15 15:57:56.959653 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:56.959617    2564 patch_prober.go:28] interesting pod/e2e-mt-7258970a-openshift-default-7cd87566c5-hg9rf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 15 15:57:56.960274 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:56.960242    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-7258970a-openshift-default-7cd87566c5-hg9rf" podUID="1109ce0d-9693-4224-867c-90092c9216be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 15 15:57:57.963450 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:57.963420    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-7258970a-openshift-default-7cd87566c5-hg9rf"
Jul 15 15:57:57.963824 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:57.963673    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-7258970a-openshift-default-7cd87566c5-hg9rf"
Jul 15 15:57:57.964270 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:57:57.964253    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-7258970a-openshift-default-7cd87566c5-hg9rf"
Jul 15 15:58:01.657374 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:01.657342    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:58:06.235276 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:06.235236    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:58:12.270133 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:12.270099    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:58:12.372204 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:12.372163    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:58:16.907906 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:16.907872    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-7258970a-openshift-default-7cd87566c5-hg9rf"]
Jul 15 15:58:16.908428 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:16.908113    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-7258970a-openshift-default-7cd87566c5-hg9rf" podUID="1109ce0d-9693-4224-867c-90092c9216be" containerName="istio-proxy" containerID="cri-o://67174de16378db604e07f542406335a9366ea515b1bea1c95329df35c5ff174e" gracePeriod=30
Jul 15 15:58:16.935485 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:16.935450    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:58:17.232148 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:17.232063    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:58:17.346444 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:17.346415    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:58:17.436662 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:17.436626    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:58:17.542293 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:17.542269    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:58:22.148435 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:22.148414    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-7258970a-openshift-default-7cd87566c5-hg9rf"
Jul 15 15:58:22.190849 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:22.190777    2564 generic.go:356] "Generic (PLEG): container finished" podID="1109ce0d-9693-4224-867c-90092c9216be" containerID="67174de16378db604e07f542406335a9366ea515b1bea1c95329df35c5ff174e" exitCode=0
Jul 15 15:58:22.190849 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:22.190815    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-7258970a-openshift-default-7cd87566c5-hg9rf"
Jul 15 15:58:22.191041 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:22.190870    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7258970a-openshift-default-7cd87566c5-hg9rf" event={"ID":"1109ce0d-9693-4224-867c-90092c9216be","Type":"ContainerDied","Data":"67174de16378db604e07f542406335a9366ea515b1bea1c95329df35c5ff174e"}
Jul 15 15:58:22.191041 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:22.190920    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7258970a-openshift-default-7cd87566c5-hg9rf" event={"ID":"1109ce0d-9693-4224-867c-90092c9216be","Type":"ContainerDied","Data":"ed96e3456d56d546325d4d2b3baf15e523843a03f238ef4f4af196cc0e2e73eb"}
Jul 15 15:58:22.191041 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:22.190943    2564 scope.go:117] "RemoveContainer" containerID="67174de16378db604e07f542406335a9366ea515b1bea1c95329df35c5ff174e"
Jul 15 15:58:22.199467 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:22.199453    2564 scope.go:117] "RemoveContainer" containerID="c0f3717bbe832a357cd5ad0336cfa281eec24291a64d6eb8bc3751f28b756777"
Jul 15 15:58:22.206504 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:22.206484    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1109ce0d-9693-4224-867c-90092c9216be-istio-envoy\") pod \"1109ce0d-9693-4224-867c-90092c9216be\" (UID: \"1109ce0d-9693-4224-867c-90092c9216be\") "
Jul 15 15:58:22.206616 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:22.206523    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1109ce0d-9693-4224-867c-90092c9216be-workload-certs\") pod \"1109ce0d-9693-4224-867c-90092c9216be\" (UID: \"1109ce0d-9693-4224-867c-90092c9216be\") "
Jul 15 15:58:22.206616 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:22.206544    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1109ce0d-9693-4224-867c-90092c9216be-istio-token\") pod \"1109ce0d-9693-4224-867c-90092c9216be\" (UID: \"1109ce0d-9693-4224-867c-90092c9216be\") "
Jul 15 15:58:22.206616 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:22.206562    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1109ce0d-9693-4224-867c-90092c9216be-credential-socket\") pod \"1109ce0d-9693-4224-867c-90092c9216be\" (UID: \"1109ce0d-9693-4224-867c-90092c9216be\") "
Jul 15 15:58:22.206783 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:22.206620    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1109ce0d-9693-4224-867c-90092c9216be-istiod-ca-cert\") pod \"1109ce0d-9693-4224-867c-90092c9216be\" (UID: \"1109ce0d-9693-4224-867c-90092c9216be\") "
Jul 15 15:58:22.206783 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:22.206674    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1109ce0d-9693-4224-867c-90092c9216be-istio-data\") pod \"1109ce0d-9693-4224-867c-90092c9216be\" (UID: \"1109ce0d-9693-4224-867c-90092c9216be\") "
Jul 15 15:58:22.206783 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:22.206728    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1109ce0d-9693-4224-867c-90092c9216be-istio-podinfo\") pod \"1109ce0d-9693-4224-867c-90092c9216be\" (UID: \"1109ce0d-9693-4224-867c-90092c9216be\") "
Jul 15 15:58:22.206783 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:22.206750    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k9xmk\" (UniqueName: \"kubernetes.io/projected/1109ce0d-9693-4224-867c-90092c9216be-kube-api-access-k9xmk\") pod \"1109ce0d-9693-4224-867c-90092c9216be\" (UID: \"1109ce0d-9693-4224-867c-90092c9216be\") "
Jul 15 15:58:22.207045 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:22.206797    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1109ce0d-9693-4224-867c-90092c9216be-workload-socket\") pod \"1109ce0d-9693-4224-867c-90092c9216be\" (UID: \"1109ce0d-9693-4224-867c-90092c9216be\") "
Jul 15 15:58:22.207045 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:22.206876    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1109ce0d-9693-4224-867c-90092c9216be-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1109ce0d-9693-4224-867c-90092c9216be" (UID: "1109ce0d-9693-4224-867c-90092c9216be"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:58:22.207162 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:22.207133    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1109ce0d-9693-4224-867c-90092c9216be-credential-socket\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 15:58:22.207620 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:22.207302    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1109ce0d-9693-4224-867c-90092c9216be-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1109ce0d-9693-4224-867c-90092c9216be" (UID: "1109ce0d-9693-4224-867c-90092c9216be"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:58:22.207620 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:22.207366    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1109ce0d-9693-4224-867c-90092c9216be-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1109ce0d-9693-4224-867c-90092c9216be" (UID: "1109ce0d-9693-4224-867c-90092c9216be"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:58:22.207620 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:22.207400    2564 scope.go:117] "RemoveContainer" containerID="67174de16378db604e07f542406335a9366ea515b1bea1c95329df35c5ff174e"
Jul 15 15:58:22.207620 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:22.207603    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1109ce0d-9693-4224-867c-90092c9216be-istio-data" (OuterVolumeSpecName: "istio-data") pod "1109ce0d-9693-4224-867c-90092c9216be" (UID: "1109ce0d-9693-4224-867c-90092c9216be"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:58:22.207877 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:22.207663    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1109ce0d-9693-4224-867c-90092c9216be-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1109ce0d-9693-4224-867c-90092c9216be" (UID: "1109ce0d-9693-4224-867c-90092c9216be"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 15:58:22.207877 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:58:22.207755    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67174de16378db604e07f542406335a9366ea515b1bea1c95329df35c5ff174e\": container with ID starting with 67174de16378db604e07f542406335a9366ea515b1bea1c95329df35c5ff174e not found: ID does not exist" containerID="67174de16378db604e07f542406335a9366ea515b1bea1c95329df35c5ff174e"
Jul 15 15:58:22.207877 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:22.207790    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67174de16378db604e07f542406335a9366ea515b1bea1c95329df35c5ff174e"} err="failed to get container status \"67174de16378db604e07f542406335a9366ea515b1bea1c95329df35c5ff174e\": rpc error: code = NotFound desc = could not find container \"67174de16378db604e07f542406335a9366ea515b1bea1c95329df35c5ff174e\": container with ID starting with 67174de16378db604e07f542406335a9366ea515b1bea1c95329df35c5ff174e not found: ID does not exist"
Jul 15 15:58:22.207877 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:22.207815    2564 scope.go:117] "RemoveContainer" containerID="c0f3717bbe832a357cd5ad0336cfa281eec24291a64d6eb8bc3751f28b756777"
Jul 15 15:58:22.208212 ip-10-0-138-107 kubenswrapper[2564]: E0715 15:58:22.208176    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0f3717bbe832a357cd5ad0336cfa281eec24291a64d6eb8bc3751f28b756777\": container with ID starting with c0f3717bbe832a357cd5ad0336cfa281eec24291a64d6eb8bc3751f28b756777 not found: ID does not exist" containerID="c0f3717bbe832a357cd5ad0336cfa281eec24291a64d6eb8bc3751f28b756777"
Jul 15 15:58:22.208265 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:22.208204    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0f3717bbe832a357cd5ad0336cfa281eec24291a64d6eb8bc3751f28b756777"} err="failed to get container status \"c0f3717bbe832a357cd5ad0336cfa281eec24291a64d6eb8bc3751f28b756777\": rpc error: code = NotFound desc = could not find container \"c0f3717bbe832a357cd5ad0336cfa281eec24291a64d6eb8bc3751f28b756777\": container with ID starting with c0f3717bbe832a357cd5ad0336cfa281eec24291a64d6eb8bc3751f28b756777 not found: ID does not exist"
Jul 15 15:58:22.208774 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:22.208749    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1109ce0d-9693-4224-867c-90092c9216be-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1109ce0d-9693-4224-867c-90092c9216be" (UID: "1109ce0d-9693-4224-867c-90092c9216be"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:58:22.208859 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:22.208784    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1109ce0d-9693-4224-867c-90092c9216be-istio-token" (OuterVolumeSpecName: "istio-token") pod "1109ce0d-9693-4224-867c-90092c9216be" (UID: "1109ce0d-9693-4224-867c-90092c9216be"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:58:22.209302 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:22.209280    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1109ce0d-9693-4224-867c-90092c9216be-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1109ce0d-9693-4224-867c-90092c9216be" (UID: "1109ce0d-9693-4224-867c-90092c9216be"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 15:58:22.209359 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:22.209335    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1109ce0d-9693-4224-867c-90092c9216be-kube-api-access-k9xmk" (OuterVolumeSpecName: "kube-api-access-k9xmk") pod "1109ce0d-9693-4224-867c-90092c9216be" (UID: "1109ce0d-9693-4224-867c-90092c9216be"). InnerVolumeSpecName "kube-api-access-k9xmk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:58:22.308332 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:22.308307    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1109ce0d-9693-4224-867c-90092c9216be-istio-data\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 15:58:22.308332 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:22.308329    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1109ce0d-9693-4224-867c-90092c9216be-istio-podinfo\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 15:58:22.308492 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:22.308338    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k9xmk\" (UniqueName: \"kubernetes.io/projected/1109ce0d-9693-4224-867c-90092c9216be-kube-api-access-k9xmk\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 15:58:22.308492 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:22.308348    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1109ce0d-9693-4224-867c-90092c9216be-workload-socket\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 15:58:22.308492 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:22.308357    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1109ce0d-9693-4224-867c-90092c9216be-istio-envoy\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 15:58:22.308492 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:22.308365    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1109ce0d-9693-4224-867c-90092c9216be-workload-certs\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 15:58:22.308492 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:22.308372    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1109ce0d-9693-4224-867c-90092c9216be-istio-token\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 15:58:22.308492 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:22.308379    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1109ce0d-9693-4224-867c-90092c9216be-istiod-ca-cert\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 15:58:22.507501 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:22.507421    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-7258970a-openshift-default-7cd87566c5-hg9rf"]
Jul 15 15:58:22.513709 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:22.513679    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-7258970a-openshift-default-7cd87566c5-hg9rf"]
Jul 15 15:58:23.465365 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:23.465326    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:58:23.575577 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:23.575537    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:58:23.665803 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:23.665770    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:58:23.822212 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:23.822178    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:58:24.229375 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:24.229284    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1109ce0d-9693-4224-867c-90092c9216be" path="/var/lib/kubelet/pods/1109ce0d-9693-4224-867c-90092c9216be/volumes"
Jul 15 15:58:25.453915 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:25.453888    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:58:29.581236 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:29.581208    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:58:29.681453 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:29.681409    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:58:37.070104 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:37.070055    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:58:37.374582 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:37.374486    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r"]
Jul 15 15:58:37.374858 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:37.374843    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1109ce0d-9693-4224-867c-90092c9216be" containerName="istio-proxy"
Jul 15 15:58:37.374858 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:37.374856    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="1109ce0d-9693-4224-867c-90092c9216be" containerName="istio-proxy"
Jul 15 15:58:37.375000 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:37.374868    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4092b22-a4fd-46b4-a177-086b0a8da544" containerName="istio-proxy"
Jul 15 15:58:37.375000 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:37.374874    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4092b22-a4fd-46b4-a177-086b0a8da544" containerName="istio-proxy"
Jul 15 15:58:37.375000 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:37.374882    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1109ce0d-9693-4224-867c-90092c9216be" containerName="istio-proxy"
Jul 15 15:58:37.375000 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:37.374888    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="1109ce0d-9693-4224-867c-90092c9216be" containerName="istio-proxy"
Jul 15 15:58:37.375000 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:37.374947    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="1109ce0d-9693-4224-867c-90092c9216be" containerName="istio-proxy"
Jul 15 15:58:37.377743 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:37.377719    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r"
Jul 15 15:58:37.381158 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:37.381135    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-fb1842df-openshift-default-dockercfg-fg2vm\""
Jul 15 15:58:37.394527 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:37.394507    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r"]
Jul 15 15:58:37.403691 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:37.403667    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:58:37.429903 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:37.429873    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jbwg\" (UniqueName: \"kubernetes.io/projected/8522faee-cc8b-4556-b943-f82f08b80bef-kube-api-access-2jbwg\") pod \"e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r\" (UID: \"8522faee-cc8b-4556-b943-f82f08b80bef\") " pod="openshift-ingress/e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r"
Jul 15 15:58:37.430078 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:37.429917    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8522faee-cc8b-4556-b943-f82f08b80bef-istiod-ca-cert\") pod \"e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r\" (UID: \"8522faee-cc8b-4556-b943-f82f08b80bef\") " pod="openshift-ingress/e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r"
Jul 15 15:58:37.430078 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:37.430032    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8522faee-cc8b-4556-b943-f82f08b80bef-workload-socket\") pod \"e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r\" (UID: \"8522faee-cc8b-4556-b943-f82f08b80bef\") " pod="openshift-ingress/e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r"
Jul 15 15:58:37.430078 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:37.430067    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8522faee-cc8b-4556-b943-f82f08b80bef-credential-socket\") pod \"e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r\" (UID: \"8522faee-cc8b-4556-b943-f82f08b80bef\") " pod="openshift-ingress/e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r"
Jul 15 15:58:37.430231 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:37.430113    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8522faee-cc8b-4556-b943-f82f08b80bef-istio-envoy\") pod \"e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r\" (UID: \"8522faee-cc8b-4556-b943-f82f08b80bef\") " pod="openshift-ingress/e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r"
Jul 15 15:58:37.430231 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:37.430150    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8522faee-cc8b-4556-b943-f82f08b80bef-istio-data\") pod \"e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r\" (UID: \"8522faee-cc8b-4556-b943-f82f08b80bef\") " pod="openshift-ingress/e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r"
Jul 15 15:58:37.430231 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:37.430172    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8522faee-cc8b-4556-b943-f82f08b80bef-istio-token\") pod \"e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r\" (UID: \"8522faee-cc8b-4556-b943-f82f08b80bef\") " pod="openshift-ingress/e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r"
Jul 15 15:58:37.430231 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:37.430190    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8522faee-cc8b-4556-b943-f82f08b80bef-workload-certs\") pod \"e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r\" (UID: \"8522faee-cc8b-4556-b943-f82f08b80bef\") " pod="openshift-ingress/e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r"
Jul 15 15:58:37.430231 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:37.430210    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8522faee-cc8b-4556-b943-f82f08b80bef-istio-podinfo\") pod \"e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r\" (UID: \"8522faee-cc8b-4556-b943-f82f08b80bef\") " pod="openshift-ingress/e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r"
Jul 15 15:58:37.531241 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:37.531193    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8522faee-cc8b-4556-b943-f82f08b80bef-workload-socket\") pod \"e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r\" (UID: \"8522faee-cc8b-4556-b943-f82f08b80bef\") " pod="openshift-ingress/e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r"
Jul 15 15:58:37.531241 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:37.531234    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8522faee-cc8b-4556-b943-f82f08b80bef-credential-socket\") pod \"e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r\" (UID: \"8522faee-cc8b-4556-b943-f82f08b80bef\") " pod="openshift-ingress/e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r"
Jul 15 15:58:37.531496 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:37.531256    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8522faee-cc8b-4556-b943-f82f08b80bef-istio-envoy\") pod \"e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r\" (UID: \"8522faee-cc8b-4556-b943-f82f08b80bef\") " pod="openshift-ingress/e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r"
Jul 15 15:58:37.531496 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:37.531296    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8522faee-cc8b-4556-b943-f82f08b80bef-istio-data\") pod \"e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r\" (UID: \"8522faee-cc8b-4556-b943-f82f08b80bef\") " pod="openshift-ingress/e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r"
Jul 15 15:58:37.531496 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:37.531319    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8522faee-cc8b-4556-b943-f82f08b80bef-istio-token\") pod \"e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r\" (UID: \"8522faee-cc8b-4556-b943-f82f08b80bef\") " pod="openshift-ingress/e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r"
Jul 15 15:58:37.531496 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:37.531347    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8522faee-cc8b-4556-b943-f82f08b80bef-workload-certs\") pod \"e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r\" (UID: \"8522faee-cc8b-4556-b943-f82f08b80bef\") " pod="openshift-ingress/e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r"
Jul 15 15:58:37.531496 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:37.531372    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8522faee-cc8b-4556-b943-f82f08b80bef-istio-podinfo\") pod \"e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r\" (UID: \"8522faee-cc8b-4556-b943-f82f08b80bef\") " pod="openshift-ingress/e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r"
Jul 15 15:58:37.531496 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:37.531431    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jbwg\" (UniqueName: \"kubernetes.io/projected/8522faee-cc8b-4556-b943-f82f08b80bef-kube-api-access-2jbwg\") pod \"e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r\" (UID: \"8522faee-cc8b-4556-b943-f82f08b80bef\") " pod="openshift-ingress/e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r"
Jul 15 15:58:37.531496 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:37.531477    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8522faee-cc8b-4556-b943-f82f08b80bef-istiod-ca-cert\") pod \"e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r\" (UID: \"8522faee-cc8b-4556-b943-f82f08b80bef\") " pod="openshift-ingress/e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r"
Jul 15 15:58:37.531926 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:37.531676    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8522faee-cc8b-4556-b943-f82f08b80bef-credential-socket\") pod \"e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r\" (UID: \"8522faee-cc8b-4556-b943-f82f08b80bef\") " pod="openshift-ingress/e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r"
Jul 15 15:58:37.531926 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:37.531693    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8522faee-cc8b-4556-b943-f82f08b80bef-workload-certs\") pod \"e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r\" (UID: \"8522faee-cc8b-4556-b943-f82f08b80bef\") " pod="openshift-ingress/e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r"
Jul 15 15:58:37.532077 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:37.532042    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8522faee-cc8b-4556-b943-f82f08b80bef-workload-socket\") pod \"e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r\" (UID: \"8522faee-cc8b-4556-b943-f82f08b80bef\") " pod="openshift-ingress/e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r"
Jul 15 15:58:37.532159 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:37.532137    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8522faee-cc8b-4556-b943-f82f08b80bef-istio-data\") pod \"e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r\" (UID: \"8522faee-cc8b-4556-b943-f82f08b80bef\") " pod="openshift-ingress/e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r"
Jul 15 15:58:37.532358 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:37.532337    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8522faee-cc8b-4556-b943-f82f08b80bef-istiod-ca-cert\") pod \"e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r\" (UID: \"8522faee-cc8b-4556-b943-f82f08b80bef\") " pod="openshift-ingress/e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r"
Jul 15 15:58:37.533930 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:37.533899    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8522faee-cc8b-4556-b943-f82f08b80bef-istio-envoy\") pod \"e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r\" (UID: \"8522faee-cc8b-4556-b943-f82f08b80bef\") " pod="openshift-ingress/e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r"
Jul 15 15:58:37.534099 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:37.534057    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8522faee-cc8b-4556-b943-f82f08b80bef-istio-podinfo\") pod \"e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r\" (UID: \"8522faee-cc8b-4556-b943-f82f08b80bef\") " pod="openshift-ingress/e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r"
Jul 15 15:58:37.540621 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:37.540598    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8522faee-cc8b-4556-b943-f82f08b80bef-istio-token\") pod \"e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r\" (UID: \"8522faee-cc8b-4556-b943-f82f08b80bef\") " pod="openshift-ingress/e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r"
Jul 15 15:58:37.540740 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:37.540691    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jbwg\" (UniqueName: \"kubernetes.io/projected/8522faee-cc8b-4556-b943-f82f08b80bef-kube-api-access-2jbwg\") pod \"e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r\" (UID: \"8522faee-cc8b-4556-b943-f82f08b80bef\") " pod="openshift-ingress/e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r"
Jul 15 15:58:37.689774 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:37.689650    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r"
Jul 15 15:58:37.744688 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:37.744638    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:58:37.829670 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:37.829642    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r"]
Jul 15 15:58:37.830356 ip-10-0-138-107 kubenswrapper[2564]: W0715 15:58:37.830323    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8522faee_cc8b_4556_b943_f82f08b80bef.slice/crio-7f266d5fa43d9d1894f25274abded8ab11c31148f6b942367774e435fcc540b9 WatchSource:0}: Error finding container 7f266d5fa43d9d1894f25274abded8ab11c31148f6b942367774e435fcc540b9: Status 404 returned error can't find the container with id 7f266d5fa43d9d1894f25274abded8ab11c31148f6b942367774e435fcc540b9
Jul 15 15:58:37.832705 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:37.832662    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 15:58:37.832783 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:37.832753    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 15:58:37.832826 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:37.832798    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 15:58:38.268376 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:38.268343    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r" event={"ID":"8522faee-cc8b-4556-b943-f82f08b80bef","Type":"ContainerStarted","Data":"600fb35284b6e9902389d43491068345f36df58036f7b4ebdba0cbd18d396d5c"}
Jul 15 15:58:38.268853 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:38.268403    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r" event={"ID":"8522faee-cc8b-4556-b943-f82f08b80bef","Type":"ContainerStarted","Data":"7f266d5fa43d9d1894f25274abded8ab11c31148f6b942367774e435fcc540b9"}
Jul 15 15:58:38.295441 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:38.295396    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r" podStartSLOduration=1.295376699 podStartE2EDuration="1.295376699s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:58:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:58:38.29505595 +0000 UTC m=+2048.640959149" watchObservedRunningTime="2026-07-15 15:58:38.295376699 +0000 UTC m=+2048.641279896"
Jul 15 15:58:38.690414 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:38.690327    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r"
Jul 15 15:58:38.695270 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:38.695242    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r"
Jul 15 15:58:39.274852 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:39.274814    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r"
Jul 15 15:58:39.275657 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:39.275635    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r"
Jul 15 15:58:40.212835 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:40.212794    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:58:40.303539 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:40.303510    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:58:40.481131 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:40.481044    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:58:40.658686 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:40.658655    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:58:41.066705 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:41.066671    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:58:41.168462 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:41.168426    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:58:44.740224 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:44.740194    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:58:46.444593 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:46.444550    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:58:46.544101 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:46.544063    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:58:46.684124 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:46.684092    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:58:46.785359 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:46.785336    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:58:49.813467 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:49.813427    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:58:54.276188 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:54.276159    2564 patch_prober.go:28] interesting pod/e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 15 15:58:54.276520 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:54.276208    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r" podUID="8522faee-cc8b-4556-b943-f82f08b80bef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 15 15:58:54.342463 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:54.342439    2564 generic.go:356] "Generic (PLEG): container finished" podID="8522faee-cc8b-4556-b943-f82f08b80bef" containerID="600fb35284b6e9902389d43491068345f36df58036f7b4ebdba0cbd18d396d5c" exitCode=0
Jul 15 15:58:54.342561 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:54.342501    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r" event={"ID":"8522faee-cc8b-4556-b943-f82f08b80bef","Type":"ContainerDied","Data":"600fb35284b6e9902389d43491068345f36df58036f7b4ebdba0cbd18d396d5c"}
Jul 15 15:58:54.342851 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:54.342838    2564 scope.go:117] "RemoveContainer" containerID="600fb35284b6e9902389d43491068345f36df58036f7b4ebdba0cbd18d396d5c"
Jul 15 15:58:54.343786 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:54.343755    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 15:58:54.343882 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:54.343823    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 15:58:54.343882 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:54.343855    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 15:58:55.351005 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:55.350968    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r" event={"ID":"8522faee-cc8b-4556-b943-f82f08b80bef","Type":"ContainerStarted","Data":"95bb7788cfa7b4f92793b4a29fe1b74b45fc4701470ab11997c8da069294af0a"}
Jul 15 15:58:55.690291 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:55.690197    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r"
Jul 15 15:58:55.690535 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:55.690516    2564 patch_prober.go:28] interesting pod/e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 15 15:58:55.690583 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:55.690557    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r" podUID="8522faee-cc8b-4556-b943-f82f08b80bef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 15 15:58:56.690959 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:56.690920    2564 patch_prober.go:28] interesting pod/e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 15 15:58:56.691366 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:56.690975    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r" podUID="8522faee-cc8b-4556-b943-f82f08b80bef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 15 15:58:57.690971 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:57.690936    2564 patch_prober.go:28] interesting pod/e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 15 15:58:57.691367 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:57.691028    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r" podUID="8522faee-cc8b-4556-b943-f82f08b80bef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 15 15:58:58.690522 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:58.690484    2564 patch_prober.go:28] interesting pod/e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 15 15:58:58.690696 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:58.690543    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r" podUID="8522faee-cc8b-4556-b943-f82f08b80bef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 15 15:58:59.694409 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:59.694380    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r"
Jul 15 15:58:59.694850 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:59.694651    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r"
Jul 15 15:58:59.695506 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:58:59.695487    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r"
Jul 15 15:59:01.995748 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:59:01.995712    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:59:02.096952 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:59:02.096915    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:59:18.334581 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:59:18.334543    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:59:22.803689 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:59:22.803651    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:59:27.881805 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:59:27.881763    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 15:59:30.184717 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:59:30.184688    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfw7r_55d0e798-7e5a-4f3e-afc2-67dfb308d934/ovn-acl-logging/0.log"
Jul 15 15:59:30.190175 ip-10-0-138-107 kubenswrapper[2564]: I0715 15:59:30.190156    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfw7r_55d0e798-7e5a-4f3e-afc2-67dfb308d934/ovn-acl-logging/0.log"
Jul 15 16:00:04.854344 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:00:04.854308    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:00:05.260687 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:00:05.260596    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:00:10.898811 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:00:10.898775    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:00:16.692731 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:00:16.692691    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:00:16.793450 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:00:16.793400    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:00:25.135478 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:00:25.135401    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r"]
Jul 15 16:00:25.135844 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:00:25.135648    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r" podUID="8522faee-cc8b-4556-b943-f82f08b80bef" containerName="istio-proxy" containerID="cri-o://95bb7788cfa7b4f92793b4a29fe1b74b45fc4701470ab11997c8da069294af0a" gracePeriod=30
Jul 15 16:00:25.156377 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:00:25.156350    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:00:25.990655 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:00:25.990621    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:00:26.441232 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:00:26.441199    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:00:26.537407 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:00:26.537360    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:00:26.637596 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:00:26.637562    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:00:27.351373 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:00:27.351340    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:00:27.449446 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:00:27.449416    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:00:27.552051 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:00:27.551998    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:00:29.697542 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:00:29.697498    2564 patch_prober.go:28] interesting pod/e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 15 16:00:29.697917 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:00:29.697573    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r" podUID="8522faee-cc8b-4556-b943-f82f08b80bef" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 16:00:29.745183 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:00:29.745145    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:00:30.392064 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:00:30.392036    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r"
Jul 15 16:00:30.514326 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:00:30.514244    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8522faee-cc8b-4556-b943-f82f08b80bef-istiod-ca-cert\") pod \"8522faee-cc8b-4556-b943-f82f08b80bef\" (UID: \"8522faee-cc8b-4556-b943-f82f08b80bef\") "
Jul 15 16:00:30.514326 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:00:30.514287    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8522faee-cc8b-4556-b943-f82f08b80bef-istio-envoy\") pod \"8522faee-cc8b-4556-b943-f82f08b80bef\" (UID: \"8522faee-cc8b-4556-b943-f82f08b80bef\") "
Jul 15 16:00:30.514326 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:00:30.514306    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8522faee-cc8b-4556-b943-f82f08b80bef-istio-token\") pod \"8522faee-cc8b-4556-b943-f82f08b80bef\" (UID: \"8522faee-cc8b-4556-b943-f82f08b80bef\") "
Jul 15 16:00:30.514326 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:00:30.514325    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2jbwg\" (UniqueName: \"kubernetes.io/projected/8522faee-cc8b-4556-b943-f82f08b80bef-kube-api-access-2jbwg\") pod \"8522faee-cc8b-4556-b943-f82f08b80bef\" (UID: \"8522faee-cc8b-4556-b943-f82f08b80bef\") "
Jul 15 16:00:30.514679 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:00:30.514349    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8522faee-cc8b-4556-b943-f82f08b80bef-istio-podinfo\") pod \"8522faee-cc8b-4556-b943-f82f08b80bef\" (UID: \"8522faee-cc8b-4556-b943-f82f08b80bef\") "
Jul 15 16:00:30.514679 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:00:30.514401    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8522faee-cc8b-4556-b943-f82f08b80bef-credential-socket\") pod \"8522faee-cc8b-4556-b943-f82f08b80bef\" (UID: \"8522faee-cc8b-4556-b943-f82f08b80bef\") "
Jul 15 16:00:30.514679 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:00:30.514441    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8522faee-cc8b-4556-b943-f82f08b80bef-workload-socket\") pod \"8522faee-cc8b-4556-b943-f82f08b80bef\" (UID: \"8522faee-cc8b-4556-b943-f82f08b80bef\") "
Jul 15 16:00:30.514679 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:00:30.514467    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8522faee-cc8b-4556-b943-f82f08b80bef-workload-certs\") pod \"8522faee-cc8b-4556-b943-f82f08b80bef\" (UID: \"8522faee-cc8b-4556-b943-f82f08b80bef\") "
Jul 15 16:00:30.514679 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:00:30.514503    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8522faee-cc8b-4556-b943-f82f08b80bef-istio-data\") pod \"8522faee-cc8b-4556-b943-f82f08b80bef\" (UID: \"8522faee-cc8b-4556-b943-f82f08b80bef\") "
Jul 15 16:00:30.514955 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:00:30.514800    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8522faee-cc8b-4556-b943-f82f08b80bef-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8522faee-cc8b-4556-b943-f82f08b80bef" (UID: "8522faee-cc8b-4556-b943-f82f08b80bef"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:00:30.515116 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:00:30.515096    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8522faee-cc8b-4556-b943-f82f08b80bef-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8522faee-cc8b-4556-b943-f82f08b80bef" (UID: "8522faee-cc8b-4556-b943-f82f08b80bef"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:00:30.515227 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:00:30.515155    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8522faee-cc8b-4556-b943-f82f08b80bef-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8522faee-cc8b-4556-b943-f82f08b80bef" (UID: "8522faee-cc8b-4556-b943-f82f08b80bef"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:00:30.515227 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:00:30.515193    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8522faee-cc8b-4556-b943-f82f08b80bef-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8522faee-cc8b-4556-b943-f82f08b80bef" (UID: "8522faee-cc8b-4556-b943-f82f08b80bef"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 16:00:30.515454 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:00:30.515434    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8522faee-cc8b-4556-b943-f82f08b80bef-istio-data" (OuterVolumeSpecName: "istio-data") pod "8522faee-cc8b-4556-b943-f82f08b80bef" (UID: "8522faee-cc8b-4556-b943-f82f08b80bef"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:00:30.517002 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:00:30.516875    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8522faee-cc8b-4556-b943-f82f08b80bef-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8522faee-cc8b-4556-b943-f82f08b80bef" (UID: "8522faee-cc8b-4556-b943-f82f08b80bef"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:00:30.517002 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:00:30.516962    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8522faee-cc8b-4556-b943-f82f08b80bef-kube-api-access-2jbwg" (OuterVolumeSpecName: "kube-api-access-2jbwg") pod "8522faee-cc8b-4556-b943-f82f08b80bef" (UID: "8522faee-cc8b-4556-b943-f82f08b80bef"). InnerVolumeSpecName "kube-api-access-2jbwg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:00:30.517002 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:00:30.516966    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8522faee-cc8b-4556-b943-f82f08b80bef-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8522faee-cc8b-4556-b943-f82f08b80bef" (UID: "8522faee-cc8b-4556-b943-f82f08b80bef"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 16:00:30.517002 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:00:30.516993    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8522faee-cc8b-4556-b943-f82f08b80bef-istio-token" (OuterVolumeSpecName: "istio-token") pod "8522faee-cc8b-4556-b943-f82f08b80bef" (UID: "8522faee-cc8b-4556-b943-f82f08b80bef"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:00:30.615773 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:00:30.615740    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8522faee-cc8b-4556-b943-f82f08b80bef-workload-socket\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 16:00:30.615773 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:00:30.615772    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8522faee-cc8b-4556-b943-f82f08b80bef-workload-certs\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 16:00:30.616037 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:00:30.615787    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8522faee-cc8b-4556-b943-f82f08b80bef-istio-data\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 16:00:30.616037 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:00:30.615795    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8522faee-cc8b-4556-b943-f82f08b80bef-istiod-ca-cert\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 16:00:30.616037 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:00:30.615806    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8522faee-cc8b-4556-b943-f82f08b80bef-istio-envoy\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 16:00:30.616037 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:00:30.615816    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8522faee-cc8b-4556-b943-f82f08b80bef-istio-token\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 16:00:30.616037 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:00:30.615824    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2jbwg\" (UniqueName: \"kubernetes.io/projected/8522faee-cc8b-4556-b943-f82f08b80bef-kube-api-access-2jbwg\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 16:00:30.616037 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:00:30.615835    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8522faee-cc8b-4556-b943-f82f08b80bef-istio-podinfo\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 16:00:30.616037 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:00:30.615847    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8522faee-cc8b-4556-b943-f82f08b80bef-credential-socket\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 16:00:30.792553 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:00:30.792506    2564 generic.go:356] "Generic (PLEG): container finished" podID="8522faee-cc8b-4556-b943-f82f08b80bef" containerID="95bb7788cfa7b4f92793b4a29fe1b74b45fc4701470ab11997c8da069294af0a" exitCode=0
Jul 15 16:00:30.793043 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:00:30.792568    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r"
Jul 15 16:00:30.793043 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:00:30.792591    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r" event={"ID":"8522faee-cc8b-4556-b943-f82f08b80bef","Type":"ContainerDied","Data":"95bb7788cfa7b4f92793b4a29fe1b74b45fc4701470ab11997c8da069294af0a"}
Jul 15 16:00:30.793043 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:00:30.792646    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r" event={"ID":"8522faee-cc8b-4556-b943-f82f08b80bef","Type":"ContainerDied","Data":"7f266d5fa43d9d1894f25274abded8ab11c31148f6b942367774e435fcc540b9"}
Jul 15 16:00:30.793043 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:00:30.792668    2564 scope.go:117] "RemoveContainer" containerID="95bb7788cfa7b4f92793b4a29fe1b74b45fc4701470ab11997c8da069294af0a"
Jul 15 16:00:30.802583 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:00:30.802569    2564 scope.go:117] "RemoveContainer" containerID="600fb35284b6e9902389d43491068345f36df58036f7b4ebdba0cbd18d396d5c"
Jul 15 16:00:30.811972 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:00:30.811957    2564 scope.go:117] "RemoveContainer" containerID="95bb7788cfa7b4f92793b4a29fe1b74b45fc4701470ab11997c8da069294af0a"
Jul 15 16:00:30.812259 ip-10-0-138-107 kubenswrapper[2564]: E0715 16:00:30.812237    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95bb7788cfa7b4f92793b4a29fe1b74b45fc4701470ab11997c8da069294af0a\": container with ID starting with 95bb7788cfa7b4f92793b4a29fe1b74b45fc4701470ab11997c8da069294af0a not found: ID does not exist" containerID="95bb7788cfa7b4f92793b4a29fe1b74b45fc4701470ab11997c8da069294af0a"
Jul 15 16:00:30.812315 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:00:30.812267    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95bb7788cfa7b4f92793b4a29fe1b74b45fc4701470ab11997c8da069294af0a"} err="failed to get container status \"95bb7788cfa7b4f92793b4a29fe1b74b45fc4701470ab11997c8da069294af0a\": rpc error: code = NotFound desc = could not find container \"95bb7788cfa7b4f92793b4a29fe1b74b45fc4701470ab11997c8da069294af0a\": container with ID starting with 95bb7788cfa7b4f92793b4a29fe1b74b45fc4701470ab11997c8da069294af0a not found: ID does not exist"
Jul 15 16:00:30.812315 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:00:30.812285    2564 scope.go:117] "RemoveContainer" containerID="600fb35284b6e9902389d43491068345f36df58036f7b4ebdba0cbd18d396d5c"
Jul 15 16:00:30.812534 ip-10-0-138-107 kubenswrapper[2564]: E0715 16:00:30.812518    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"600fb35284b6e9902389d43491068345f36df58036f7b4ebdba0cbd18d396d5c\": container with ID starting with 600fb35284b6e9902389d43491068345f36df58036f7b4ebdba0cbd18d396d5c not found: ID does not exist" containerID="600fb35284b6e9902389d43491068345f36df58036f7b4ebdba0cbd18d396d5c"
Jul 15 16:00:30.812596 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:00:30.812538    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"600fb35284b6e9902389d43491068345f36df58036f7b4ebdba0cbd18d396d5c"} err="failed to get container status \"600fb35284b6e9902389d43491068345f36df58036f7b4ebdba0cbd18d396d5c\": rpc error: code = NotFound desc = could not find container \"600fb35284b6e9902389d43491068345f36df58036f7b4ebdba0cbd18d396d5c\": container with ID starting with 600fb35284b6e9902389d43491068345f36df58036f7b4ebdba0cbd18d396d5c not found: ID does not exist"
Jul 15 16:00:30.818659 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:00:30.818634    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r"]
Jul 15 16:00:30.820536 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:00:30.820514    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-fb1842df-openshift-default-5f9598954c-vjh9r"]
Jul 15 16:00:32.230637 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:00:32.230604    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8522faee-cc8b-4556-b943-f82f08b80bef" path="/var/lib/kubelet/pods/8522faee-cc8b-4556-b943-f82f08b80bef/volumes"
Jul 15 16:00:34.741831 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:00:34.741793    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:00:34.846061 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:00:34.846033    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:00:35.451115 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:00:35.451076    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:00:41.792878 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:00:41.792840    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:00:41.894222 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:00:41.894193    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:00:42.053827 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:00:42.053745    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:00:53.709000 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:00:53.708964    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:00:53.779190 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:00:53.779158    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:01:13.842422 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:13.842388    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:01:19.899867 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:19.899827    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:01:20.000714 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:20.000681    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:01:20.544516 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:20.544485    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm"]
Jul 15 16:01:20.544883 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:20.544869    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8522faee-cc8b-4556-b943-f82f08b80bef" containerName="istio-proxy"
Jul 15 16:01:20.544930 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:20.544887    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8522faee-cc8b-4556-b943-f82f08b80bef" containerName="istio-proxy"
Jul 15 16:01:20.544930 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:20.544905    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8522faee-cc8b-4556-b943-f82f08b80bef" containerName="istio-proxy"
Jul 15 16:01:20.544930 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:20.544910    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8522faee-cc8b-4556-b943-f82f08b80bef" containerName="istio-proxy"
Jul 15 16:01:20.545055 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:20.544979    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="1109ce0d-9693-4224-867c-90092c9216be" containerName="istio-proxy"
Jul 15 16:01:20.545055 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:20.544989    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="8522faee-cc8b-4556-b943-f82f08b80bef" containerName="istio-proxy"
Jul 15 16:01:20.545055 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:20.544997    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="8522faee-cc8b-4556-b943-f82f08b80bef" containerName="istio-proxy"
Jul 15 16:01:20.547882 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:20.547866    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm"
Jul 15 16:01:20.552362 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:20.552340    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-a920e4-openshift-default-dockercfg-rfwpl\""
Jul 15 16:01:20.563056 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:20.563034    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm"]
Jul 15 16:01:20.721391 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:20.721350    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/663ff04e-6d19-4e87-b3ef-4c135ecb85b4-workload-certs\") pod \"e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm\" (UID: \"663ff04e-6d19-4e87-b3ef-4c135ecb85b4\") " pod="openshift-ingress/e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm"
Jul 15 16:01:20.721391 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:20.721390    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/663ff04e-6d19-4e87-b3ef-4c135ecb85b4-workload-socket\") pod \"e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm\" (UID: \"663ff04e-6d19-4e87-b3ef-4c135ecb85b4\") " pod="openshift-ingress/e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm"
Jul 15 16:01:20.721590 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:20.721407    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmllr\" (UniqueName: \"kubernetes.io/projected/663ff04e-6d19-4e87-b3ef-4c135ecb85b4-kube-api-access-nmllr\") pod \"e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm\" (UID: \"663ff04e-6d19-4e87-b3ef-4c135ecb85b4\") " pod="openshift-ingress/e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm"
Jul 15 16:01:20.721590 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:20.721435    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/663ff04e-6d19-4e87-b3ef-4c135ecb85b4-istio-envoy\") pod \"e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm\" (UID: \"663ff04e-6d19-4e87-b3ef-4c135ecb85b4\") " pod="openshift-ingress/e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm"
Jul 15 16:01:20.721590 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:20.721509    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/663ff04e-6d19-4e87-b3ef-4c135ecb85b4-istio-token\") pod \"e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm\" (UID: \"663ff04e-6d19-4e87-b3ef-4c135ecb85b4\") " pod="openshift-ingress/e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm"
Jul 15 16:01:20.721590 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:20.721555    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/663ff04e-6d19-4e87-b3ef-4c135ecb85b4-istio-podinfo\") pod \"e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm\" (UID: \"663ff04e-6d19-4e87-b3ef-4c135ecb85b4\") " pod="openshift-ingress/e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm"
Jul 15 16:01:20.721590 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:20.721575    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/663ff04e-6d19-4e87-b3ef-4c135ecb85b4-credential-socket\") pod \"e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm\" (UID: \"663ff04e-6d19-4e87-b3ef-4c135ecb85b4\") " pod="openshift-ingress/e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm"
Jul 15 16:01:20.721590 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:20.721591    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/663ff04e-6d19-4e87-b3ef-4c135ecb85b4-istio-data\") pod \"e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm\" (UID: \"663ff04e-6d19-4e87-b3ef-4c135ecb85b4\") " pod="openshift-ingress/e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm"
Jul 15 16:01:20.721811 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:20.721613    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/663ff04e-6d19-4e87-b3ef-4c135ecb85b4-istiod-ca-cert\") pod \"e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm\" (UID: \"663ff04e-6d19-4e87-b3ef-4c135ecb85b4\") " pod="openshift-ingress/e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm"
Jul 15 16:01:20.724756 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:20.724731    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:01:20.823066 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:20.822978    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/663ff04e-6d19-4e87-b3ef-4c135ecb85b4-workload-socket\") pod \"e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm\" (UID: \"663ff04e-6d19-4e87-b3ef-4c135ecb85b4\") " pod="openshift-ingress/e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm"
Jul 15 16:01:20.823066 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:20.823020    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmllr\" (UniqueName: \"kubernetes.io/projected/663ff04e-6d19-4e87-b3ef-4c135ecb85b4-kube-api-access-nmllr\") pod \"e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm\" (UID: \"663ff04e-6d19-4e87-b3ef-4c135ecb85b4\") " pod="openshift-ingress/e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm"
Jul 15 16:01:20.823066 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:20.823053    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/663ff04e-6d19-4e87-b3ef-4c135ecb85b4-istio-envoy\") pod \"e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm\" (UID: \"663ff04e-6d19-4e87-b3ef-4c135ecb85b4\") " pod="openshift-ingress/e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm"
Jul 15 16:01:20.823291 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:20.823101    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/663ff04e-6d19-4e87-b3ef-4c135ecb85b4-istio-token\") pod \"e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm\" (UID: \"663ff04e-6d19-4e87-b3ef-4c135ecb85b4\") " pod="openshift-ingress/e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm"
Jul 15 16:01:20.823291 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:20.823143    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/663ff04e-6d19-4e87-b3ef-4c135ecb85b4-istio-podinfo\") pod \"e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm\" (UID: \"663ff04e-6d19-4e87-b3ef-4c135ecb85b4\") " pod="openshift-ingress/e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm"
Jul 15 16:01:20.823291 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:20.823171    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/663ff04e-6d19-4e87-b3ef-4c135ecb85b4-credential-socket\") pod \"e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm\" (UID: \"663ff04e-6d19-4e87-b3ef-4c135ecb85b4\") " pod="openshift-ingress/e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm"
Jul 15 16:01:20.823291 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:20.823196    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/663ff04e-6d19-4e87-b3ef-4c135ecb85b4-istio-data\") pod \"e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm\" (UID: \"663ff04e-6d19-4e87-b3ef-4c135ecb85b4\") " pod="openshift-ingress/e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm"
Jul 15 16:01:20.823291 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:20.823229    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/663ff04e-6d19-4e87-b3ef-4c135ecb85b4-istiod-ca-cert\") pod \"e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm\" (UID: \"663ff04e-6d19-4e87-b3ef-4c135ecb85b4\") " pod="openshift-ingress/e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm"
Jul 15 16:01:20.823291 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:20.823296    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/663ff04e-6d19-4e87-b3ef-4c135ecb85b4-workload-certs\") pod \"e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm\" (UID: \"663ff04e-6d19-4e87-b3ef-4c135ecb85b4\") " pod="openshift-ingress/e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm"
Jul 15 16:01:20.823632 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:20.823553    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/663ff04e-6d19-4e87-b3ef-4c135ecb85b4-credential-socket\") pod \"e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm\" (UID: \"663ff04e-6d19-4e87-b3ef-4c135ecb85b4\") " pod="openshift-ingress/e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm"
Jul 15 16:01:20.823632 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:20.823564    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/663ff04e-6d19-4e87-b3ef-4c135ecb85b4-istio-data\") pod \"e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm\" (UID: \"663ff04e-6d19-4e87-b3ef-4c135ecb85b4\") " pod="openshift-ingress/e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm"
Jul 15 16:01:20.823632 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:20.823620    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/663ff04e-6d19-4e87-b3ef-4c135ecb85b4-workload-certs\") pod \"e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm\" (UID: \"663ff04e-6d19-4e87-b3ef-4c135ecb85b4\") " pod="openshift-ingress/e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm"
Jul 15 16:01:20.823751 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:20.823656    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/663ff04e-6d19-4e87-b3ef-4c135ecb85b4-workload-socket\") pod \"e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm\" (UID: \"663ff04e-6d19-4e87-b3ef-4c135ecb85b4\") " pod="openshift-ingress/e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm"
Jul 15 16:01:20.824128 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:20.824104    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/663ff04e-6d19-4e87-b3ef-4c135ecb85b4-istiod-ca-cert\") pod \"e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm\" (UID: \"663ff04e-6d19-4e87-b3ef-4c135ecb85b4\") " pod="openshift-ingress/e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm"
Jul 15 16:01:20.825570 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:20.825547    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/663ff04e-6d19-4e87-b3ef-4c135ecb85b4-istio-envoy\") pod \"e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm\" (UID: \"663ff04e-6d19-4e87-b3ef-4c135ecb85b4\") " pod="openshift-ingress/e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm"
Jul 15 16:01:20.825764 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:20.825747    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/663ff04e-6d19-4e87-b3ef-4c135ecb85b4-istio-podinfo\") pod \"e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm\" (UID: \"663ff04e-6d19-4e87-b3ef-4c135ecb85b4\") " pod="openshift-ingress/e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm"
Jul 15 16:01:20.832599 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:20.832575    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmllr\" (UniqueName: \"kubernetes.io/projected/663ff04e-6d19-4e87-b3ef-4c135ecb85b4-kube-api-access-nmllr\") pod \"e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm\" (UID: \"663ff04e-6d19-4e87-b3ef-4c135ecb85b4\") " pod="openshift-ingress/e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm"
Jul 15 16:01:20.837556 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:20.837538    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/663ff04e-6d19-4e87-b3ef-4c135ecb85b4-istio-token\") pod \"e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm\" (UID: \"663ff04e-6d19-4e87-b3ef-4c135ecb85b4\") " pod="openshift-ingress/e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm"
Jul 15 16:01:20.857739 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:20.857718    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm"
Jul 15 16:01:20.997623 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:20.997599    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm"]
Jul 15 16:01:20.999521 ip-10-0-138-107 kubenswrapper[2564]: W0715 16:01:20.999495    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod663ff04e_6d19_4e87_b3ef_4c135ecb85b4.slice/crio-b2999254bce3fa9cbc1a414b6eef8b8a98303e8df4fdc440468c3a2ce6bd6ac2 WatchSource:0}: Error finding container b2999254bce3fa9cbc1a414b6eef8b8a98303e8df4fdc440468c3a2ce6bd6ac2: Status 404 returned error can't find the container with id b2999254bce3fa9cbc1a414b6eef8b8a98303e8df4fdc440468c3a2ce6bd6ac2
Jul 15 16:01:21.001564 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:21.001532    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:01:21.001630 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:21.001602    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:01:21.001676 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:21.001633    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:01:21.025661 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:21.025635    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm" event={"ID":"663ff04e-6d19-4e87-b3ef-4c135ecb85b4","Type":"ContainerStarted","Data":"b2999254bce3fa9cbc1a414b6eef8b8a98303e8df4fdc440468c3a2ce6bd6ac2"}
Jul 15 16:01:22.031957 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:22.031917    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm" event={"ID":"663ff04e-6d19-4e87-b3ef-4c135ecb85b4","Type":"ContainerStarted","Data":"44842ade02a33881c19964acd49cb0537a0efd5be621cff0ea1b135011d7770e"}
Jul 15 16:01:22.058704 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:22.058656    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm" podStartSLOduration=2.058640876 podStartE2EDuration="2.058640876s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:01:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:01:22.057096353 +0000 UTC m=+2212.402999546" watchObservedRunningTime="2026-07-15 16:01:22.058640876 +0000 UTC m=+2212.404544069"
Jul 15 16:01:22.858085 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:22.858048    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm"
Jul 15 16:01:22.862815 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:22.862784    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm"
Jul 15 16:01:23.036232 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:23.036202    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm"
Jul 15 16:01:23.037175 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:23.037156    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm"
Jul 15 16:01:23.336254 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:23.336226    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:01:23.978385 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:23.978356    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:01:24.120130 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:24.120087    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:01:24.276112 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:24.276080    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:01:24.456466 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:24.456434    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:01:24.928943 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:24.928912    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:01:25.030159 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:25.030130    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:01:28.482041 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:28.481986    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:01:28.845122 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:28.845081    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:01:29.111248 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:29.111156    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk"]
Jul 15 16:01:29.115256 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:29.115232    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk"
Jul 15 16:01:29.118610 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:29.118590    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-89ce7e-openshift-default-dockercfg-7dfsv\""
Jul 15 16:01:29.131401 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:29.131376    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk"]
Jul 15 16:01:29.145452 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:29.145420    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:01:29.245869 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:29.245837    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:01:29.288214 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:29.288181    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9cf123c8-1752-4bca-8855-97842553c4e8-istio-token\") pod \"e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk\" (UID: \"9cf123c8-1752-4bca-8855-97842553c4e8\") " pod="openshift-ingress/e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk"
Jul 15 16:01:29.288214 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:29.288216    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9cf123c8-1752-4bca-8855-97842553c4e8-istio-envoy\") pod \"e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk\" (UID: \"9cf123c8-1752-4bca-8855-97842553c4e8\") " pod="openshift-ingress/e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk"
Jul 15 16:01:29.288419 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:29.288284    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p67r5\" (UniqueName: \"kubernetes.io/projected/9cf123c8-1752-4bca-8855-97842553c4e8-kube-api-access-p67r5\") pod \"e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk\" (UID: \"9cf123c8-1752-4bca-8855-97842553c4e8\") " pod="openshift-ingress/e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk"
Jul 15 16:01:29.288419 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:29.288346    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9cf123c8-1752-4bca-8855-97842553c4e8-istio-data\") pod \"e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk\" (UID: \"9cf123c8-1752-4bca-8855-97842553c4e8\") " pod="openshift-ingress/e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk"
Jul 15 16:01:29.288419 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:29.288365    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9cf123c8-1752-4bca-8855-97842553c4e8-istiod-ca-cert\") pod \"e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk\" (UID: \"9cf123c8-1752-4bca-8855-97842553c4e8\") " pod="openshift-ingress/e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk"
Jul 15 16:01:29.288419 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:29.288409    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9cf123c8-1752-4bca-8855-97842553c4e8-workload-certs\") pod \"e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk\" (UID: \"9cf123c8-1752-4bca-8855-97842553c4e8\") " pod="openshift-ingress/e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk"
Jul 15 16:01:29.288579 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:29.288469    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cf123c8-1752-4bca-8855-97842553c4e8-workload-socket\") pod \"e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk\" (UID: \"9cf123c8-1752-4bca-8855-97842553c4e8\") " pod="openshift-ingress/e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk"
Jul 15 16:01:29.288579 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:29.288495    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cf123c8-1752-4bca-8855-97842553c4e8-credential-socket\") pod \"e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk\" (UID: \"9cf123c8-1752-4bca-8855-97842553c4e8\") " pod="openshift-ingress/e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk"
Jul 15 16:01:29.288579 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:29.288510    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9cf123c8-1752-4bca-8855-97842553c4e8-istio-podinfo\") pod \"e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk\" (UID: \"9cf123c8-1752-4bca-8855-97842553c4e8\") " pod="openshift-ingress/e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk"
Jul 15 16:01:29.389868 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:29.389777    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cf123c8-1752-4bca-8855-97842553c4e8-workload-socket\") pod \"e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk\" (UID: \"9cf123c8-1752-4bca-8855-97842553c4e8\") " pod="openshift-ingress/e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk"
Jul 15 16:01:29.389868 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:29.389820    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cf123c8-1752-4bca-8855-97842553c4e8-credential-socket\") pod \"e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk\" (UID: \"9cf123c8-1752-4bca-8855-97842553c4e8\") " pod="openshift-ingress/e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk"
Jul 15 16:01:29.389868 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:29.389843    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9cf123c8-1752-4bca-8855-97842553c4e8-istio-podinfo\") pod \"e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk\" (UID: \"9cf123c8-1752-4bca-8855-97842553c4e8\") " pod="openshift-ingress/e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk"
Jul 15 16:01:29.390221 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:29.389884    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9cf123c8-1752-4bca-8855-97842553c4e8-istio-token\") pod \"e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk\" (UID: \"9cf123c8-1752-4bca-8855-97842553c4e8\") " pod="openshift-ingress/e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk"
Jul 15 16:01:29.390221 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:29.389924    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9cf123c8-1752-4bca-8855-97842553c4e8-istio-envoy\") pod \"e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk\" (UID: \"9cf123c8-1752-4bca-8855-97842553c4e8\") " pod="openshift-ingress/e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk"
Jul 15 16:01:29.390221 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:29.390047    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p67r5\" (UniqueName: \"kubernetes.io/projected/9cf123c8-1752-4bca-8855-97842553c4e8-kube-api-access-p67r5\") pod \"e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk\" (UID: \"9cf123c8-1752-4bca-8855-97842553c4e8\") " pod="openshift-ingress/e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk"
Jul 15 16:01:29.390221 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:29.390133    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9cf123c8-1752-4bca-8855-97842553c4e8-istio-data\") pod \"e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk\" (UID: \"9cf123c8-1752-4bca-8855-97842553c4e8\") " pod="openshift-ingress/e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk"
Jul 15 16:01:29.390221 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:29.390162    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9cf123c8-1752-4bca-8855-97842553c4e8-istiod-ca-cert\") pod \"e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk\" (UID: \"9cf123c8-1752-4bca-8855-97842553c4e8\") " pod="openshift-ingress/e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk"
Jul 15 16:01:29.390494 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:29.390249    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9cf123c8-1752-4bca-8855-97842553c4e8-workload-certs\") pod \"e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk\" (UID: \"9cf123c8-1752-4bca-8855-97842553c4e8\") " pod="openshift-ingress/e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk"
Jul 15 16:01:29.390494 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:29.390290    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cf123c8-1752-4bca-8855-97842553c4e8-credential-socket\") pod \"e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk\" (UID: \"9cf123c8-1752-4bca-8855-97842553c4e8\") " pod="openshift-ingress/e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk"
Jul 15 16:01:29.390808 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:29.390782    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cf123c8-1752-4bca-8855-97842553c4e8-workload-socket\") pod \"e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk\" (UID: \"9cf123c8-1752-4bca-8855-97842553c4e8\") " pod="openshift-ingress/e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk"
Jul 15 16:01:29.390900 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:29.390827    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9cf123c8-1752-4bca-8855-97842553c4e8-workload-certs\") pod \"e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk\" (UID: \"9cf123c8-1752-4bca-8855-97842553c4e8\") " pod="openshift-ingress/e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk"
Jul 15 16:01:29.391072 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:29.391049    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9cf123c8-1752-4bca-8855-97842553c4e8-istio-data\") pod \"e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk\" (UID: \"9cf123c8-1752-4bca-8855-97842553c4e8\") " pod="openshift-ingress/e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk"
Jul 15 16:01:29.391145 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:29.391078    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9cf123c8-1752-4bca-8855-97842553c4e8-istiod-ca-cert\") pod \"e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk\" (UID: \"9cf123c8-1752-4bca-8855-97842553c4e8\") " pod="openshift-ingress/e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk"
Jul 15 16:01:29.392358 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:29.392335    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9cf123c8-1752-4bca-8855-97842553c4e8-istio-envoy\") pod \"e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk\" (UID: \"9cf123c8-1752-4bca-8855-97842553c4e8\") " pod="openshift-ingress/e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk"
Jul 15 16:01:29.392608 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:29.392584    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9cf123c8-1752-4bca-8855-97842553c4e8-istio-podinfo\") pod \"e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk\" (UID: \"9cf123c8-1752-4bca-8855-97842553c4e8\") " pod="openshift-ingress/e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk"
Jul 15 16:01:29.398460 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:29.398438    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9cf123c8-1752-4bca-8855-97842553c4e8-istio-token\") pod \"e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk\" (UID: \"9cf123c8-1752-4bca-8855-97842553c4e8\") " pod="openshift-ingress/e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk"
Jul 15 16:01:29.398684 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:29.398662    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p67r5\" (UniqueName: \"kubernetes.io/projected/9cf123c8-1752-4bca-8855-97842553c4e8-kube-api-access-p67r5\") pod \"e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk\" (UID: \"9cf123c8-1752-4bca-8855-97842553c4e8\") " pod="openshift-ingress/e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk"
Jul 15 16:01:29.426119 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:29.426096    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk"
Jul 15 16:01:29.564768 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:29.564743    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk"]
Jul 15 16:01:29.567179 ip-10-0-138-107 kubenswrapper[2564]: W0715 16:01:29.567149    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cf123c8_1752_4bca_8855_97842553c4e8.slice/crio-6bcceb1268f78c630dc2b6952a7ca570f2e04c54f35871fc6630f2b150c7ca96 WatchSource:0}: Error finding container 6bcceb1268f78c630dc2b6952a7ca570f2e04c54f35871fc6630f2b150c7ca96: Status 404 returned error can't find the container with id 6bcceb1268f78c630dc2b6952a7ca570f2e04c54f35871fc6630f2b150c7ca96
Jul 15 16:01:29.569294 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:29.569258    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:01:29.569401 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:29.569343    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:01:29.569401 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:29.569387    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:01:30.073856 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:30.073815    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk" event={"ID":"9cf123c8-1752-4bca-8855-97842553c4e8","Type":"ContainerStarted","Data":"eebd450b26eb588b483d06d743671c4762e5b44566e46f40a804493b95bdbdbe"}
Jul 15 16:01:30.074046 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:30.073878    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk" event={"ID":"9cf123c8-1752-4bca-8855-97842553c4e8","Type":"ContainerStarted","Data":"6bcceb1268f78c630dc2b6952a7ca570f2e04c54f35871fc6630f2b150c7ca96"}
Jul 15 16:01:30.098545 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:30.098503    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk" podStartSLOduration=1.098488852 podStartE2EDuration="1.098488852s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:01:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:01:30.096827287 +0000 UTC m=+2220.442730480" watchObservedRunningTime="2026-07-15 16:01:30.098488852 +0000 UTC m=+2220.444392044"
Jul 15 16:01:30.426886 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:30.426827    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk"
Jul 15 16:01:30.431691 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:30.431668    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk"
Jul 15 16:01:31.078369 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:31.078339    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk"
Jul 15 16:01:31.079200 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:31.079183    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk"
Jul 15 16:01:32.063761 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:32.063722    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:01:32.172520 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:32.172482    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:01:32.269944 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:32.269908    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:01:33.468767 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:33.468732    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:01:33.567997 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:33.567951    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:01:36.786098 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:36.786057    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:01:37.649066 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:37.649033    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:01:39.079148 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:39.079116    2564 patch_prober.go:28] interesting pod/e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 15 16:01:39.079530 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:39.079175    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm" podUID="663ff04e-6d19-4e87-b3ef-4c135ecb85b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 15 16:01:40.126098 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:40.126065    2564 generic.go:356] "Generic (PLEG): container finished" podID="663ff04e-6d19-4e87-b3ef-4c135ecb85b4" containerID="44842ade02a33881c19964acd49cb0537a0efd5be621cff0ea1b135011d7770e" exitCode=0
Jul 15 16:01:40.126577 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:40.126140    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm" event={"ID":"663ff04e-6d19-4e87-b3ef-4c135ecb85b4","Type":"ContainerDied","Data":"44842ade02a33881c19964acd49cb0537a0efd5be621cff0ea1b135011d7770e"}
Jul 15 16:01:40.126577 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:40.126538    2564 scope.go:117] "RemoveContainer" containerID="44842ade02a33881c19964acd49cb0537a0efd5be621cff0ea1b135011d7770e"
Jul 15 16:01:40.127617 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:40.127591    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:01:40.127676 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:40.127655    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:01:40.127718 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:40.127688    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:01:41.132304 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:41.132271    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm" event={"ID":"663ff04e-6d19-4e87-b3ef-4c135ecb85b4","Type":"ContainerStarted","Data":"3c95233e33abc90951eaef43f801fcdb3e54e668764eea3b74ad635f15879904"}
Jul 15 16:01:41.858868 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:41.858785    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm"
Jul 15 16:01:41.859463 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:41.859155    2564 patch_prober.go:28] interesting pod/e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 15 16:01:41.859463 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:41.859220    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm" podUID="663ff04e-6d19-4e87-b3ef-4c135ecb85b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 15 16:01:42.858887 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:42.858434    2564 patch_prober.go:28] interesting pod/e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 15 16:01:42.858887 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:42.858506    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm" podUID="663ff04e-6d19-4e87-b3ef-4c135ecb85b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 15 16:01:43.858966 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:43.858920    2564 patch_prober.go:28] interesting pod/e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 15 16:01:43.859574 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:43.858989    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm" podUID="663ff04e-6d19-4e87-b3ef-4c135ecb85b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 15 16:01:44.865833 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:44.865389    2564 patch_prober.go:28] interesting pod/e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 15 16:01:44.865833 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:44.865454    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm" podUID="663ff04e-6d19-4e87-b3ef-4c135ecb85b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 15 16:01:45.771662 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:45.771623    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:01:45.867035 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:45.858244    2564 patch_prober.go:28] interesting pod/e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 15 16:01:45.867035 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:45.858313    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm" podUID="663ff04e-6d19-4e87-b3ef-4c135ecb85b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 15 16:01:45.880771 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:45.880563    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:01:46.870031 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:46.859098    2564 patch_prober.go:28] interesting pod/e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 15 16:01:46.870031 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:46.859165    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm" podUID="663ff04e-6d19-4e87-b3ef-4c135ecb85b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 15 16:01:47.120259 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:47.120174    2564 patch_prober.go:28] interesting pod/e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 15 16:01:47.120259 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:47.120237    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk" podUID="9cf123c8-1752-4bca-8855-97842553c4e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 15 16:01:47.697260 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:47.697226    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:01:47.859322 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:47.858836    2564 patch_prober.go:28] interesting pod/e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 15 16:01:47.859322 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:47.858902    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm" podUID="663ff04e-6d19-4e87-b3ef-4c135ecb85b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 15 16:01:48.166859 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:48.166827    2564 generic.go:356] "Generic (PLEG): container finished" podID="9cf123c8-1752-4bca-8855-97842553c4e8" containerID="eebd450b26eb588b483d06d743671c4762e5b44566e46f40a804493b95bdbdbe" exitCode=0
Jul 15 16:01:48.167263 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:48.166900    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk" event={"ID":"9cf123c8-1752-4bca-8855-97842553c4e8","Type":"ContainerDied","Data":"eebd450b26eb588b483d06d743671c4762e5b44566e46f40a804493b95bdbdbe"}
Jul 15 16:01:48.167313 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:48.167295    2564 scope.go:117] "RemoveContainer" containerID="eebd450b26eb588b483d06d743671c4762e5b44566e46f40a804493b95bdbdbe"
Jul 15 16:01:48.168237 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:48.168212    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:01:48.168298 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:48.168283    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:01:48.168334 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:48.168325    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:01:48.862143 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:48.862115    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm"
Jul 15 16:01:48.862407 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:48.862388    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm"
Jul 15 16:01:48.863056 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:48.863037    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm"
Jul 15 16:01:49.178304 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:49.177489    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk" event={"ID":"9cf123c8-1752-4bca-8855-97842553c4e8","Type":"ContainerStarted","Data":"de31949e376133ac309146cfe0c53442a8bdae905d433cb4d868abe6a304a1ac"}
Jul 15 16:01:49.426389 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:49.426354    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk"
Jul 15 16:01:49.426618 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:49.426597    2564 patch_prober.go:28] interesting pod/e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 15 16:01:49.426679 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:49.426644    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk" podUID="9cf123c8-1752-4bca-8855-97842553c4e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 15 16:01:50.427303 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:50.427265    2564 patch_prober.go:28] interesting pod/e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 15 16:01:50.427691 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:50.427324    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk" podUID="9cf123c8-1752-4bca-8855-97842553c4e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 15 16:01:51.426505 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:51.426473    2564 patch_prober.go:28] interesting pod/e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 15 16:01:51.426692 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:51.426525    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk" podUID="9cf123c8-1752-4bca-8855-97842553c4e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 15 16:01:52.426620 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:52.426541    2564 patch_prober.go:28] interesting pod/e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 15 16:01:52.426974 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:52.426612    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk" podUID="9cf123c8-1752-4bca-8855-97842553c4e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 15 16:01:53.430360 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:53.430332    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk"
Jul 15 16:01:53.430730 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:53.430689    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk"
Jul 15 16:01:53.431406 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:53.431386    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk"
Jul 15 16:01:53.708463 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:53.708380    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:01:53.808044 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:01:53.807999    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:02:10.308880 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:02:10.308840    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:02:29.922125 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:02:29.922089    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:02:30.977735 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:02:30.977694    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:02:31.779059 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:02:31.779003    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:02:31.875094 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:02:31.875057    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:02:41.586314 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:02:41.586279    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:02:46.185766 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:02:46.185727    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:02:52.072886 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:02:52.072849    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:02:52.157921 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:02:52.157888    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:02:56.881735 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:02:56.881700    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm"]
Jul 15 16:02:56.882176 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:02:56.881951    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm" podUID="663ff04e-6d19-4e87-b3ef-4c135ecb85b4" containerName="istio-proxy" containerID="cri-o://3c95233e33abc90951eaef43f801fcdb3e54e668764eea3b74ad635f15879904" gracePeriod=30
Jul 15 16:02:56.907420 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:02:56.907387    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:02:57.137899 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:02:57.137813    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:02:59.517115 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:02:59.517079    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:02:59.615769 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:02:59.615734    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:03:02.134784 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:02.134756    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm"
Jul 15 16:03:02.193569 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:02.193493    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/663ff04e-6d19-4e87-b3ef-4c135ecb85b4-workload-certs\") pod \"663ff04e-6d19-4e87-b3ef-4c135ecb85b4\" (UID: \"663ff04e-6d19-4e87-b3ef-4c135ecb85b4\") "
Jul 15 16:03:02.193569 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:02.193524    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/663ff04e-6d19-4e87-b3ef-4c135ecb85b4-credential-socket\") pod \"663ff04e-6d19-4e87-b3ef-4c135ecb85b4\" (UID: \"663ff04e-6d19-4e87-b3ef-4c135ecb85b4\") "
Jul 15 16:03:02.193569 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:02.193548    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/663ff04e-6d19-4e87-b3ef-4c135ecb85b4-istio-data\") pod \"663ff04e-6d19-4e87-b3ef-4c135ecb85b4\" (UID: \"663ff04e-6d19-4e87-b3ef-4c135ecb85b4\") "
Jul 15 16:03:02.193832 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:02.193587    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nmllr\" (UniqueName: \"kubernetes.io/projected/663ff04e-6d19-4e87-b3ef-4c135ecb85b4-kube-api-access-nmllr\") pod \"663ff04e-6d19-4e87-b3ef-4c135ecb85b4\" (UID: \"663ff04e-6d19-4e87-b3ef-4c135ecb85b4\") "
Jul 15 16:03:02.193832 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:02.193648    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/663ff04e-6d19-4e87-b3ef-4c135ecb85b4-istio-token\") pod \"663ff04e-6d19-4e87-b3ef-4c135ecb85b4\" (UID: \"663ff04e-6d19-4e87-b3ef-4c135ecb85b4\") "
Jul 15 16:03:02.193832 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:02.193728    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/663ff04e-6d19-4e87-b3ef-4c135ecb85b4-workload-socket\") pod \"663ff04e-6d19-4e87-b3ef-4c135ecb85b4\" (UID: \"663ff04e-6d19-4e87-b3ef-4c135ecb85b4\") "
Jul 15 16:03:02.193832 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:02.193768    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/663ff04e-6d19-4e87-b3ef-4c135ecb85b4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "663ff04e-6d19-4e87-b3ef-4c135ecb85b4" (UID: "663ff04e-6d19-4e87-b3ef-4c135ecb85b4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:03:02.193832 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:02.193816    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/663ff04e-6d19-4e87-b3ef-4c135ecb85b4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "663ff04e-6d19-4e87-b3ef-4c135ecb85b4" (UID: "663ff04e-6d19-4e87-b3ef-4c135ecb85b4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:03:02.194189 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:02.193854    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/663ff04e-6d19-4e87-b3ef-4c135ecb85b4-istiod-ca-cert\") pod \"663ff04e-6d19-4e87-b3ef-4c135ecb85b4\" (UID: \"663ff04e-6d19-4e87-b3ef-4c135ecb85b4\") "
Jul 15 16:03:02.194189 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:02.193917    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/663ff04e-6d19-4e87-b3ef-4c135ecb85b4-istio-podinfo\") pod \"663ff04e-6d19-4e87-b3ef-4c135ecb85b4\" (UID: \"663ff04e-6d19-4e87-b3ef-4c135ecb85b4\") "
Jul 15 16:03:02.194189 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:02.193949    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/663ff04e-6d19-4e87-b3ef-4c135ecb85b4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "663ff04e-6d19-4e87-b3ef-4c135ecb85b4" (UID: "663ff04e-6d19-4e87-b3ef-4c135ecb85b4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:03:02.194189 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:02.193959    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/663ff04e-6d19-4e87-b3ef-4c135ecb85b4-istio-envoy\") pod \"663ff04e-6d19-4e87-b3ef-4c135ecb85b4\" (UID: \"663ff04e-6d19-4e87-b3ef-4c135ecb85b4\") "
Jul 15 16:03:02.194403 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:02.194272    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/663ff04e-6d19-4e87-b3ef-4c135ecb85b4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "663ff04e-6d19-4e87-b3ef-4c135ecb85b4" (UID: "663ff04e-6d19-4e87-b3ef-4c135ecb85b4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 16:03:02.194403 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:02.194339    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/663ff04e-6d19-4e87-b3ef-4c135ecb85b4-workload-socket\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 16:03:02.194403 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:02.194359    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/663ff04e-6d19-4e87-b3ef-4c135ecb85b4-workload-certs\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 16:03:02.194403 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:02.194373    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/663ff04e-6d19-4e87-b3ef-4c135ecb85b4-credential-socket\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 16:03:02.194695 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:02.194643    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/663ff04e-6d19-4e87-b3ef-4c135ecb85b4-istio-data" (OuterVolumeSpecName: "istio-data") pod "663ff04e-6d19-4e87-b3ef-4c135ecb85b4" (UID: "663ff04e-6d19-4e87-b3ef-4c135ecb85b4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:03:02.196118 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:02.196083    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/663ff04e-6d19-4e87-b3ef-4c135ecb85b4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "663ff04e-6d19-4e87-b3ef-4c135ecb85b4" (UID: "663ff04e-6d19-4e87-b3ef-4c135ecb85b4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 16:03:02.196213 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:02.196118    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/663ff04e-6d19-4e87-b3ef-4c135ecb85b4-kube-api-access-nmllr" (OuterVolumeSpecName: "kube-api-access-nmllr") pod "663ff04e-6d19-4e87-b3ef-4c135ecb85b4" (UID: "663ff04e-6d19-4e87-b3ef-4c135ecb85b4"). InnerVolumeSpecName "kube-api-access-nmllr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:03:02.196337 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:02.196315    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/663ff04e-6d19-4e87-b3ef-4c135ecb85b4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "663ff04e-6d19-4e87-b3ef-4c135ecb85b4" (UID: "663ff04e-6d19-4e87-b3ef-4c135ecb85b4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:03:02.196400 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:02.196327    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/663ff04e-6d19-4e87-b3ef-4c135ecb85b4-istio-token" (OuterVolumeSpecName: "istio-token") pod "663ff04e-6d19-4e87-b3ef-4c135ecb85b4" (UID: "663ff04e-6d19-4e87-b3ef-4c135ecb85b4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:03:02.295202 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:02.295179    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nmllr\" (UniqueName: \"kubernetes.io/projected/663ff04e-6d19-4e87-b3ef-4c135ecb85b4-kube-api-access-nmllr\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 16:03:02.295202 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:02.295201    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/663ff04e-6d19-4e87-b3ef-4c135ecb85b4-istio-token\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 16:03:02.295336 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:02.295210    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/663ff04e-6d19-4e87-b3ef-4c135ecb85b4-istiod-ca-cert\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 16:03:02.295336 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:02.295218    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/663ff04e-6d19-4e87-b3ef-4c135ecb85b4-istio-podinfo\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 16:03:02.295336 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:02.295226    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/663ff04e-6d19-4e87-b3ef-4c135ecb85b4-istio-envoy\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 16:03:02.295336 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:02.295233    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/663ff04e-6d19-4e87-b3ef-4c135ecb85b4-istio-data\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 16:03:02.519977 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:02.519942    2564 generic.go:356] "Generic (PLEG): container finished" podID="663ff04e-6d19-4e87-b3ef-4c135ecb85b4" containerID="3c95233e33abc90951eaef43f801fcdb3e54e668764eea3b74ad635f15879904" exitCode=0
Jul 15 16:03:02.520156 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:02.519989    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm"
Jul 15 16:03:02.520156 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:02.520002    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm" event={"ID":"663ff04e-6d19-4e87-b3ef-4c135ecb85b4","Type":"ContainerDied","Data":"3c95233e33abc90951eaef43f801fcdb3e54e668764eea3b74ad635f15879904"}
Jul 15 16:03:02.520156 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:02.520066    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm" event={"ID":"663ff04e-6d19-4e87-b3ef-4c135ecb85b4","Type":"ContainerDied","Data":"b2999254bce3fa9cbc1a414b6eef8b8a98303e8df4fdc440468c3a2ce6bd6ac2"}
Jul 15 16:03:02.520156 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:02.520089    2564 scope.go:117] "RemoveContainer" containerID="3c95233e33abc90951eaef43f801fcdb3e54e668764eea3b74ad635f15879904"
Jul 15 16:03:02.528831 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:02.528815    2564 scope.go:117] "RemoveContainer" containerID="44842ade02a33881c19964acd49cb0537a0efd5be621cff0ea1b135011d7770e"
Jul 15 16:03:02.536538 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:02.536514    2564 scope.go:117] "RemoveContainer" containerID="3c95233e33abc90951eaef43f801fcdb3e54e668764eea3b74ad635f15879904"
Jul 15 16:03:02.536951 ip-10-0-138-107 kubenswrapper[2564]: E0715 16:03:02.536925    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c95233e33abc90951eaef43f801fcdb3e54e668764eea3b74ad635f15879904\": container with ID starting with 3c95233e33abc90951eaef43f801fcdb3e54e668764eea3b74ad635f15879904 not found: ID does not exist" containerID="3c95233e33abc90951eaef43f801fcdb3e54e668764eea3b74ad635f15879904"
Jul 15 16:03:02.537119 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:02.536963    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c95233e33abc90951eaef43f801fcdb3e54e668764eea3b74ad635f15879904"} err="failed to get container status \"3c95233e33abc90951eaef43f801fcdb3e54e668764eea3b74ad635f15879904\": rpc error: code = NotFound desc = could not find container \"3c95233e33abc90951eaef43f801fcdb3e54e668764eea3b74ad635f15879904\": container with ID starting with 3c95233e33abc90951eaef43f801fcdb3e54e668764eea3b74ad635f15879904 not found: ID does not exist"
Jul 15 16:03:02.537119 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:02.536989    2564 scope.go:117] "RemoveContainer" containerID="44842ade02a33881c19964acd49cb0537a0efd5be621cff0ea1b135011d7770e"
Jul 15 16:03:02.537341 ip-10-0-138-107 kubenswrapper[2564]: E0715 16:03:02.537301    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44842ade02a33881c19964acd49cb0537a0efd5be621cff0ea1b135011d7770e\": container with ID starting with 44842ade02a33881c19964acd49cb0537a0efd5be621cff0ea1b135011d7770e not found: ID does not exist" containerID="44842ade02a33881c19964acd49cb0537a0efd5be621cff0ea1b135011d7770e"
Jul 15 16:03:02.537417 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:02.537335    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44842ade02a33881c19964acd49cb0537a0efd5be621cff0ea1b135011d7770e"} err="failed to get container status \"44842ade02a33881c19964acd49cb0537a0efd5be621cff0ea1b135011d7770e\": rpc error: code = NotFound desc = could not find container \"44842ade02a33881c19964acd49cb0537a0efd5be621cff0ea1b135011d7770e\": container with ID starting with 44842ade02a33881c19964acd49cb0537a0efd5be621cff0ea1b135011d7770e not found: ID does not exist"
Jul 15 16:03:02.539434 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:02.539415    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm"]
Jul 15 16:03:02.545144 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:02.545125    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-a920e4-openshift-default-78bc74f875-kvqmm"]
Jul 15 16:03:04.229983 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:04.229949    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="663ff04e-6d19-4e87-b3ef-4c135ecb85b4" path="/var/lib/kubelet/pods/663ff04e-6d19-4e87-b3ef-4c135ecb85b4/volumes"
Jul 15 16:03:07.746865 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:07.746835    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:03:12.336333 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:12.336291    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:03:18.644757 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:18.644719    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:03:18.752816 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:18.752776    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:03:23.029662 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:23.029583    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk"]
Jul 15 16:03:23.029999 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:23.029871    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk" podUID="9cf123c8-1752-4bca-8855-97842553c4e8" containerName="istio-proxy" containerID="cri-o://de31949e376133ac309146cfe0c53442a8bdae905d433cb4d868abe6a304a1ac" gracePeriod=30
Jul 15 16:03:23.070232 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:23.070199    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:03:23.303538 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:23.303454    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:03:23.432837 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:23.432806    2564 patch_prober.go:28] interesting pod/e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 15 16:03:23.432969 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:23.432864    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk" podUID="9cf123c8-1752-4bca-8855-97842553c4e8" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 16:03:23.667841 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:23.667753    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:03:23.968875 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:23.968806    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-097eff-openshift-default-8569997db5-pdkd2"]
Jul 15 16:03:23.969220 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:23.969206    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="663ff04e-6d19-4e87-b3ef-4c135ecb85b4" containerName="istio-proxy"
Jul 15 16:03:23.969271 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:23.969222    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="663ff04e-6d19-4e87-b3ef-4c135ecb85b4" containerName="istio-proxy"
Jul 15 16:03:23.969311 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:23.969300    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="663ff04e-6d19-4e87-b3ef-4c135ecb85b4" containerName="istio-proxy"
Jul 15 16:03:23.969311 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:23.969310    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="663ff04e-6d19-4e87-b3ef-4c135ecb85b4" containerName="istio-proxy"
Jul 15 16:03:23.972199 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:23.972183    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-097eff-openshift-default-8569997db5-pdkd2"
Jul 15 16:03:23.976254 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:23.976233    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-097eff-openshift-default-dockercfg-ngdj5\""
Jul 15 16:03:23.989088 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:23.989059    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-097eff-openshift-default-8569997db5-pdkd2"]
Jul 15 16:03:24.029374 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:24.029350    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:03:24.084817 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:24.084784    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/695dc504-f5c8-48fe-9933-b283b28803f5-credential-socket\") pod \"e2e-api-a-097eff-openshift-default-8569997db5-pdkd2\" (UID: \"695dc504-f5c8-48fe-9933-b283b28803f5\") " pod="openshift-ingress/e2e-api-a-097eff-openshift-default-8569997db5-pdkd2"
Jul 15 16:03:24.085272 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:24.084902    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/695dc504-f5c8-48fe-9933-b283b28803f5-istio-envoy\") pod \"e2e-api-a-097eff-openshift-default-8569997db5-pdkd2\" (UID: \"695dc504-f5c8-48fe-9933-b283b28803f5\") " pod="openshift-ingress/e2e-api-a-097eff-openshift-default-8569997db5-pdkd2"
Jul 15 16:03:24.085272 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:24.084942    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/695dc504-f5c8-48fe-9933-b283b28803f5-istio-data\") pod \"e2e-api-a-097eff-openshift-default-8569997db5-pdkd2\" (UID: \"695dc504-f5c8-48fe-9933-b283b28803f5\") " pod="openshift-ingress/e2e-api-a-097eff-openshift-default-8569997db5-pdkd2"
Jul 15 16:03:24.085272 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:24.084983    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/695dc504-f5c8-48fe-9933-b283b28803f5-workload-socket\") pod \"e2e-api-a-097eff-openshift-default-8569997db5-pdkd2\" (UID: \"695dc504-f5c8-48fe-9933-b283b28803f5\") " pod="openshift-ingress/e2e-api-a-097eff-openshift-default-8569997db5-pdkd2"
Jul 15 16:03:24.085272 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:24.085063    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/695dc504-f5c8-48fe-9933-b283b28803f5-istiod-ca-cert\") pod \"e2e-api-a-097eff-openshift-default-8569997db5-pdkd2\" (UID: \"695dc504-f5c8-48fe-9933-b283b28803f5\") " pod="openshift-ingress/e2e-api-a-097eff-openshift-default-8569997db5-pdkd2"
Jul 15 16:03:24.085272 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:24.085105    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/695dc504-f5c8-48fe-9933-b283b28803f5-istio-podinfo\") pod \"e2e-api-a-097eff-openshift-default-8569997db5-pdkd2\" (UID: \"695dc504-f5c8-48fe-9933-b283b28803f5\") " pod="openshift-ingress/e2e-api-a-097eff-openshift-default-8569997db5-pdkd2"
Jul 15 16:03:24.085272 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:24.085129    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/695dc504-f5c8-48fe-9933-b283b28803f5-istio-token\") pod \"e2e-api-a-097eff-openshift-default-8569997db5-pdkd2\" (UID: \"695dc504-f5c8-48fe-9933-b283b28803f5\") " pod="openshift-ingress/e2e-api-a-097eff-openshift-default-8569997db5-pdkd2"
Jul 15 16:03:24.085272 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:24.085156    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/695dc504-f5c8-48fe-9933-b283b28803f5-workload-certs\") pod \"e2e-api-a-097eff-openshift-default-8569997db5-pdkd2\" (UID: \"695dc504-f5c8-48fe-9933-b283b28803f5\") " pod="openshift-ingress/e2e-api-a-097eff-openshift-default-8569997db5-pdkd2"
Jul 15 16:03:24.085272 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:24.085241    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tj2n4\" (UniqueName: \"kubernetes.io/projected/695dc504-f5c8-48fe-9933-b283b28803f5-kube-api-access-tj2n4\") pod \"e2e-api-a-097eff-openshift-default-8569997db5-pdkd2\" (UID: \"695dc504-f5c8-48fe-9933-b283b28803f5\") " pod="openshift-ingress/e2e-api-a-097eff-openshift-default-8569997db5-pdkd2"
Jul 15 16:03:24.186212 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:24.186187    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/695dc504-f5c8-48fe-9933-b283b28803f5-istio-envoy\") pod \"e2e-api-a-097eff-openshift-default-8569997db5-pdkd2\" (UID: \"695dc504-f5c8-48fe-9933-b283b28803f5\") " pod="openshift-ingress/e2e-api-a-097eff-openshift-default-8569997db5-pdkd2"
Jul 15 16:03:24.186354 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:24.186217    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/695dc504-f5c8-48fe-9933-b283b28803f5-istio-data\") pod \"e2e-api-a-097eff-openshift-default-8569997db5-pdkd2\" (UID: \"695dc504-f5c8-48fe-9933-b283b28803f5\") " pod="openshift-ingress/e2e-api-a-097eff-openshift-default-8569997db5-pdkd2"
Jul 15 16:03:24.186354 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:24.186240    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/695dc504-f5c8-48fe-9933-b283b28803f5-workload-socket\") pod \"e2e-api-a-097eff-openshift-default-8569997db5-pdkd2\" (UID: \"695dc504-f5c8-48fe-9933-b283b28803f5\") " pod="openshift-ingress/e2e-api-a-097eff-openshift-default-8569997db5-pdkd2"
Jul 15 16:03:24.186354 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:24.186258    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/695dc504-f5c8-48fe-9933-b283b28803f5-istiod-ca-cert\") pod \"e2e-api-a-097eff-openshift-default-8569997db5-pdkd2\" (UID: \"695dc504-f5c8-48fe-9933-b283b28803f5\") " pod="openshift-ingress/e2e-api-a-097eff-openshift-default-8569997db5-pdkd2"
Jul 15 16:03:24.186477 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:24.186391    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/695dc504-f5c8-48fe-9933-b283b28803f5-istio-podinfo\") pod \"e2e-api-a-097eff-openshift-default-8569997db5-pdkd2\" (UID: \"695dc504-f5c8-48fe-9933-b283b28803f5\") " pod="openshift-ingress/e2e-api-a-097eff-openshift-default-8569997db5-pdkd2"
Jul 15 16:03:24.186477 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:24.186434    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/695dc504-f5c8-48fe-9933-b283b28803f5-istio-token\") pod \"e2e-api-a-097eff-openshift-default-8569997db5-pdkd2\" (UID: \"695dc504-f5c8-48fe-9933-b283b28803f5\") " pod="openshift-ingress/e2e-api-a-097eff-openshift-default-8569997db5-pdkd2"
Jul 15 16:03:24.186477 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:24.186473    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/695dc504-f5c8-48fe-9933-b283b28803f5-workload-certs\") pod \"e2e-api-a-097eff-openshift-default-8569997db5-pdkd2\" (UID: \"695dc504-f5c8-48fe-9933-b283b28803f5\") " pod="openshift-ingress/e2e-api-a-097eff-openshift-default-8569997db5-pdkd2"
Jul 15 16:03:24.186630 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:24.186526    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tj2n4\" (UniqueName: \"kubernetes.io/projected/695dc504-f5c8-48fe-9933-b283b28803f5-kube-api-access-tj2n4\") pod \"e2e-api-a-097eff-openshift-default-8569997db5-pdkd2\" (UID: \"695dc504-f5c8-48fe-9933-b283b28803f5\") " pod="openshift-ingress/e2e-api-a-097eff-openshift-default-8569997db5-pdkd2"
Jul 15 16:03:24.186630 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:24.186589    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/695dc504-f5c8-48fe-9933-b283b28803f5-credential-socket\") pod \"e2e-api-a-097eff-openshift-default-8569997db5-pdkd2\" (UID: \"695dc504-f5c8-48fe-9933-b283b28803f5\") " pod="openshift-ingress/e2e-api-a-097eff-openshift-default-8569997db5-pdkd2"
Jul 15 16:03:24.186739 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:24.186668    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/695dc504-f5c8-48fe-9933-b283b28803f5-workload-socket\") pod \"e2e-api-a-097eff-openshift-default-8569997db5-pdkd2\" (UID: \"695dc504-f5c8-48fe-9933-b283b28803f5\") " pod="openshift-ingress/e2e-api-a-097eff-openshift-default-8569997db5-pdkd2"
Jul 15 16:03:24.186928 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:24.186902    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/695dc504-f5c8-48fe-9933-b283b28803f5-istiod-ca-cert\") pod \"e2e-api-a-097eff-openshift-default-8569997db5-pdkd2\" (UID: \"695dc504-f5c8-48fe-9933-b283b28803f5\") " pod="openshift-ingress/e2e-api-a-097eff-openshift-default-8569997db5-pdkd2"
Jul 15 16:03:24.187070 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:24.186941    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/695dc504-f5c8-48fe-9933-b283b28803f5-istio-data\") pod \"e2e-api-a-097eff-openshift-default-8569997db5-pdkd2\" (UID: \"695dc504-f5c8-48fe-9933-b283b28803f5\") " pod="openshift-ingress/e2e-api-a-097eff-openshift-default-8569997db5-pdkd2"
Jul 15 16:03:24.187128 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:24.187091    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/695dc504-f5c8-48fe-9933-b283b28803f5-workload-certs\") pod \"e2e-api-a-097eff-openshift-default-8569997db5-pdkd2\" (UID: \"695dc504-f5c8-48fe-9933-b283b28803f5\") " pod="openshift-ingress/e2e-api-a-097eff-openshift-default-8569997db5-pdkd2"
Jul 15 16:03:24.187178 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:24.187147    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/695dc504-f5c8-48fe-9933-b283b28803f5-credential-socket\") pod \"e2e-api-a-097eff-openshift-default-8569997db5-pdkd2\" (UID: \"695dc504-f5c8-48fe-9933-b283b28803f5\") " pod="openshift-ingress/e2e-api-a-097eff-openshift-default-8569997db5-pdkd2"
Jul 15 16:03:24.188585 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:24.188569    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/695dc504-f5c8-48fe-9933-b283b28803f5-istio-envoy\") pod \"e2e-api-a-097eff-openshift-default-8569997db5-pdkd2\" (UID: \"695dc504-f5c8-48fe-9933-b283b28803f5\") " pod="openshift-ingress/e2e-api-a-097eff-openshift-default-8569997db5-pdkd2"
Jul 15 16:03:24.188823 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:24.188802    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/695dc504-f5c8-48fe-9933-b283b28803f5-istio-podinfo\") pod \"e2e-api-a-097eff-openshift-default-8569997db5-pdkd2\" (UID: \"695dc504-f5c8-48fe-9933-b283b28803f5\") " pod="openshift-ingress/e2e-api-a-097eff-openshift-default-8569997db5-pdkd2"
Jul 15 16:03:24.209937 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:24.209919    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tj2n4\" (UniqueName: \"kubernetes.io/projected/695dc504-f5c8-48fe-9933-b283b28803f5-kube-api-access-tj2n4\") pod \"e2e-api-a-097eff-openshift-default-8569997db5-pdkd2\" (UID: \"695dc504-f5c8-48fe-9933-b283b28803f5\") " pod="openshift-ingress/e2e-api-a-097eff-openshift-default-8569997db5-pdkd2"
Jul 15 16:03:24.211404 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:24.211386    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/695dc504-f5c8-48fe-9933-b283b28803f5-istio-token\") pod \"e2e-api-a-097eff-openshift-default-8569997db5-pdkd2\" (UID: \"695dc504-f5c8-48fe-9933-b283b28803f5\") " pod="openshift-ingress/e2e-api-a-097eff-openshift-default-8569997db5-pdkd2"
Jul 15 16:03:24.282487 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:24.282444    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-097eff-openshift-default-8569997db5-pdkd2"
Jul 15 16:03:24.302209 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:24.302174    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:03:24.420677 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:24.420655    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-097eff-openshift-default-8569997db5-pdkd2"]
Jul 15 16:03:24.422641 ip-10-0-138-107 kubenswrapper[2564]: W0715 16:03:24.422615    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod695dc504_f5c8_48fe_9933_b283b28803f5.slice/crio-a77c754e5330322538aa583e7602c00f290f7779fdd117d045270498c9af4502 WatchSource:0}: Error finding container a77c754e5330322538aa583e7602c00f290f7779fdd117d045270498c9af4502: Status 404 returned error can't find the container with id a77c754e5330322538aa583e7602c00f290f7779fdd117d045270498c9af4502
Jul 15 16:03:24.424664 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:24.424632    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:03:24.424720 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:24.424696    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:03:24.424760 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:24.424729    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:03:24.622460 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:24.622380    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-097eff-openshift-default-8569997db5-pdkd2" event={"ID":"695dc504-f5c8-48fe-9933-b283b28803f5","Type":"ContainerStarted","Data":"c61bae8fbbb2aa7ba66ee2a6ea5ef5bfe5e46e3101fb73982f1ec449efcb1b67"}
Jul 15 16:03:24.622460 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:24.622440    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-097eff-openshift-default-8569997db5-pdkd2" event={"ID":"695dc504-f5c8-48fe-9933-b283b28803f5","Type":"ContainerStarted","Data":"a77c754e5330322538aa583e7602c00f290f7779fdd117d045270498c9af4502"}
Jul 15 16:03:24.648912 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:24.648868    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-097eff-openshift-default-8569997db5-pdkd2" podStartSLOduration=1.648852957 podStartE2EDuration="1.648852957s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:03:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:03:24.645946256 +0000 UTC m=+2334.991849449" watchObservedRunningTime="2026-07-15 16:03:24.648852957 +0000 UTC m=+2334.994756149"
Jul 15 16:03:25.282780 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:25.282736    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-097eff-openshift-default-8569997db5-pdkd2"
Jul 15 16:03:25.288026 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:25.287991    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-097eff-openshift-default-8569997db5-pdkd2"
Jul 15 16:03:25.627718 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:25.627634    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-097eff-openshift-default-8569997db5-pdkd2"
Jul 15 16:03:25.628442 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:25.628423    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-097eff-openshift-default-8569997db5-pdkd2"
Jul 15 16:03:27.464625 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:27.464576    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:03:27.553753 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:27.553719    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:03:27.633195 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:27.633161    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:03:27.846868 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:27.846834    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:03:28.288198 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:28.288175    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk"
Jul 15 16:03:28.327714 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:28.327688    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:03:28.421969 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:28.421900    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p67r5\" (UniqueName: \"kubernetes.io/projected/9cf123c8-1752-4bca-8855-97842553c4e8-kube-api-access-p67r5\") pod \"9cf123c8-1752-4bca-8855-97842553c4e8\" (UID: \"9cf123c8-1752-4bca-8855-97842553c4e8\") "
Jul 15 16:03:28.421969 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:28.421940    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9cf123c8-1752-4bca-8855-97842553c4e8-istiod-ca-cert\") pod \"9cf123c8-1752-4bca-8855-97842553c4e8\" (UID: \"9cf123c8-1752-4bca-8855-97842553c4e8\") "
Jul 15 16:03:28.422171 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:28.421978    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9cf123c8-1752-4bca-8855-97842553c4e8-istio-data\") pod \"9cf123c8-1752-4bca-8855-97842553c4e8\" (UID: \"9cf123c8-1752-4bca-8855-97842553c4e8\") "
Jul 15 16:03:28.422171 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:28.422004    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cf123c8-1752-4bca-8855-97842553c4e8-credential-socket\") pod \"9cf123c8-1752-4bca-8855-97842553c4e8\" (UID: \"9cf123c8-1752-4bca-8855-97842553c4e8\") "
Jul 15 16:03:28.422171 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:28.422063    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9cf123c8-1752-4bca-8855-97842553c4e8-istio-token\") pod \"9cf123c8-1752-4bca-8855-97842553c4e8\" (UID: \"9cf123c8-1752-4bca-8855-97842553c4e8\") "
Jul 15 16:03:28.422324 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:28.422181    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9cf123c8-1752-4bca-8855-97842553c4e8-workload-certs\") pod \"9cf123c8-1752-4bca-8855-97842553c4e8\" (UID: \"9cf123c8-1752-4bca-8855-97842553c4e8\") "
Jul 15 16:03:28.422324 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:28.422228    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cf123c8-1752-4bca-8855-97842553c4e8-workload-socket\") pod \"9cf123c8-1752-4bca-8855-97842553c4e8\" (UID: \"9cf123c8-1752-4bca-8855-97842553c4e8\") "
Jul 15 16:03:28.422324 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:28.422266    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9cf123c8-1752-4bca-8855-97842553c4e8-istio-podinfo\") pod \"9cf123c8-1752-4bca-8855-97842553c4e8\" (UID: \"9cf123c8-1752-4bca-8855-97842553c4e8\") "
Jul 15 16:03:28.422324 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:28.422306    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9cf123c8-1752-4bca-8855-97842553c4e8-istio-envoy\") pod \"9cf123c8-1752-4bca-8855-97842553c4e8\" (UID: \"9cf123c8-1752-4bca-8855-97842553c4e8\") "
Jul 15 16:03:28.422523 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:28.422414    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cf123c8-1752-4bca-8855-97842553c4e8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9cf123c8-1752-4bca-8855-97842553c4e8" (UID: "9cf123c8-1752-4bca-8855-97842553c4e8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:03:28.422523 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:28.422469    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cf123c8-1752-4bca-8855-97842553c4e8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9cf123c8-1752-4bca-8855-97842553c4e8" (UID: "9cf123c8-1752-4bca-8855-97842553c4e8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:03:28.422523 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:28.422513    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9cf123c8-1752-4bca-8855-97842553c4e8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9cf123c8-1752-4bca-8855-97842553c4e8" (UID: "9cf123c8-1752-4bca-8855-97842553c4e8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 16:03:28.422772 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:28.422747    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cf123c8-1752-4bca-8855-97842553c4e8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9cf123c8-1752-4bca-8855-97842553c4e8" (UID: "9cf123c8-1752-4bca-8855-97842553c4e8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:03:28.422858 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:28.422760    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9cf123c8-1752-4bca-8855-97842553c4e8-istiod-ca-cert\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 16:03:28.422858 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:28.422795    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cf123c8-1752-4bca-8855-97842553c4e8-credential-socket\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 16:03:28.422858 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:28.422812    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9cf123c8-1752-4bca-8855-97842553c4e8-workload-certs\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 16:03:28.423003 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:28.422978    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cf123c8-1752-4bca-8855-97842553c4e8-istio-data" (OuterVolumeSpecName: "istio-data") pod "9cf123c8-1752-4bca-8855-97842553c4e8" (UID: "9cf123c8-1752-4bca-8855-97842553c4e8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:03:28.424280 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:28.424261    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9cf123c8-1752-4bca-8855-97842553c4e8-kube-api-access-p67r5" (OuterVolumeSpecName: "kube-api-access-p67r5") pod "9cf123c8-1752-4bca-8855-97842553c4e8" (UID: "9cf123c8-1752-4bca-8855-97842553c4e8"). InnerVolumeSpecName "kube-api-access-p67r5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:03:28.424349 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:28.424282    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9cf123c8-1752-4bca-8855-97842553c4e8-istio-token" (OuterVolumeSpecName: "istio-token") pod "9cf123c8-1752-4bca-8855-97842553c4e8" (UID: "9cf123c8-1752-4bca-8855-97842553c4e8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:03:28.424794 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:28.424775    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cf123c8-1752-4bca-8855-97842553c4e8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9cf123c8-1752-4bca-8855-97842553c4e8" (UID: "9cf123c8-1752-4bca-8855-97842553c4e8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:03:28.424794 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:28.424786    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9cf123c8-1752-4bca-8855-97842553c4e8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9cf123c8-1752-4bca-8855-97842553c4e8" (UID: "9cf123c8-1752-4bca-8855-97842553c4e8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 16:03:28.427436 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:28.427409    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:03:28.524209 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:28.524180    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cf123c8-1752-4bca-8855-97842553c4e8-workload-socket\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 16:03:28.524209 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:28.524206    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9cf123c8-1752-4bca-8855-97842553c4e8-istio-podinfo\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 16:03:28.524599 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:28.524217    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9cf123c8-1752-4bca-8855-97842553c4e8-istio-envoy\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 16:03:28.524599 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:28.524226    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p67r5\" (UniqueName: \"kubernetes.io/projected/9cf123c8-1752-4bca-8855-97842553c4e8-kube-api-access-p67r5\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 16:03:28.524599 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:28.524236    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9cf123c8-1752-4bca-8855-97842553c4e8-istio-data\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 16:03:28.524599 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:28.524244    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9cf123c8-1752-4bca-8855-97842553c4e8-istio-token\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 16:03:28.644984 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:28.644949    2564 generic.go:356] "Generic (PLEG): container finished" podID="9cf123c8-1752-4bca-8855-97842553c4e8" containerID="de31949e376133ac309146cfe0c53442a8bdae905d433cb4d868abe6a304a1ac" exitCode=0
Jul 15 16:03:28.645191 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:28.645035    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk"
Jul 15 16:03:28.645191 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:28.645037    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk" event={"ID":"9cf123c8-1752-4bca-8855-97842553c4e8","Type":"ContainerDied","Data":"de31949e376133ac309146cfe0c53442a8bdae905d433cb4d868abe6a304a1ac"}
Jul 15 16:03:28.645191 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:28.645095    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk" event={"ID":"9cf123c8-1752-4bca-8855-97842553c4e8","Type":"ContainerDied","Data":"6bcceb1268f78c630dc2b6952a7ca570f2e04c54f35871fc6630f2b150c7ca96"}
Jul 15 16:03:28.645191 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:28.645118    2564 scope.go:117] "RemoveContainer" containerID="de31949e376133ac309146cfe0c53442a8bdae905d433cb4d868abe6a304a1ac"
Jul 15 16:03:28.656223 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:28.656205    2564 scope.go:117] "RemoveContainer" containerID="eebd450b26eb588b483d06d743671c4762e5b44566e46f40a804493b95bdbdbe"
Jul 15 16:03:28.664232 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:28.664196    2564 scope.go:117] "RemoveContainer" containerID="de31949e376133ac309146cfe0c53442a8bdae905d433cb4d868abe6a304a1ac"
Jul 15 16:03:28.664444 ip-10-0-138-107 kubenswrapper[2564]: E0715 16:03:28.664428    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de31949e376133ac309146cfe0c53442a8bdae905d433cb4d868abe6a304a1ac\": container with ID starting with de31949e376133ac309146cfe0c53442a8bdae905d433cb4d868abe6a304a1ac not found: ID does not exist" containerID="de31949e376133ac309146cfe0c53442a8bdae905d433cb4d868abe6a304a1ac"
Jul 15 16:03:28.664489 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:28.664451    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de31949e376133ac309146cfe0c53442a8bdae905d433cb4d868abe6a304a1ac"} err="failed to get container status \"de31949e376133ac309146cfe0c53442a8bdae905d433cb4d868abe6a304a1ac\": rpc error: code = NotFound desc = could not find container \"de31949e376133ac309146cfe0c53442a8bdae905d433cb4d868abe6a304a1ac\": container with ID starting with de31949e376133ac309146cfe0c53442a8bdae905d433cb4d868abe6a304a1ac not found: ID does not exist"
Jul 15 16:03:28.664489 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:28.664467    2564 scope.go:117] "RemoveContainer" containerID="eebd450b26eb588b483d06d743671c4762e5b44566e46f40a804493b95bdbdbe"
Jul 15 16:03:28.664697 ip-10-0-138-107 kubenswrapper[2564]: E0715 16:03:28.664682    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eebd450b26eb588b483d06d743671c4762e5b44566e46f40a804493b95bdbdbe\": container with ID starting with eebd450b26eb588b483d06d743671c4762e5b44566e46f40a804493b95bdbdbe not found: ID does not exist" containerID="eebd450b26eb588b483d06d743671c4762e5b44566e46f40a804493b95bdbdbe"
Jul 15 16:03:28.664742 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:28.664700    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eebd450b26eb588b483d06d743671c4762e5b44566e46f40a804493b95bdbdbe"} err="failed to get container status \"eebd450b26eb588b483d06d743671c4762e5b44566e46f40a804493b95bdbdbe\": rpc error: code = NotFound desc = could not find container \"eebd450b26eb588b483d06d743671c4762e5b44566e46f40a804493b95bdbdbe\": container with ID starting with eebd450b26eb588b483d06d743671c4762e5b44566e46f40a804493b95bdbdbe not found: ID does not exist"
Jul 15 16:03:28.669186 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:28.669139    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk"]
Jul 15 16:03:28.671523 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:28.671499    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-89ce7e-openshift-default-7897b75cd9-qwzhk"]
Jul 15 16:03:30.230568 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:30.230537    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9cf123c8-1752-4bca-8855-97842553c4e8" path="/var/lib/kubelet/pods/9cf123c8-1752-4bca-8855-97842553c4e8/volumes"
Jul 15 16:03:32.863170 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:32.863127    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:03:34.579281 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:34.579242    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:03:34.652609 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:34.652580    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:03:37.802246 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:37.802212    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:03:38.973225 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:38.973185    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:03:39.101463 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:39.101428    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:03:39.704214 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:39.704180    2564 generic.go:356] "Generic (PLEG): container finished" podID="695dc504-f5c8-48fe-9933-b283b28803f5" containerID="c61bae8fbbb2aa7ba66ee2a6ea5ef5bfe5e46e3101fb73982f1ec449efcb1b67" exitCode=0
Jul 15 16:03:39.704402 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:39.704257    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-097eff-openshift-default-8569997db5-pdkd2" event={"ID":"695dc504-f5c8-48fe-9933-b283b28803f5","Type":"ContainerDied","Data":"c61bae8fbbb2aa7ba66ee2a6ea5ef5bfe5e46e3101fb73982f1ec449efcb1b67"}
Jul 15 16:03:39.704674 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:39.704657    2564 scope.go:117] "RemoveContainer" containerID="c61bae8fbbb2aa7ba66ee2a6ea5ef5bfe5e46e3101fb73982f1ec449efcb1b67"
Jul 15 16:03:39.705644 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:39.705615    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:03:39.705747 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:39.705681    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:03:39.705798 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:39.705718    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:03:40.627569 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:40.627529    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-097eff-openshift-default-8569997db5-pdkd2"
Jul 15 16:03:40.710464 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:40.710430    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-097eff-openshift-default-8569997db5-pdkd2" event={"ID":"695dc504-f5c8-48fe-9933-b283b28803f5","Type":"ContainerStarted","Data":"19b892a5fee9399278398f7b6b2c57d6efb75658322e5947335966f363f1180e"}
Jul 15 16:03:41.282766 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:41.282721    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-097eff-openshift-default-8569997db5-pdkd2"
Jul 15 16:03:41.283735 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:41.283707    2564 patch_prober.go:28] interesting pod/e2e-api-a-097eff-openshift-default-8569997db5-pdkd2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 15 16:03:41.283864 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:41.283757    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-097eff-openshift-default-8569997db5-pdkd2" podUID="695dc504-f5c8-48fe-9933-b283b28803f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 15 16:03:42.217819 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:42.217786    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:03:42.283595 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:42.283552    2564 patch_prober.go:28] interesting pod/e2e-api-a-097eff-openshift-default-8569997db5-pdkd2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 15 16:03:42.283765 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:42.283630    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-097eff-openshift-default-8569997db5-pdkd2" podUID="695dc504-f5c8-48fe-9933-b283b28803f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 15 16:03:43.283644 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:43.283603    2564 patch_prober.go:28] interesting pod/e2e-api-a-097eff-openshift-default-8569997db5-pdkd2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 15 16:03:43.284167 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:43.283669    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-097eff-openshift-default-8569997db5-pdkd2" podUID="695dc504-f5c8-48fe-9933-b283b28803f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 15 16:03:44.283567 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:44.283521    2564 patch_prober.go:28] interesting pod/e2e-api-a-097eff-openshift-default-8569997db5-pdkd2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 15 16:03:44.283780 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:44.283579    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-097eff-openshift-default-8569997db5-pdkd2" podUID="695dc504-f5c8-48fe-9933-b283b28803f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 15 16:03:45.287750 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:45.287718    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-097eff-openshift-default-8569997db5-pdkd2"
Jul 15 16:03:45.288162 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:45.288087    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-097eff-openshift-default-8569997db5-pdkd2"
Jul 15 16:03:45.288815 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:45.288797    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-097eff-openshift-default-8569997db5-pdkd2"
Jul 15 16:03:47.470048 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:47.469986    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:03:47.571000 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:47.570962    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:03:49.200068 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:49.200033    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:03:50.506138 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:50.506103    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:03:50.605772 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:50.605721    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:03:59.864441 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:59.864372    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:03:59.968838 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:03:59.968812    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:04:00.708306 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:00.708277    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:04:07.943025 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:07.942983    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:04:11.201296 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:11.201259    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:04:11.280693 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:11.280654    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:04:16.050738 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:16.050704    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-097eff-openshift-default-8569997db5-pdkd2"]
Jul 15 16:04:16.051244 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:16.051032    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-097eff-openshift-default-8569997db5-pdkd2" podUID="695dc504-f5c8-48fe-9933-b283b28803f5" containerName="istio-proxy" containerID="cri-o://19b892a5fee9399278398f7b6b2c57d6efb75658322e5947335966f363f1180e" gracePeriod=30
Jul 15 16:04:16.073349 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:16.073308    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:04:16.304161 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:16.304074    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:04:21.307829 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:21.307808    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-097eff-openshift-default-8569997db5-pdkd2"
Jul 15 16:04:21.411397 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:21.411338    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/695dc504-f5c8-48fe-9933-b283b28803f5-istio-data\") pod \"695dc504-f5c8-48fe-9933-b283b28803f5\" (UID: \"695dc504-f5c8-48fe-9933-b283b28803f5\") "
Jul 15 16:04:21.411397 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:21.411370    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/695dc504-f5c8-48fe-9933-b283b28803f5-istiod-ca-cert\") pod \"695dc504-f5c8-48fe-9933-b283b28803f5\" (UID: \"695dc504-f5c8-48fe-9933-b283b28803f5\") "
Jul 15 16:04:21.411397 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:21.411389    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/695dc504-f5c8-48fe-9933-b283b28803f5-istio-token\") pod \"695dc504-f5c8-48fe-9933-b283b28803f5\" (UID: \"695dc504-f5c8-48fe-9933-b283b28803f5\") "
Jul 15 16:04:21.411611 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:21.411421    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/695dc504-f5c8-48fe-9933-b283b28803f5-istio-podinfo\") pod \"695dc504-f5c8-48fe-9933-b283b28803f5\" (UID: \"695dc504-f5c8-48fe-9933-b283b28803f5\") "
Jul 15 16:04:21.411611 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:21.411437    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/695dc504-f5c8-48fe-9933-b283b28803f5-workload-certs\") pod \"695dc504-f5c8-48fe-9933-b283b28803f5\" (UID: \"695dc504-f5c8-48fe-9933-b283b28803f5\") "
Jul 15 16:04:21.411611 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:21.411483    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/695dc504-f5c8-48fe-9933-b283b28803f5-credential-socket\") pod \"695dc504-f5c8-48fe-9933-b283b28803f5\" (UID: \"695dc504-f5c8-48fe-9933-b283b28803f5\") "
Jul 15 16:04:21.411611 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:21.411503    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tj2n4\" (UniqueName: \"kubernetes.io/projected/695dc504-f5c8-48fe-9933-b283b28803f5-kube-api-access-tj2n4\") pod \"695dc504-f5c8-48fe-9933-b283b28803f5\" (UID: \"695dc504-f5c8-48fe-9933-b283b28803f5\") "
Jul 15 16:04:21.411611 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:21.411522    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/695dc504-f5c8-48fe-9933-b283b28803f5-istio-envoy\") pod \"695dc504-f5c8-48fe-9933-b283b28803f5\" (UID: \"695dc504-f5c8-48fe-9933-b283b28803f5\") "
Jul 15 16:04:21.411862 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:21.411661    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/695dc504-f5c8-48fe-9933-b283b28803f5-workload-socket\") pod \"695dc504-f5c8-48fe-9933-b283b28803f5\" (UID: \"695dc504-f5c8-48fe-9933-b283b28803f5\") "
Jul 15 16:04:21.411862 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:21.411781    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/695dc504-f5c8-48fe-9933-b283b28803f5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "695dc504-f5c8-48fe-9933-b283b28803f5" (UID: "695dc504-f5c8-48fe-9933-b283b28803f5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:04:21.412079 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:21.412044    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/695dc504-f5c8-48fe-9933-b283b28803f5-workload-certs\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 16:04:21.412079 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:21.412047    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/695dc504-f5c8-48fe-9933-b283b28803f5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "695dc504-f5c8-48fe-9933-b283b28803f5" (UID: "695dc504-f5c8-48fe-9933-b283b28803f5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:04:21.412292 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:21.412088    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/695dc504-f5c8-48fe-9933-b283b28803f5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "695dc504-f5c8-48fe-9933-b283b28803f5" (UID: "695dc504-f5c8-48fe-9933-b283b28803f5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:04:21.412292 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:21.412146    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/695dc504-f5c8-48fe-9933-b283b28803f5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "695dc504-f5c8-48fe-9933-b283b28803f5" (UID: "695dc504-f5c8-48fe-9933-b283b28803f5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 16:04:21.412451 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:21.412421    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/695dc504-f5c8-48fe-9933-b283b28803f5-istio-data" (OuterVolumeSpecName: "istio-data") pod "695dc504-f5c8-48fe-9933-b283b28803f5" (UID: "695dc504-f5c8-48fe-9933-b283b28803f5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:04:21.413624 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:21.413602    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/695dc504-f5c8-48fe-9933-b283b28803f5-istio-token" (OuterVolumeSpecName: "istio-token") pod "695dc504-f5c8-48fe-9933-b283b28803f5" (UID: "695dc504-f5c8-48fe-9933-b283b28803f5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:04:21.413701 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:21.413665    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/695dc504-f5c8-48fe-9933-b283b28803f5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "695dc504-f5c8-48fe-9933-b283b28803f5" (UID: "695dc504-f5c8-48fe-9933-b283b28803f5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 16:04:21.413701 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:21.413677    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/695dc504-f5c8-48fe-9933-b283b28803f5-kube-api-access-tj2n4" (OuterVolumeSpecName: "kube-api-access-tj2n4") pod "695dc504-f5c8-48fe-9933-b283b28803f5" (UID: "695dc504-f5c8-48fe-9933-b283b28803f5"). InnerVolumeSpecName "kube-api-access-tj2n4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:04:21.413793 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:21.413779    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/695dc504-f5c8-48fe-9933-b283b28803f5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "695dc504-f5c8-48fe-9933-b283b28803f5" (UID: "695dc504-f5c8-48fe-9933-b283b28803f5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:04:21.512861 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:21.512829    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/695dc504-f5c8-48fe-9933-b283b28803f5-istio-data\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 16:04:21.512861 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:21.512857    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/695dc504-f5c8-48fe-9933-b283b28803f5-istiod-ca-cert\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 16:04:21.513077 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:21.512870    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/695dc504-f5c8-48fe-9933-b283b28803f5-istio-token\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 16:04:21.513077 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:21.512879    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/695dc504-f5c8-48fe-9933-b283b28803f5-istio-podinfo\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 16:04:21.513077 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:21.512888    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/695dc504-f5c8-48fe-9933-b283b28803f5-credential-socket\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 16:04:21.513077 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:21.512896    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tj2n4\" (UniqueName: \"kubernetes.io/projected/695dc504-f5c8-48fe-9933-b283b28803f5-kube-api-access-tj2n4\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 16:04:21.513077 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:21.512904    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/695dc504-f5c8-48fe-9933-b283b28803f5-istio-envoy\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 16:04:21.513077 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:21.512912    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/695dc504-f5c8-48fe-9933-b283b28803f5-workload-socket\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 16:04:21.901735 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:21.901704    2564 generic.go:356] "Generic (PLEG): container finished" podID="695dc504-f5c8-48fe-9933-b283b28803f5" containerID="19b892a5fee9399278398f7b6b2c57d6efb75658322e5947335966f363f1180e" exitCode=0
Jul 15 16:04:21.901887 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:21.901753    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-097eff-openshift-default-8569997db5-pdkd2"
Jul 15 16:04:21.901887 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:21.901764    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-097eff-openshift-default-8569997db5-pdkd2" event={"ID":"695dc504-f5c8-48fe-9933-b283b28803f5","Type":"ContainerDied","Data":"19b892a5fee9399278398f7b6b2c57d6efb75658322e5947335966f363f1180e"}
Jul 15 16:04:21.901887 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:21.901806    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-097eff-openshift-default-8569997db5-pdkd2" event={"ID":"695dc504-f5c8-48fe-9933-b283b28803f5","Type":"ContainerDied","Data":"a77c754e5330322538aa583e7602c00f290f7779fdd117d045270498c9af4502"}
Jul 15 16:04:21.901887 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:21.901835    2564 scope.go:117] "RemoveContainer" containerID="19b892a5fee9399278398f7b6b2c57d6efb75658322e5947335966f363f1180e"
Jul 15 16:04:21.910995 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:21.910977    2564 scope.go:117] "RemoveContainer" containerID="c61bae8fbbb2aa7ba66ee2a6ea5ef5bfe5e46e3101fb73982f1ec449efcb1b67"
Jul 15 16:04:21.919729 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:21.919713    2564 scope.go:117] "RemoveContainer" containerID="19b892a5fee9399278398f7b6b2c57d6efb75658322e5947335966f363f1180e"
Jul 15 16:04:21.919979 ip-10-0-138-107 kubenswrapper[2564]: E0715 16:04:21.919959    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19b892a5fee9399278398f7b6b2c57d6efb75658322e5947335966f363f1180e\": container with ID starting with 19b892a5fee9399278398f7b6b2c57d6efb75658322e5947335966f363f1180e not found: ID does not exist" containerID="19b892a5fee9399278398f7b6b2c57d6efb75658322e5947335966f363f1180e"
Jul 15 16:04:21.920068 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:21.919984    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19b892a5fee9399278398f7b6b2c57d6efb75658322e5947335966f363f1180e"} err="failed to get container status \"19b892a5fee9399278398f7b6b2c57d6efb75658322e5947335966f363f1180e\": rpc error: code = NotFound desc = could not find container \"19b892a5fee9399278398f7b6b2c57d6efb75658322e5947335966f363f1180e\": container with ID starting with 19b892a5fee9399278398f7b6b2c57d6efb75658322e5947335966f363f1180e not found: ID does not exist"
Jul 15 16:04:21.920068 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:21.920001    2564 scope.go:117] "RemoveContainer" containerID="c61bae8fbbb2aa7ba66ee2a6ea5ef5bfe5e46e3101fb73982f1ec449efcb1b67"
Jul 15 16:04:21.920272 ip-10-0-138-107 kubenswrapper[2564]: E0715 16:04:21.920257    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c61bae8fbbb2aa7ba66ee2a6ea5ef5bfe5e46e3101fb73982f1ec449efcb1b67\": container with ID starting with c61bae8fbbb2aa7ba66ee2a6ea5ef5bfe5e46e3101fb73982f1ec449efcb1b67 not found: ID does not exist" containerID="c61bae8fbbb2aa7ba66ee2a6ea5ef5bfe5e46e3101fb73982f1ec449efcb1b67"
Jul 15 16:04:21.920321 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:21.920275    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c61bae8fbbb2aa7ba66ee2a6ea5ef5bfe5e46e3101fb73982f1ec449efcb1b67"} err="failed to get container status \"c61bae8fbbb2aa7ba66ee2a6ea5ef5bfe5e46e3101fb73982f1ec449efcb1b67\": rpc error: code = NotFound desc = could not find container \"c61bae8fbbb2aa7ba66ee2a6ea5ef5bfe5e46e3101fb73982f1ec449efcb1b67\": container with ID starting with c61bae8fbbb2aa7ba66ee2a6ea5ef5bfe5e46e3101fb73982f1ec449efcb1b67 not found: ID does not exist"
Jul 15 16:04:21.926883 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:21.926863    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-097eff-openshift-default-8569997db5-pdkd2"]
Jul 15 16:04:21.930444 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:21.930424    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-097eff-openshift-default-8569997db5-pdkd2"]
Jul 15 16:04:22.235253 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:22.235163    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="695dc504-f5c8-48fe-9933-b283b28803f5" path="/var/lib/kubelet/pods/695dc504-f5c8-48fe-9933-b283b28803f5/volumes"
Jul 15 16:04:26.905292 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:26.905261    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:04:27.612437 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:27.612402    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:04:27.672653 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:27.672617    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:04:30.209868 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:30.209842    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfw7r_55d0e798-7e5a-4f3e-afc2-67dfb308d934/ovn-acl-logging/0.log"
Jul 15 16:04:30.217715 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:30.217695    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfw7r_55d0e798-7e5a-4f3e-afc2-67dfb308d934/ovn-acl-logging/0.log"
Jul 15 16:04:31.530163 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:31.530129    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:04:37.331864 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:37.331829    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:04:37.399979 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:37.399935    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:04:42.244970 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:42.244937    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:04:42.486327 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:42.486292    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:04:42.833199 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:42.833160    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:04:43.128468 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:43.128392    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk"]
Jul 15 16:04:43.128795 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:43.128782    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="695dc504-f5c8-48fe-9933-b283b28803f5" containerName="istio-proxy"
Jul 15 16:04:43.128842 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:43.128798    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="695dc504-f5c8-48fe-9933-b283b28803f5" containerName="istio-proxy"
Jul 15 16:04:43.128842 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:43.128816    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="663ff04e-6d19-4e87-b3ef-4c135ecb85b4" containerName="istio-proxy"
Jul 15 16:04:43.128842 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:43.128824    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="663ff04e-6d19-4e87-b3ef-4c135ecb85b4" containerName="istio-proxy"
Jul 15 16:04:43.128842 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:43.128835    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cf123c8-1752-4bca-8855-97842553c4e8" containerName="istio-proxy"
Jul 15 16:04:43.128842 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:43.128842    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cf123c8-1752-4bca-8855-97842553c4e8" containerName="istio-proxy"
Jul 15 16:04:43.129052 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:43.128917    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="9cf123c8-1752-4bca-8855-97842553c4e8" containerName="istio-proxy"
Jul 15 16:04:43.129052 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:43.128925    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="695dc504-f5c8-48fe-9933-b283b28803f5" containerName="istio-proxy"
Jul 15 16:04:43.131979 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:43.131964    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk"
Jul 15 16:04:43.134582 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:43.134562    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-0e8a6d-openshift-default-dockercfg-2scz9\""
Jul 15 16:04:43.145666 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:43.145643    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk"]
Jul 15 16:04:43.155944 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:43.155919    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:04:43.188127 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:43.188102    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbd893bd-b196-4dd4-842f-1783b533b000-credential-socket\") pod \"e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk\" (UID: \"fbd893bd-b196-4dd4-842f-1783b533b000\") " pod="openshift-ingress/e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk"
Jul 15 16:04:43.188232 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:43.188132    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbd893bd-b196-4dd4-842f-1783b533b000-workload-socket\") pod \"e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk\" (UID: \"fbd893bd-b196-4dd4-842f-1783b533b000\") " pod="openshift-ingress/e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk"
Jul 15 16:04:43.188232 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:43.188170    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fbd893bd-b196-4dd4-842f-1783b533b000-istio-podinfo\") pod \"e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk\" (UID: \"fbd893bd-b196-4dd4-842f-1783b533b000\") " pod="openshift-ingress/e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk"
Jul 15 16:04:43.188311 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:43.188253    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fbd893bd-b196-4dd4-842f-1783b533b000-istio-envoy\") pod \"e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk\" (UID: \"fbd893bd-b196-4dd4-842f-1783b533b000\") " pod="openshift-ingress/e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk"
Jul 15 16:04:43.188311 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:43.188280    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bxzv\" (UniqueName: \"kubernetes.io/projected/fbd893bd-b196-4dd4-842f-1783b533b000-kube-api-access-7bxzv\") pod \"e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk\" (UID: \"fbd893bd-b196-4dd4-842f-1783b533b000\") " pod="openshift-ingress/e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk"
Jul 15 16:04:43.188395 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:43.188311    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fbd893bd-b196-4dd4-842f-1783b533b000-istiod-ca-cert\") pod \"e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk\" (UID: \"fbd893bd-b196-4dd4-842f-1783b533b000\") " pod="openshift-ingress/e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk"
Jul 15 16:04:43.188395 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:43.188375    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fbd893bd-b196-4dd4-842f-1783b533b000-workload-certs\") pod \"e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk\" (UID: \"fbd893bd-b196-4dd4-842f-1783b533b000\") " pod="openshift-ingress/e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk"
Jul 15 16:04:43.188492 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:43.188395    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fbd893bd-b196-4dd4-842f-1783b533b000-istio-data\") pod \"e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk\" (UID: \"fbd893bd-b196-4dd4-842f-1783b533b000\") " pod="openshift-ingress/e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk"
Jul 15 16:04:43.188492 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:43.188410    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fbd893bd-b196-4dd4-842f-1783b533b000-istio-token\") pod \"e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk\" (UID: \"fbd893bd-b196-4dd4-842f-1783b533b000\") " pod="openshift-ingress/e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk"
Jul 15 16:04:43.257524 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:43.257503    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:04:43.289005 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:43.288981    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fbd893bd-b196-4dd4-842f-1783b533b000-istio-podinfo\") pod \"e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk\" (UID: \"fbd893bd-b196-4dd4-842f-1783b533b000\") " pod="openshift-ingress/e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk"
Jul 15 16:04:43.289103 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:43.289051    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fbd893bd-b196-4dd4-842f-1783b533b000-istio-envoy\") pod \"e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk\" (UID: \"fbd893bd-b196-4dd4-842f-1783b533b000\") " pod="openshift-ingress/e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk"
Jul 15 16:04:43.289103 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:43.289081    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bxzv\" (UniqueName: \"kubernetes.io/projected/fbd893bd-b196-4dd4-842f-1783b533b000-kube-api-access-7bxzv\") pod \"e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk\" (UID: \"fbd893bd-b196-4dd4-842f-1783b533b000\") " pod="openshift-ingress/e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk"
Jul 15 16:04:43.289219 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:43.289178    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fbd893bd-b196-4dd4-842f-1783b533b000-istiod-ca-cert\") pod \"e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk\" (UID: \"fbd893bd-b196-4dd4-842f-1783b533b000\") " pod="openshift-ingress/e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk"
Jul 15 16:04:43.289278 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:43.289246    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fbd893bd-b196-4dd4-842f-1783b533b000-workload-certs\") pod \"e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk\" (UID: \"fbd893bd-b196-4dd4-842f-1783b533b000\") " pod="openshift-ingress/e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk"
Jul 15 16:04:43.289345 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:43.289276    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fbd893bd-b196-4dd4-842f-1783b533b000-istio-data\") pod \"e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk\" (UID: \"fbd893bd-b196-4dd4-842f-1783b533b000\") " pod="openshift-ingress/e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk"
Jul 15 16:04:43.289345 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:43.289299    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fbd893bd-b196-4dd4-842f-1783b533b000-istio-token\") pod \"e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk\" (UID: \"fbd893bd-b196-4dd4-842f-1783b533b000\") " pod="openshift-ingress/e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk"
Jul 15 16:04:43.289345 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:43.289336    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbd893bd-b196-4dd4-842f-1783b533b000-credential-socket\") pod \"e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk\" (UID: \"fbd893bd-b196-4dd4-842f-1783b533b000\") " pod="openshift-ingress/e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk"
Jul 15 16:04:43.289511 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:43.289370    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbd893bd-b196-4dd4-842f-1783b533b000-workload-socket\") pod \"e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk\" (UID: \"fbd893bd-b196-4dd4-842f-1783b533b000\") " pod="openshift-ingress/e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk"
Jul 15 16:04:43.289745 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:43.289694    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fbd893bd-b196-4dd4-842f-1783b533b000-istio-data\") pod \"e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk\" (UID: \"fbd893bd-b196-4dd4-842f-1783b533b000\") " pod="openshift-ingress/e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk"
Jul 15 16:04:43.289837 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:43.289822    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbd893bd-b196-4dd4-842f-1783b533b000-workload-socket\") pod \"e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk\" (UID: \"fbd893bd-b196-4dd4-842f-1783b533b000\") " pod="openshift-ingress/e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk"
Jul 15 16:04:43.289973 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:43.289949    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fbd893bd-b196-4dd4-842f-1783b533b000-workload-certs\") pod \"e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk\" (UID: \"fbd893bd-b196-4dd4-842f-1783b533b000\") " pod="openshift-ingress/e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk"
Jul 15 16:04:43.290049 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:43.290003    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbd893bd-b196-4dd4-842f-1783b533b000-credential-socket\") pod \"e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk\" (UID: \"fbd893bd-b196-4dd4-842f-1783b533b000\") " pod="openshift-ingress/e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk"
Jul 15 16:04:43.290049 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:43.290003    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fbd893bd-b196-4dd4-842f-1783b533b000-istiod-ca-cert\") pod \"e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk\" (UID: \"fbd893bd-b196-4dd4-842f-1783b533b000\") " pod="openshift-ingress/e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk"
Jul 15 16:04:43.291553 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:43.291528    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fbd893bd-b196-4dd4-842f-1783b533b000-istio-envoy\") pod \"e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk\" (UID: \"fbd893bd-b196-4dd4-842f-1783b533b000\") " pod="openshift-ingress/e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk"
Jul 15 16:04:43.291792 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:43.291772    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fbd893bd-b196-4dd4-842f-1783b533b000-istio-podinfo\") pod \"e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk\" (UID: \"fbd893bd-b196-4dd4-842f-1783b533b000\") " pod="openshift-ingress/e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk"
Jul 15 16:04:43.300329 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:43.300306    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bxzv\" (UniqueName: \"kubernetes.io/projected/fbd893bd-b196-4dd4-842f-1783b533b000-kube-api-access-7bxzv\") pod \"e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk\" (UID: \"fbd893bd-b196-4dd4-842f-1783b533b000\") " pod="openshift-ingress/e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk"
Jul 15 16:04:43.303368 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:43.303347    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fbd893bd-b196-4dd4-842f-1783b533b000-istio-token\") pod \"e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk\" (UID: \"fbd893bd-b196-4dd4-842f-1783b533b000\") " pod="openshift-ingress/e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk"
Jul 15 16:04:43.442386 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:43.442324    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk"
Jul 15 16:04:43.583061 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:43.583038    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk"]
Jul 15 16:04:43.585348 ip-10-0-138-107 kubenswrapper[2564]: W0715 16:04:43.585317    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbd893bd_b196_4dd4_842f_1783b533b000.slice/crio-0ee61081760adcba12c5e9b7b510358d72ac7b6f6fa0326766132566dd090cd8 WatchSource:0}: Error finding container 0ee61081760adcba12c5e9b7b510358d72ac7b6f6fa0326766132566dd090cd8: Status 404 returned error can't find the container with id 0ee61081760adcba12c5e9b7b510358d72ac7b6f6fa0326766132566dd090cd8
Jul 15 16:04:43.587385 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:43.587353    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:04:43.587451 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:43.587418    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:04:43.587492 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:43.587466    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:04:44.002492 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:44.002455    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk" event={"ID":"fbd893bd-b196-4dd4-842f-1783b533b000","Type":"ContainerStarted","Data":"b20371a8bad7392cadbd1e6e3c35a673ab4cfe5477e18a0084163e7df2b62bb8"}
Jul 15 16:04:44.002668 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:44.002507    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk" event={"ID":"fbd893bd-b196-4dd4-842f-1783b533b000","Type":"ContainerStarted","Data":"0ee61081760adcba12c5e9b7b510358d72ac7b6f6fa0326766132566dd090cd8"}
Jul 15 16:04:44.028683 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:44.028639    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk" podStartSLOduration=1.028621741 podStartE2EDuration="1.028621741s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:04:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:04:44.026678233 +0000 UTC m=+2414.372581426" watchObservedRunningTime="2026-07-15 16:04:44.028621741 +0000 UTC m=+2414.374524934"
Jul 15 16:04:44.443427 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:44.443402    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk"
Jul 15 16:04:44.448155 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:44.448132    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk"
Jul 15 16:04:45.007060 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:45.007028    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk"
Jul 15 16:04:45.008001 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:45.007978    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk"
Jul 15 16:04:45.987083 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:45.986966    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:04:46.097481 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:46.097443    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:04:46.291265 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:46.291226    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:04:46.413164 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:46.413133    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:04:46.802090 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:46.802056    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:04:46.904583 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:46.904549    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:04:50.482727 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:50.482686    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:04:50.828259 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:50.828207    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:04:51.160803 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:51.160702    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:04:51.254690 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:51.254645    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:04:54.547580 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:54.547495    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:04:54.694025 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:54.693986    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:04:54.822839 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:54.822755    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:04:55.290640 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:55.290602    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:04:55.477736 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:55.477701    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:04:55.580586 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:55.580411    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:04:59.036712 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:04:59.036680    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:05:01.050179 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:05:01.050138    2564 patch_prober.go:28] interesting pod/e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 15 16:05:01.050590 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:05:01.050213    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk" podUID="fbd893bd-b196-4dd4-842f-1783b533b000" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 15 16:05:03.104546 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:05:03.104504    2564 generic.go:356] "Generic (PLEG): container finished" podID="fbd893bd-b196-4dd4-842f-1783b533b000" containerID="b20371a8bad7392cadbd1e6e3c35a673ab4cfe5477e18a0084163e7df2b62bb8" exitCode=0
Jul 15 16:05:03.104971 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:05:03.104577    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk" event={"ID":"fbd893bd-b196-4dd4-842f-1783b533b000","Type":"ContainerDied","Data":"b20371a8bad7392cadbd1e6e3c35a673ab4cfe5477e18a0084163e7df2b62bb8"}
Jul 15 16:05:03.104971 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:05:03.104949    2564 scope.go:117] "RemoveContainer" containerID="b20371a8bad7392cadbd1e6e3c35a673ab4cfe5477e18a0084163e7df2b62bb8"
Jul 15 16:05:03.105979 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:05:03.105950    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:05:03.106072 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:05:03.106053    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:05:03.106121 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:05:03.106097    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:05:04.111149 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:05:04.111113    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk" event={"ID":"fbd893bd-b196-4dd4-842f-1783b533b000","Type":"ContainerStarted","Data":"c55f37745311bec0735f57e62043f61ac776e93e0cd3aeef595fe1c9f2063f0f"}
Jul 15 16:05:04.442766 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:05:04.442667    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk"
Jul 15 16:05:04.442964 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:05:04.442937    2564 patch_prober.go:28] interesting pod/e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 15 16:05:04.443076 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:05:04.442998    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk" podUID="fbd893bd-b196-4dd4-842f-1783b533b000" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 15 16:05:05.442944 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:05:05.442912    2564 patch_prober.go:28] interesting pod/e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 15 16:05:05.443336 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:05:05.442967    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk" podUID="fbd893bd-b196-4dd4-842f-1783b533b000" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 15 16:05:06.443402 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:05:06.443363    2564 patch_prober.go:28] interesting pod/e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 15 16:05:06.443819 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:05:06.443421    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk" podUID="fbd893bd-b196-4dd4-842f-1783b533b000" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 15 16:05:07.443180 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:05:07.443139    2564 patch_prober.go:28] interesting pod/e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 15 16:05:07.443369 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:05:07.443201    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk" podUID="fbd893bd-b196-4dd4-842f-1783b533b000" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 15 16:05:07.847388 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:05:07.847343    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:05:07.947933 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:05:07.947891    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:05:08.446235 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:05:08.446207    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk"
Jul 15 16:05:08.446467 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:05:08.446443    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk"
Jul 15 16:05:08.447188 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:05:08.447171    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk"
Jul 15 16:05:16.399304 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:05:16.399270    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:05:16.482601 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:05:16.482569    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:05:16.585387 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:05:16.585358    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:05:27.707203 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:05:27.707164    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:05:27.768397 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:05:27.768365    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:05:48.617183 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:05:48.617145    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:05:59.189944 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:05:59.189910    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:06:19.375257 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:06:19.375215    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:06:19.476993 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:06:19.476955    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:07:45.159599 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:07:45.159566    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:07:46.033454 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:07:46.033420    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:07:50.878863 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:07:50.878826    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-0e8a6d/sub-test-model-0e8a6d-kserve-7564f7f499-s8gn8"]
Jul 15 16:07:50.879401 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:07:50.879381    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="695dc504-f5c8-48fe-9933-b283b28803f5" containerName="istio-proxy"
Jul 15 16:07:50.879488 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:07:50.879404    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="695dc504-f5c8-48fe-9933-b283b28803f5" containerName="istio-proxy"
Jul 15 16:07:50.879488 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:07:50.879427    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cf123c8-1752-4bca-8855-97842553c4e8" containerName="istio-proxy"
Jul 15 16:07:50.879488 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:07:50.879436    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cf123c8-1752-4bca-8855-97842553c4e8" containerName="istio-proxy"
Jul 15 16:07:50.879692 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:07:50.879528    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="9cf123c8-1752-4bca-8855-97842553c4e8" containerName="istio-proxy"
Jul 15 16:07:50.879692 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:07:50.879543    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="695dc504-f5c8-48fe-9933-b283b28803f5" containerName="istio-proxy"
Jul 15 16:07:50.882551 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:07:50.882530    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0e8a6d/sub-test-model-0e8a6d-kserve-7564f7f499-s8gn8"
Jul 15 16:07:50.889449 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:07:50.889432    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-0e8a6d\"/\"sub-test-model-0e8a6d-kserve-self-signed-certs\""
Jul 15 16:07:50.890597 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:07:50.890577    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-0e8a6d\"/\"kube-root-ca.crt\""
Jul 15 16:07:50.890700 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:07:50.890640    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-0e8a6d\"/\"default-dockercfg-lxlzj\""
Jul 15 16:07:50.890700 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:07:50.890675    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-0e8a6d\"/\"openshift-service-ca.crt\""
Jul 15 16:07:50.901031 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:07:50.900983    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:07:50.901755 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:07:50.901738    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-0e8a6d/sub-test-model-0e8a6d-kserve-7564f7f499-s8gn8"]
Jul 15 16:07:51.049123 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:07:51.049090    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/00246296-26c0-4ada-9515-1bedaffa65ba-home\") pod \"sub-test-model-0e8a6d-kserve-7564f7f499-s8gn8\" (UID: \"00246296-26c0-4ada-9515-1bedaffa65ba\") " pod="ai-tenant-e2e-shared-a-0e8a6d/sub-test-model-0e8a6d-kserve-7564f7f499-s8gn8"
Jul 15 16:07:51.049293 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:07:51.049145    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/00246296-26c0-4ada-9515-1bedaffa65ba-dshm\") pod \"sub-test-model-0e8a6d-kserve-7564f7f499-s8gn8\" (UID: \"00246296-26c0-4ada-9515-1bedaffa65ba\") " pod="ai-tenant-e2e-shared-a-0e8a6d/sub-test-model-0e8a6d-kserve-7564f7f499-s8gn8"
Jul 15 16:07:51.049293 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:07:51.049248    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/00246296-26c0-4ada-9515-1bedaffa65ba-model-cache\") pod \"sub-test-model-0e8a6d-kserve-7564f7f499-s8gn8\" (UID: \"00246296-26c0-4ada-9515-1bedaffa65ba\") " pod="ai-tenant-e2e-shared-a-0e8a6d/sub-test-model-0e8a6d-kserve-7564f7f499-s8gn8"
Jul 15 16:07:51.049379 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:07:51.049320    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcw5l\" (UniqueName: \"kubernetes.io/projected/00246296-26c0-4ada-9515-1bedaffa65ba-kube-api-access-xcw5l\") pod \"sub-test-model-0e8a6d-kserve-7564f7f499-s8gn8\" (UID: \"00246296-26c0-4ada-9515-1bedaffa65ba\") " pod="ai-tenant-e2e-shared-a-0e8a6d/sub-test-model-0e8a6d-kserve-7564f7f499-s8gn8"
Jul 15 16:07:51.049379 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:07:51.049347    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/00246296-26c0-4ada-9515-1bedaffa65ba-tmp-dir\") pod \"sub-test-model-0e8a6d-kserve-7564f7f499-s8gn8\" (UID: \"00246296-26c0-4ada-9515-1bedaffa65ba\") " pod="ai-tenant-e2e-shared-a-0e8a6d/sub-test-model-0e8a6d-kserve-7564f7f499-s8gn8"
Jul 15 16:07:51.049379 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:07:51.049367    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00246296-26c0-4ada-9515-1bedaffa65ba-tls-certs\") pod \"sub-test-model-0e8a6d-kserve-7564f7f499-s8gn8\" (UID: \"00246296-26c0-4ada-9515-1bedaffa65ba\") " pod="ai-tenant-e2e-shared-a-0e8a6d/sub-test-model-0e8a6d-kserve-7564f7f499-s8gn8"
Jul 15 16:07:51.149749 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:07:51.149679    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/00246296-26c0-4ada-9515-1bedaffa65ba-model-cache\") pod \"sub-test-model-0e8a6d-kserve-7564f7f499-s8gn8\" (UID: \"00246296-26c0-4ada-9515-1bedaffa65ba\") " pod="ai-tenant-e2e-shared-a-0e8a6d/sub-test-model-0e8a6d-kserve-7564f7f499-s8gn8"
Jul 15 16:07:51.149749 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:07:51.149731    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcw5l\" (UniqueName: \"kubernetes.io/projected/00246296-26c0-4ada-9515-1bedaffa65ba-kube-api-access-xcw5l\") pod \"sub-test-model-0e8a6d-kserve-7564f7f499-s8gn8\" (UID: \"00246296-26c0-4ada-9515-1bedaffa65ba\") " pod="ai-tenant-e2e-shared-a-0e8a6d/sub-test-model-0e8a6d-kserve-7564f7f499-s8gn8"
Jul 15 16:07:51.149937 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:07:51.149760    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/00246296-26c0-4ada-9515-1bedaffa65ba-tmp-dir\") pod \"sub-test-model-0e8a6d-kserve-7564f7f499-s8gn8\" (UID: \"00246296-26c0-4ada-9515-1bedaffa65ba\") " pod="ai-tenant-e2e-shared-a-0e8a6d/sub-test-model-0e8a6d-kserve-7564f7f499-s8gn8"
Jul 15 16:07:51.149937 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:07:51.149787    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00246296-26c0-4ada-9515-1bedaffa65ba-tls-certs\") pod \"sub-test-model-0e8a6d-kserve-7564f7f499-s8gn8\" (UID: \"00246296-26c0-4ada-9515-1bedaffa65ba\") " pod="ai-tenant-e2e-shared-a-0e8a6d/sub-test-model-0e8a6d-kserve-7564f7f499-s8gn8"
Jul 15 16:07:51.149937 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:07:51.149812    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/00246296-26c0-4ada-9515-1bedaffa65ba-home\") pod \"sub-test-model-0e8a6d-kserve-7564f7f499-s8gn8\" (UID: \"00246296-26c0-4ada-9515-1bedaffa65ba\") " pod="ai-tenant-e2e-shared-a-0e8a6d/sub-test-model-0e8a6d-kserve-7564f7f499-s8gn8"
Jul 15 16:07:51.150126 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:07:51.149960    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/00246296-26c0-4ada-9515-1bedaffa65ba-dshm\") pod \"sub-test-model-0e8a6d-kserve-7564f7f499-s8gn8\" (UID: \"00246296-26c0-4ada-9515-1bedaffa65ba\") " pod="ai-tenant-e2e-shared-a-0e8a6d/sub-test-model-0e8a6d-kserve-7564f7f499-s8gn8"
Jul 15 16:07:51.150187 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:07:51.150157    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/00246296-26c0-4ada-9515-1bedaffa65ba-model-cache\") pod \"sub-test-model-0e8a6d-kserve-7564f7f499-s8gn8\" (UID: \"00246296-26c0-4ada-9515-1bedaffa65ba\") " pod="ai-tenant-e2e-shared-a-0e8a6d/sub-test-model-0e8a6d-kserve-7564f7f499-s8gn8"
Jul 15 16:07:51.150244 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:07:51.150185    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/00246296-26c0-4ada-9515-1bedaffa65ba-tmp-dir\") pod \"sub-test-model-0e8a6d-kserve-7564f7f499-s8gn8\" (UID: \"00246296-26c0-4ada-9515-1bedaffa65ba\") " pod="ai-tenant-e2e-shared-a-0e8a6d/sub-test-model-0e8a6d-kserve-7564f7f499-s8gn8"
Jul 15 16:07:51.150244 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:07:51.150209    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/00246296-26c0-4ada-9515-1bedaffa65ba-home\") pod \"sub-test-model-0e8a6d-kserve-7564f7f499-s8gn8\" (UID: \"00246296-26c0-4ada-9515-1bedaffa65ba\") " pod="ai-tenant-e2e-shared-a-0e8a6d/sub-test-model-0e8a6d-kserve-7564f7f499-s8gn8"
Jul 15 16:07:51.152091 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:07:51.152068    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/00246296-26c0-4ada-9515-1bedaffa65ba-dshm\") pod \"sub-test-model-0e8a6d-kserve-7564f7f499-s8gn8\" (UID: \"00246296-26c0-4ada-9515-1bedaffa65ba\") " pod="ai-tenant-e2e-shared-a-0e8a6d/sub-test-model-0e8a6d-kserve-7564f7f499-s8gn8"
Jul 15 16:07:51.152450 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:07:51.152431    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00246296-26c0-4ada-9515-1bedaffa65ba-tls-certs\") pod \"sub-test-model-0e8a6d-kserve-7564f7f499-s8gn8\" (UID: \"00246296-26c0-4ada-9515-1bedaffa65ba\") " pod="ai-tenant-e2e-shared-a-0e8a6d/sub-test-model-0e8a6d-kserve-7564f7f499-s8gn8"
Jul 15 16:07:51.158135 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:07:51.158112    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcw5l\" (UniqueName: \"kubernetes.io/projected/00246296-26c0-4ada-9515-1bedaffa65ba-kube-api-access-xcw5l\") pod \"sub-test-model-0e8a6d-kserve-7564f7f499-s8gn8\" (UID: \"00246296-26c0-4ada-9515-1bedaffa65ba\") " pod="ai-tenant-e2e-shared-a-0e8a6d/sub-test-model-0e8a6d-kserve-7564f7f499-s8gn8"
Jul 15 16:07:51.191948 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:07:51.191925    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0e8a6d/sub-test-model-0e8a6d-kserve-7564f7f499-s8gn8"
Jul 15 16:07:51.324488 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:07:51.324462    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-0e8a6d/sub-test-model-0e8a6d-kserve-7564f7f499-s8gn8"]
Jul 15 16:07:51.326704 ip-10-0-138-107 kubenswrapper[2564]: W0715 16:07:51.326674    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod00246296_26c0_4ada_9515_1bedaffa65ba.slice/crio-3753b1d2dd3db62fc9abf0cf0dbf1d27d14bff42ef146e82bfd925192e7aef7e WatchSource:0}: Error finding container 3753b1d2dd3db62fc9abf0cf0dbf1d27d14bff42ef146e82bfd925192e7aef7e: Status 404 returned error can't find the container with id 3753b1d2dd3db62fc9abf0cf0dbf1d27d14bff42ef146e82bfd925192e7aef7e
Jul 15 16:07:51.858981 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:07:51.858948    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0e8a6d/sub-test-model-0e8a6d-kserve-7564f7f499-s8gn8" event={"ID":"00246296-26c0-4ada-9515-1bedaffa65ba","Type":"ContainerStarted","Data":"ef7c38c5af2b8f4ecb113813dbc2a4d1b67cda6734122a40435e1ca9910a7aeb"}
Jul 15 16:07:51.859157 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:07:51.858992    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0e8a6d/sub-test-model-0e8a6d-kserve-7564f7f499-s8gn8" event={"ID":"00246296-26c0-4ada-9515-1bedaffa65ba","Type":"ContainerStarted","Data":"3753b1d2dd3db62fc9abf0cf0dbf1d27d14bff42ef146e82bfd925192e7aef7e"}
Jul 15 16:07:51.880123 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:07:51.880080    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-0e8a6d/sub-test-model-0e8a6d-kserve-7564f7f499-s8gn8" podStartSLOduration=1.880064633 podStartE2EDuration="1.880064633s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:07:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:07:51.879270863 +0000 UTC m=+2602.225174057" watchObservedRunningTime="2026-07-15 16:07:51.880064633 +0000 UTC m=+2602.225967868"
Jul 15 16:08:01.192402 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:08:01.192367    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-0e8a6d/sub-test-model-0e8a6d-kserve-7564f7f499-s8gn8"
Jul 15 16:08:01.192781 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:08:01.192422    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-0e8a6d/sub-test-model-0e8a6d-kserve-7564f7f499-s8gn8"
Jul 15 16:08:01.205061 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:08:01.205032    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-0e8a6d/sub-test-model-0e8a6d-kserve-7564f7f499-s8gn8"
Jul 15 16:08:01.922474 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:08:01.922445    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-0e8a6d/sub-test-model-0e8a6d-kserve-7564f7f499-s8gn8"
Jul 15 16:08:33.612629 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:08:33.612588    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:08:48.232396 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:08:48.232360    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:08:48.335727 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:08:48.335690    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:09:26.039402 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:09:26.039322    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-0e8a6d/sub-test-model-0e8a6d-kserve-7564f7f499-s8gn8"]
Jul 15 16:09:26.066877 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:09:26.066846    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:09:26.871841 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:09:26.871799    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:09:30.243211 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:09:30.243185    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfw7r_55d0e798-7e5a-4f3e-afc2-67dfb308d934/ovn-acl-logging/0.log"
Jul 15 16:09:30.251923 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:09:30.251905    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfw7r_55d0e798-7e5a-4f3e-afc2-67dfb308d934/ovn-acl-logging/0.log"
Jul 15 16:09:41.059163 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:09:41.059121    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-0e8a6d/sub-test-model-0e8a6d-kserve-7564f7f499-s8gn8" podUID="00246296-26c0-4ada-9515-1bedaffa65ba" containerName="main" containerID="cri-o://ef7c38c5af2b8f4ecb113813dbc2a4d1b67cda6734122a40435e1ca9910a7aeb" gracePeriod=45
Jul 15 16:09:41.302956 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:09:41.302935    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0e8a6d/sub-test-model-0e8a6d-kserve-7564f7f499-s8gn8"
Jul 15 16:09:41.368541 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:09:41.368466    2564 generic.go:356] "Generic (PLEG): container finished" podID="00246296-26c0-4ada-9515-1bedaffa65ba" containerID="ef7c38c5af2b8f4ecb113813dbc2a4d1b67cda6734122a40435e1ca9910a7aeb" exitCode=0
Jul 15 16:09:41.368541 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:09:41.368509    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0e8a6d/sub-test-model-0e8a6d-kserve-7564f7f499-s8gn8"
Jul 15 16:09:41.368720 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:09:41.368558    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0e8a6d/sub-test-model-0e8a6d-kserve-7564f7f499-s8gn8" event={"ID":"00246296-26c0-4ada-9515-1bedaffa65ba","Type":"ContainerDied","Data":"ef7c38c5af2b8f4ecb113813dbc2a4d1b67cda6734122a40435e1ca9910a7aeb"}
Jul 15 16:09:41.368720 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:09:41.368601    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0e8a6d/sub-test-model-0e8a6d-kserve-7564f7f499-s8gn8" event={"ID":"00246296-26c0-4ada-9515-1bedaffa65ba","Type":"ContainerDied","Data":"3753b1d2dd3db62fc9abf0cf0dbf1d27d14bff42ef146e82bfd925192e7aef7e"}
Jul 15 16:09:41.368720 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:09:41.368619    2564 scope.go:117] "RemoveContainer" containerID="ef7c38c5af2b8f4ecb113813dbc2a4d1b67cda6734122a40435e1ca9910a7aeb"
Jul 15 16:09:41.377720 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:09:41.377700    2564 scope.go:117] "RemoveContainer" containerID="ef7c38c5af2b8f4ecb113813dbc2a4d1b67cda6734122a40435e1ca9910a7aeb"
Jul 15 16:09:41.378091 ip-10-0-138-107 kubenswrapper[2564]: E0715 16:09:41.378072    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef7c38c5af2b8f4ecb113813dbc2a4d1b67cda6734122a40435e1ca9910a7aeb\": container with ID starting with ef7c38c5af2b8f4ecb113813dbc2a4d1b67cda6734122a40435e1ca9910a7aeb not found: ID does not exist" containerID="ef7c38c5af2b8f4ecb113813dbc2a4d1b67cda6734122a40435e1ca9910a7aeb"
Jul 15 16:09:41.378204 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:09:41.378098    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef7c38c5af2b8f4ecb113813dbc2a4d1b67cda6734122a40435e1ca9910a7aeb"} err="failed to get container status \"ef7c38c5af2b8f4ecb113813dbc2a4d1b67cda6734122a40435e1ca9910a7aeb\": rpc error: code = NotFound desc = could not find container \"ef7c38c5af2b8f4ecb113813dbc2a4d1b67cda6734122a40435e1ca9910a7aeb\": container with ID starting with ef7c38c5af2b8f4ecb113813dbc2a4d1b67cda6734122a40435e1ca9910a7aeb not found: ID does not exist"
Jul 15 16:09:41.464491 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:09:41.464470    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/00246296-26c0-4ada-9515-1bedaffa65ba-model-cache\") pod \"00246296-26c0-4ada-9515-1bedaffa65ba\" (UID: \"00246296-26c0-4ada-9515-1bedaffa65ba\") "
Jul 15 16:09:41.464597 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:09:41.464526    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00246296-26c0-4ada-9515-1bedaffa65ba-tls-certs\") pod \"00246296-26c0-4ada-9515-1bedaffa65ba\" (UID: \"00246296-26c0-4ada-9515-1bedaffa65ba\") "
Jul 15 16:09:41.464597 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:09:41.464557    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/00246296-26c0-4ada-9515-1bedaffa65ba-tmp-dir\") pod \"00246296-26c0-4ada-9515-1bedaffa65ba\" (UID: \"00246296-26c0-4ada-9515-1bedaffa65ba\") "
Jul 15 16:09:41.464597 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:09:41.464594    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/00246296-26c0-4ada-9515-1bedaffa65ba-dshm\") pod \"00246296-26c0-4ada-9515-1bedaffa65ba\" (UID: \"00246296-26c0-4ada-9515-1bedaffa65ba\") "
Jul 15 16:09:41.464750 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:09:41.464623    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/00246296-26c0-4ada-9515-1bedaffa65ba-home\") pod \"00246296-26c0-4ada-9515-1bedaffa65ba\" (UID: \"00246296-26c0-4ada-9515-1bedaffa65ba\") "
Jul 15 16:09:41.464750 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:09:41.464654    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xcw5l\" (UniqueName: \"kubernetes.io/projected/00246296-26c0-4ada-9515-1bedaffa65ba-kube-api-access-xcw5l\") pod \"00246296-26c0-4ada-9515-1bedaffa65ba\" (UID: \"00246296-26c0-4ada-9515-1bedaffa65ba\") "
Jul 15 16:09:41.464750 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:09:41.464706    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00246296-26c0-4ada-9515-1bedaffa65ba-model-cache" (OuterVolumeSpecName: "model-cache") pod "00246296-26c0-4ada-9515-1bedaffa65ba" (UID: "00246296-26c0-4ada-9515-1bedaffa65ba"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:09:41.464909 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:09:41.464856    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00246296-26c0-4ada-9515-1bedaffa65ba-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "00246296-26c0-4ada-9515-1bedaffa65ba" (UID: "00246296-26c0-4ada-9515-1bedaffa65ba"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:09:41.464909 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:09:41.464896    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/00246296-26c0-4ada-9515-1bedaffa65ba-model-cache\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 16:09:41.465002 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:09:41.464922    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00246296-26c0-4ada-9515-1bedaffa65ba-home" (OuterVolumeSpecName: "home") pod "00246296-26c0-4ada-9515-1bedaffa65ba" (UID: "00246296-26c0-4ada-9515-1bedaffa65ba"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:09:41.466735 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:09:41.466714    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00246296-26c0-4ada-9515-1bedaffa65ba-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "00246296-26c0-4ada-9515-1bedaffa65ba" (UID: "00246296-26c0-4ada-9515-1bedaffa65ba"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 16:09:41.466804 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:09:41.466742    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00246296-26c0-4ada-9515-1bedaffa65ba-dshm" (OuterVolumeSpecName: "dshm") pod "00246296-26c0-4ada-9515-1bedaffa65ba" (UID: "00246296-26c0-4ada-9515-1bedaffa65ba"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:09:41.466804 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:09:41.466780    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00246296-26c0-4ada-9515-1bedaffa65ba-kube-api-access-xcw5l" (OuterVolumeSpecName: "kube-api-access-xcw5l") pod "00246296-26c0-4ada-9515-1bedaffa65ba" (UID: "00246296-26c0-4ada-9515-1bedaffa65ba"). InnerVolumeSpecName "kube-api-access-xcw5l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:09:41.566313 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:09:41.566287    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00246296-26c0-4ada-9515-1bedaffa65ba-tls-certs\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 16:09:41.566313 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:09:41.566313    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/00246296-26c0-4ada-9515-1bedaffa65ba-tmp-dir\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 16:09:41.566455 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:09:41.566326    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/00246296-26c0-4ada-9515-1bedaffa65ba-dshm\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 16:09:41.566455 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:09:41.566337    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/00246296-26c0-4ada-9515-1bedaffa65ba-home\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 16:09:41.566455 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:09:41.566348    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xcw5l\" (UniqueName: \"kubernetes.io/projected/00246296-26c0-4ada-9515-1bedaffa65ba-kube-api-access-xcw5l\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 16:09:41.691328 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:09:41.691300    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-0e8a6d/sub-test-model-0e8a6d-kserve-7564f7f499-s8gn8"]
Jul 15 16:09:41.698619 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:09:41.698597    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-0e8a6d/sub-test-model-0e8a6d-kserve-7564f7f499-s8gn8"]
Jul 15 16:09:42.230592 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:09:42.230556    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00246296-26c0-4ada-9515-1bedaffa65ba" path="/var/lib/kubelet/pods/00246296-26c0-4ada-9515-1bedaffa65ba/volumes"
Jul 15 16:09:53.109199 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:09:53.109163    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:10:08.574654 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:10:08.574589    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:10:08.672611 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:10:08.672571    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:10:13.573037 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:10:13.572976    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:10:17.398488 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:10:17.398447    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:10:17.496345 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:10:17.496308    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:11:00.564616 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:00.564576    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:11:01.480463 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:01.480421    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:11:02.427172 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:02.427135    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7426-140545741564080"]
Jul 15 16:11:02.427551 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:02.427508    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00246296-26c0-4ada-9515-1bedaffa65ba" containerName="main"
Jul 15 16:11:02.427551 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:02.427519    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="00246296-26c0-4ada-9515-1bedaffa65ba" containerName="main"
Jul 15 16:11:02.427634 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:02.427581    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="00246296-26c0-4ada-9515-1bedaffa65ba" containerName="main"
Jul 15 16:11:02.429701 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:02.429677    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7426-140545741564080"
Jul 15 16:11:02.432336 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:02.432314    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-br7zr\""
Jul 15 16:11:02.435813 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:02.435786    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7426-140545741564080"]
Jul 15 16:11:02.542638 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:02.542598    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t99zn\" (UniqueName: \"kubernetes.io/projected/4ca2b239-8980-4183-86e2-acd02e361fca-kube-api-access-t99zn\") pod \"test-curl-7426-140545741564080\" (UID: \"4ca2b239-8980-4183-86e2-acd02e361fca\") " pod="opendatahub/test-curl-7426-140545741564080"
Jul 15 16:11:02.643489 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:02.643454    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t99zn\" (UniqueName: \"kubernetes.io/projected/4ca2b239-8980-4183-86e2-acd02e361fca-kube-api-access-t99zn\") pod \"test-curl-7426-140545741564080\" (UID: \"4ca2b239-8980-4183-86e2-acd02e361fca\") " pod="opendatahub/test-curl-7426-140545741564080"
Jul 15 16:11:02.652221 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:02.652188    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t99zn\" (UniqueName: \"kubernetes.io/projected/4ca2b239-8980-4183-86e2-acd02e361fca-kube-api-access-t99zn\") pod \"test-curl-7426-140545741564080\" (UID: \"4ca2b239-8980-4183-86e2-acd02e361fca\") " pod="opendatahub/test-curl-7426-140545741564080"
Jul 15 16:11:02.740573 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:02.740489    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7426-140545741564080"
Jul 15 16:11:02.871532 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:02.871500    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7426-140545741564080"]
Jul 15 16:11:02.874771 ip-10-0-138-107 kubenswrapper[2564]: W0715 16:11:02.874742    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4ca2b239_8980_4183_86e2_acd02e361fca.slice/crio-aa03151e8ad73d879fb6c94cc55b2fa29af19653b8733889ff0afd07413f945e WatchSource:0}: Error finding container aa03151e8ad73d879fb6c94cc55b2fa29af19653b8733889ff0afd07413f945e: Status 404 returned error can't find the container with id aa03151e8ad73d879fb6c94cc55b2fa29af19653b8733889ff0afd07413f945e
Jul 15 16:11:02.876102 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:02.876084    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 16:11:03.762804 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:03.762770    2564 generic.go:356] "Generic (PLEG): container finished" podID="4ca2b239-8980-4183-86e2-acd02e361fca" containerID="6bb7ad5af2232b83d56d62890c54f630ca5e07bbd57643bc7d88fce32bbe0916" exitCode=0
Jul 15 16:11:03.763279 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:03.762825    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7426-140545741564080" event={"ID":"4ca2b239-8980-4183-86e2-acd02e361fca","Type":"ContainerDied","Data":"6bb7ad5af2232b83d56d62890c54f630ca5e07bbd57643bc7d88fce32bbe0916"}
Jul 15 16:11:03.763279 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:03.762867    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7426-140545741564080" event={"ID":"4ca2b239-8980-4183-86e2-acd02e361fca","Type":"ContainerStarted","Data":"aa03151e8ad73d879fb6c94cc55b2fa29af19653b8733889ff0afd07413f945e"}
Jul 15 16:11:04.894954 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:04.894932    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7426-140545741564080"
Jul 15 16:11:04.919369 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:04.919346    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7426-140545741564080_4ca2b239-8980-4183-86e2-acd02e361fca/test-curl-7426-140545741564080/0.log"
Jul 15 16:11:04.947454 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:04.947430    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7426-140545741564080"]
Jul 15 16:11:04.951649 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:04.951628    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7426-140545741564080"]
Jul 15 16:11:04.963198 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:04.963177    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t99zn\" (UniqueName: \"kubernetes.io/projected/4ca2b239-8980-4183-86e2-acd02e361fca-kube-api-access-t99zn\") pod \"4ca2b239-8980-4183-86e2-acd02e361fca\" (UID: \"4ca2b239-8980-4183-86e2-acd02e361fca\") "
Jul 15 16:11:04.965110 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:04.965088    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ca2b239-8980-4183-86e2-acd02e361fca-kube-api-access-t99zn" (OuterVolumeSpecName: "kube-api-access-t99zn") pod "4ca2b239-8980-4183-86e2-acd02e361fca" (UID: "4ca2b239-8980-4183-86e2-acd02e361fca"). InnerVolumeSpecName "kube-api-access-t99zn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:11:05.064588 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:05.064497    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t99zn\" (UniqueName: \"kubernetes.io/projected/4ca2b239-8980-4183-86e2-acd02e361fca-kube-api-access-t99zn\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 16:11:05.079439 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:05.079410    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7426-140545741564336"]
Jul 15 16:11:05.079782 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:05.079770    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ca2b239-8980-4183-86e2-acd02e361fca" containerName="test-curl-7426-140545741564080"
Jul 15 16:11:05.079825 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:05.079784    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ca2b239-8980-4183-86e2-acd02e361fca" containerName="test-curl-7426-140545741564080"
Jul 15 16:11:05.079865 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:05.079854    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ca2b239-8980-4183-86e2-acd02e361fca" containerName="test-curl-7426-140545741564080"
Jul 15 16:11:05.081771 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:05.081756    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7426-140545741564336"
Jul 15 16:11:05.089513 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:05.089489    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7426-140545741564336"]
Jul 15 16:11:05.165241 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:05.165213    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5sjz\" (UniqueName: \"kubernetes.io/projected/8f5f829b-fc9b-4527-bf28-78bb8809a0c1-kube-api-access-w5sjz\") pod \"test-curl-7426-140545741564336\" (UID: \"8f5f829b-fc9b-4527-bf28-78bb8809a0c1\") " pod="opendatahub/test-curl-7426-140545741564336"
Jul 15 16:11:05.266636 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:05.266599    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5sjz\" (UniqueName: \"kubernetes.io/projected/8f5f829b-fc9b-4527-bf28-78bb8809a0c1-kube-api-access-w5sjz\") pod \"test-curl-7426-140545741564336\" (UID: \"8f5f829b-fc9b-4527-bf28-78bb8809a0c1\") " pod="opendatahub/test-curl-7426-140545741564336"
Jul 15 16:11:05.275318 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:05.275293    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5sjz\" (UniqueName: \"kubernetes.io/projected/8f5f829b-fc9b-4527-bf28-78bb8809a0c1-kube-api-access-w5sjz\") pod \"test-curl-7426-140545741564336\" (UID: \"8f5f829b-fc9b-4527-bf28-78bb8809a0c1\") " pod="opendatahub/test-curl-7426-140545741564336"
Jul 15 16:11:05.391658 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:05.391578    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7426-140545741564336"
Jul 15 16:11:05.521852 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:05.521702    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7426-140545741564336"]
Jul 15 16:11:05.524399 ip-10-0-138-107 kubenswrapper[2564]: W0715 16:11:05.524372    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8f5f829b_fc9b_4527_bf28_78bb8809a0c1.slice/crio-39c932bbf437fabd94fcf0b689a0e7087f665dd283aa6a6dbb098749c32583c9 WatchSource:0}: Error finding container 39c932bbf437fabd94fcf0b689a0e7087f665dd283aa6a6dbb098749c32583c9: Status 404 returned error can't find the container with id 39c932bbf437fabd94fcf0b689a0e7087f665dd283aa6a6dbb098749c32583c9
Jul 15 16:11:05.772820 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:05.772800    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7426-140545741564080"
Jul 15 16:11:05.772820 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:05.772812    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aa03151e8ad73d879fb6c94cc55b2fa29af19653b8733889ff0afd07413f945e"
Jul 15 16:11:05.774036 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:05.773999    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7426-140545741564336" event={"ID":"8f5f829b-fc9b-4527-bf28-78bb8809a0c1","Type":"ContainerStarted","Data":"39c932bbf437fabd94fcf0b689a0e7087f665dd283aa6a6dbb098749c32583c9"}
Jul 15 16:11:05.783609 ip-10-0-138-107 kubenswrapper[2564]: E0715 16:11:05.783586    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7426-140545741564080\" is forbidden: User \"system:node:ip-10-0-138-107.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-107.ec2.internal' and this object" podUID="4ca2b239-8980-4183-86e2-acd02e361fca" pod="opendatahub/test-curl-7426-140545741564080"
Jul 15 16:11:06.229635 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:06.229555    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ca2b239-8980-4183-86e2-acd02e361fca" path="/var/lib/kubelet/pods/4ca2b239-8980-4183-86e2-acd02e361fca/volumes"
Jul 15 16:11:06.780424 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:06.780389    2564 generic.go:356] "Generic (PLEG): container finished" podID="8f5f829b-fc9b-4527-bf28-78bb8809a0c1" containerID="90038ed63d9444a56636fed988d5fee54bb6e06f54646b9e98f30229f754b34e" exitCode=0
Jul 15 16:11:06.780606 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:06.780469    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7426-140545741564336" event={"ID":"8f5f829b-fc9b-4527-bf28-78bb8809a0c1","Type":"ContainerDied","Data":"90038ed63d9444a56636fed988d5fee54bb6e06f54646b9e98f30229f754b34e"}
Jul 15 16:11:07.927626 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:07.927597    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7426-140545741564336"
Jul 15 16:11:07.948341 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:07.948305    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7426-140545741564336_8f5f829b-fc9b-4527-bf28-78bb8809a0c1/test-curl-7426-140545741564336/0.log"
Jul 15 16:11:07.973438 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:07.973395    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7426-140545741564336"]
Jul 15 16:11:07.977844 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:07.977817    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7426-140545741564336"]
Jul 15 16:11:07.988780 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:07.988762    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w5sjz\" (UniqueName: \"kubernetes.io/projected/8f5f829b-fc9b-4527-bf28-78bb8809a0c1-kube-api-access-w5sjz\") pod \"8f5f829b-fc9b-4527-bf28-78bb8809a0c1\" (UID: \"8f5f829b-fc9b-4527-bf28-78bb8809a0c1\") "
Jul 15 16:11:07.990786 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:07.990756    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f5f829b-fc9b-4527-bf28-78bb8809a0c1-kube-api-access-w5sjz" (OuterVolumeSpecName: "kube-api-access-w5sjz") pod "8f5f829b-fc9b-4527-bf28-78bb8809a0c1" (UID: "8f5f829b-fc9b-4527-bf28-78bb8809a0c1"). InnerVolumeSpecName "kube-api-access-w5sjz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:11:08.090432 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:08.090352    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w5sjz\" (UniqueName: \"kubernetes.io/projected/8f5f829b-fc9b-4527-bf28-78bb8809a0c1-kube-api-access-w5sjz\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 16:11:08.149388 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:08.149350    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7426-140545741308240"]
Jul 15 16:11:08.149778 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:08.149760    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f5f829b-fc9b-4527-bf28-78bb8809a0c1" containerName="test-curl-7426-140545741564336"
Jul 15 16:11:08.149867 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:08.149781    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f5f829b-fc9b-4527-bf28-78bb8809a0c1" containerName="test-curl-7426-140545741564336"
Jul 15 16:11:08.149924 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:08.149865    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f5f829b-fc9b-4527-bf28-78bb8809a0c1" containerName="test-curl-7426-140545741564336"
Jul 15 16:11:08.151785 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:08.151765    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7426-140545741308240"
Jul 15 16:11:08.160102 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:08.160081    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7426-140545741308240"]
Jul 15 16:11:08.229970 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:08.229938    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f5f829b-fc9b-4527-bf28-78bb8809a0c1" path="/var/lib/kubelet/pods/8f5f829b-fc9b-4527-bf28-78bb8809a0c1/volumes"
Jul 15 16:11:08.291223 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:08.291200    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnfbr\" (UniqueName: \"kubernetes.io/projected/311c7dfa-2238-459a-9e61-b3a29ac520ee-kube-api-access-qnfbr\") pod \"test-curl-7426-140545741308240\" (UID: \"311c7dfa-2238-459a-9e61-b3a29ac520ee\") " pod="opendatahub/test-curl-7426-140545741308240"
Jul 15 16:11:08.315093 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:08.315071    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:11:08.392228 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:08.392168    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnfbr\" (UniqueName: \"kubernetes.io/projected/311c7dfa-2238-459a-9e61-b3a29ac520ee-kube-api-access-qnfbr\") pod \"test-curl-7426-140545741308240\" (UID: \"311c7dfa-2238-459a-9e61-b3a29ac520ee\") " pod="opendatahub/test-curl-7426-140545741308240"
Jul 15 16:11:08.401230 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:08.401205    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnfbr\" (UniqueName: \"kubernetes.io/projected/311c7dfa-2238-459a-9e61-b3a29ac520ee-kube-api-access-qnfbr\") pod \"test-curl-7426-140545741308240\" (UID: \"311c7dfa-2238-459a-9e61-b3a29ac520ee\") " pod="opendatahub/test-curl-7426-140545741308240"
Jul 15 16:11:08.413963 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:08.413936    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:11:08.460743 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:08.460720    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7426-140545741308240"
Jul 15 16:11:08.592089 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:08.592066    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7426-140545741308240"]
Jul 15 16:11:08.594077 ip-10-0-138-107 kubenswrapper[2564]: W0715 16:11:08.594049    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod311c7dfa_2238_459a_9e61_b3a29ac520ee.slice/crio-fdeec0be74fc950519614b72b31cec7870b313db860f84dd8c6369ba5daec9a4 WatchSource:0}: Error finding container fdeec0be74fc950519614b72b31cec7870b313db860f84dd8c6369ba5daec9a4: Status 404 returned error can't find the container with id fdeec0be74fc950519614b72b31cec7870b313db860f84dd8c6369ba5daec9a4
Jul 15 16:11:08.790032 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:08.789983    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7426-140545741564336"
Jul 15 16:11:08.790212 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:08.790058    2564 scope.go:117] "RemoveContainer" containerID="90038ed63d9444a56636fed988d5fee54bb6e06f54646b9e98f30229f754b34e"
Jul 15 16:11:08.791424 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:08.791233    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7426-140545741308240" event={"ID":"311c7dfa-2238-459a-9e61-b3a29ac520ee","Type":"ContainerStarted","Data":"fdeec0be74fc950519614b72b31cec7870b313db860f84dd8c6369ba5daec9a4"}
Jul 15 16:11:09.799081 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:09.799045    2564 generic.go:356] "Generic (PLEG): container finished" podID="311c7dfa-2238-459a-9e61-b3a29ac520ee" containerID="cf4556331d3dc4ba2aecf18af4208a18b3f499e38263937e80c95edb8d75b562" exitCode=0
Jul 15 16:11:09.799498 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:09.799112    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7426-140545741308240" event={"ID":"311c7dfa-2238-459a-9e61-b3a29ac520ee","Type":"ContainerDied","Data":"cf4556331d3dc4ba2aecf18af4208a18b3f499e38263937e80c95edb8d75b562"}
Jul 15 16:11:10.958551 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:10.958523    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7426-140545741308240"
Jul 15 16:11:10.979573 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:10.979538    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7426-140545741308240_311c7dfa-2238-459a-9e61-b3a29ac520ee/test-curl-7426-140545741308240/0.log"
Jul 15 16:11:11.003624 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:11.003578    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7426-140545741308240"]
Jul 15 16:11:11.007595 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:11.007567    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7426-140545741308240"]
Jul 15 16:11:11.015993 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:11.015953    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qnfbr\" (UniqueName: \"kubernetes.io/projected/311c7dfa-2238-459a-9e61-b3a29ac520ee-kube-api-access-qnfbr\") pod \"311c7dfa-2238-459a-9e61-b3a29ac520ee\" (UID: \"311c7dfa-2238-459a-9e61-b3a29ac520ee\") "
Jul 15 16:11:11.018339 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:11.018298    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/311c7dfa-2238-459a-9e61-b3a29ac520ee-kube-api-access-qnfbr" (OuterVolumeSpecName: "kube-api-access-qnfbr") pod "311c7dfa-2238-459a-9e61-b3a29ac520ee" (UID: "311c7dfa-2238-459a-9e61-b3a29ac520ee"). InnerVolumeSpecName "kube-api-access-qnfbr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:11:11.116871 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:11.116776    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qnfbr\" (UniqueName: \"kubernetes.io/projected/311c7dfa-2238-459a-9e61-b3a29ac520ee-kube-api-access-qnfbr\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 16:11:11.127567 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:11.127533    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7426-140545741308240"]
Jul 15 16:11:11.127931 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:11.127918    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="311c7dfa-2238-459a-9e61-b3a29ac520ee" containerName="test-curl-7426-140545741308240"
Jul 15 16:11:11.127973 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:11.127932    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="311c7dfa-2238-459a-9e61-b3a29ac520ee" containerName="test-curl-7426-140545741308240"
Jul 15 16:11:11.128022 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:11.128004    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="311c7dfa-2238-459a-9e61-b3a29ac520ee" containerName="test-curl-7426-140545741308240"
Jul 15 16:11:11.130150 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:11.130134    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7426-140545741308240"
Jul 15 16:11:11.134442 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:11.134417    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7426-140545741308240"]
Jul 15 16:11:11.217432 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:11.217394    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lz2zr\" (UniqueName: \"kubernetes.io/projected/24487f78-6fa4-4613-be7f-7a763cfb7842-kube-api-access-lz2zr\") pod \"test-curl-7426-140545741308240\" (UID: \"24487f78-6fa4-4613-be7f-7a763cfb7842\") " pod="opendatahub/test-curl-7426-140545741308240"
Jul 15 16:11:11.318090 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:11.318050    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lz2zr\" (UniqueName: \"kubernetes.io/projected/24487f78-6fa4-4613-be7f-7a763cfb7842-kube-api-access-lz2zr\") pod \"test-curl-7426-140545741308240\" (UID: \"24487f78-6fa4-4613-be7f-7a763cfb7842\") " pod="opendatahub/test-curl-7426-140545741308240"
Jul 15 16:11:11.326197 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:11.326164    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lz2zr\" (UniqueName: \"kubernetes.io/projected/24487f78-6fa4-4613-be7f-7a763cfb7842-kube-api-access-lz2zr\") pod \"test-curl-7426-140545741308240\" (UID: \"24487f78-6fa4-4613-be7f-7a763cfb7842\") " pod="opendatahub/test-curl-7426-140545741308240"
Jul 15 16:11:11.440754 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:11.440665    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7426-140545741308240"
Jul 15 16:11:11.574304 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:11.574206    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7426-140545741308240"]
Jul 15 16:11:11.576393 ip-10-0-138-107 kubenswrapper[2564]: W0715 16:11:11.576366    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod24487f78_6fa4_4613_be7f_7a763cfb7842.slice/crio-f53e87f7543c69730b627e40cf0b2575c965c5108d55ffe96a436a71a42a52f1 WatchSource:0}: Error finding container f53e87f7543c69730b627e40cf0b2575c965c5108d55ffe96a436a71a42a52f1: Status 404 returned error can't find the container with id f53e87f7543c69730b627e40cf0b2575c965c5108d55ffe96a436a71a42a52f1
Jul 15 16:11:11.810576 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:11.810541    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7426-140545741308240" event={"ID":"24487f78-6fa4-4613-be7f-7a763cfb7842","Type":"ContainerStarted","Data":"f53e87f7543c69730b627e40cf0b2575c965c5108d55ffe96a436a71a42a52f1"}
Jul 15 16:11:11.811703 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:11.811680    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fdeec0be74fc950519614b72b31cec7870b313db860f84dd8c6369ba5daec9a4"
Jul 15 16:11:11.811703 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:11.811701    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7426-140545741308240"
Jul 15 16:11:11.824180 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:11.824150    2564 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7426-140545741308240" oldPodUID="311c7dfa-2238-459a-9e61-b3a29ac520ee" podUID="24487f78-6fa4-4613-be7f-7a763cfb7842"
Jul 15 16:11:12.230394 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:12.230317    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="311c7dfa-2238-459a-9e61-b3a29ac520ee" path="/var/lib/kubelet/pods/311c7dfa-2238-459a-9e61-b3a29ac520ee/volumes"
Jul 15 16:11:12.818133 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:12.818095    2564 generic.go:356] "Generic (PLEG): container finished" podID="24487f78-6fa4-4613-be7f-7a763cfb7842" containerID="755ca80a0b8c293aa3cf88c3123e170d470b4c384aabb51ffc02b556f19f8003" exitCode=0
Jul 15 16:11:12.818313 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:12.818176    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7426-140545741308240" event={"ID":"24487f78-6fa4-4613-be7f-7a763cfb7842","Type":"ContainerDied","Data":"755ca80a0b8c293aa3cf88c3123e170d470b4c384aabb51ffc02b556f19f8003"}
Jul 15 16:11:13.955774 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:13.955750    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7426-140545741308240"
Jul 15 16:11:13.977913 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:13.977882    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7426-140545741308240_24487f78-6fa4-4613-be7f-7a763cfb7842/test-curl-7426-140545741308240/0.log"
Jul 15 16:11:14.003424 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:14.003391    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7426-140545741308240"]
Jul 15 16:11:14.007335 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:14.007314    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7426-140545741308240"]
Jul 15 16:11:14.041474 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:14.041450    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lz2zr\" (UniqueName: \"kubernetes.io/projected/24487f78-6fa4-4613-be7f-7a763cfb7842-kube-api-access-lz2zr\") pod \"24487f78-6fa4-4613-be7f-7a763cfb7842\" (UID: \"24487f78-6fa4-4613-be7f-7a763cfb7842\") "
Jul 15 16:11:14.043440 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:14.043411    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24487f78-6fa4-4613-be7f-7a763cfb7842-kube-api-access-lz2zr" (OuterVolumeSpecName: "kube-api-access-lz2zr") pod "24487f78-6fa4-4613-be7f-7a763cfb7842" (UID: "24487f78-6fa4-4613-be7f-7a763cfb7842"). InnerVolumeSpecName "kube-api-access-lz2zr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:11:14.143092 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:14.142981    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lz2zr\" (UniqueName: \"kubernetes.io/projected/24487f78-6fa4-4613-be7f-7a763cfb7842-kube-api-access-lz2zr\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 16:11:14.153497 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:14.153470    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7426-140545741309248"]
Jul 15 16:11:14.153832 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:14.153819    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24487f78-6fa4-4613-be7f-7a763cfb7842" containerName="test-curl-7426-140545741308240"
Jul 15 16:11:14.153877 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:14.153834    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="24487f78-6fa4-4613-be7f-7a763cfb7842" containerName="test-curl-7426-140545741308240"
Jul 15 16:11:14.153913 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:14.153904    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="24487f78-6fa4-4613-be7f-7a763cfb7842" containerName="test-curl-7426-140545741308240"
Jul 15 16:11:14.156620 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:14.156602    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7426-140545741309248"
Jul 15 16:11:14.164767 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:14.164744    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7426-140545741309248"]
Jul 15 16:11:14.229618 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:14.229588    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24487f78-6fa4-4613-be7f-7a763cfb7842" path="/var/lib/kubelet/pods/24487f78-6fa4-4613-be7f-7a763cfb7842/volumes"
Jul 15 16:11:14.243481 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:14.243461    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtclw\" (UniqueName: \"kubernetes.io/projected/8ba86dc8-dd4f-42cd-8b1c-8b8f9ac41237-kube-api-access-vtclw\") pod \"test-curl-7426-140545741309248\" (UID: \"8ba86dc8-dd4f-42cd-8b1c-8b8f9ac41237\") " pod="opendatahub/test-curl-7426-140545741309248"
Jul 15 16:11:14.344108 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:14.344080    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtclw\" (UniqueName: \"kubernetes.io/projected/8ba86dc8-dd4f-42cd-8b1c-8b8f9ac41237-kube-api-access-vtclw\") pod \"test-curl-7426-140545741309248\" (UID: \"8ba86dc8-dd4f-42cd-8b1c-8b8f9ac41237\") " pod="opendatahub/test-curl-7426-140545741309248"
Jul 15 16:11:14.354957 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:14.354931    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtclw\" (UniqueName: \"kubernetes.io/projected/8ba86dc8-dd4f-42cd-8b1c-8b8f9ac41237-kube-api-access-vtclw\") pod \"test-curl-7426-140545741309248\" (UID: \"8ba86dc8-dd4f-42cd-8b1c-8b8f9ac41237\") " pod="opendatahub/test-curl-7426-140545741309248"
Jul 15 16:11:14.466581 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:14.466499    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7426-140545741309248"
Jul 15 16:11:14.597606 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:14.597582    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7426-140545741309248"]
Jul 15 16:11:14.599369 ip-10-0-138-107 kubenswrapper[2564]: W0715 16:11:14.599345    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8ba86dc8_dd4f_42cd_8b1c_8b8f9ac41237.slice/crio-f23ae613e5e1ac2853c5dbeae5c75dec6412ed367558248616fd791f72f7637a WatchSource:0}: Error finding container f23ae613e5e1ac2853c5dbeae5c75dec6412ed367558248616fd791f72f7637a: Status 404 returned error can't find the container with id f23ae613e5e1ac2853c5dbeae5c75dec6412ed367558248616fd791f72f7637a
Jul 15 16:11:14.828813 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:14.828781    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7426-140545741308240"
Jul 15 16:11:14.828976 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:14.828832    2564 scope.go:117] "RemoveContainer" containerID="755ca80a0b8c293aa3cf88c3123e170d470b4c384aabb51ffc02b556f19f8003"
Jul 15 16:11:14.830169 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:14.830043    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7426-140545741309248" event={"ID":"8ba86dc8-dd4f-42cd-8b1c-8b8f9ac41237","Type":"ContainerStarted","Data":"f23ae613e5e1ac2853c5dbeae5c75dec6412ed367558248616fd791f72f7637a"}
Jul 15 16:11:15.837573 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:15.837533    2564 generic.go:356] "Generic (PLEG): container finished" podID="8ba86dc8-dd4f-42cd-8b1c-8b8f9ac41237" containerID="be4bfbc865b856d49053dae8368dbcd54de1588184761e404fb34cc7826f9466" exitCode=0
Jul 15 16:11:15.838058 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:15.837627    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7426-140545741309248" event={"ID":"8ba86dc8-dd4f-42cd-8b1c-8b8f9ac41237","Type":"ContainerDied","Data":"be4bfbc865b856d49053dae8368dbcd54de1588184761e404fb34cc7826f9466"}
Jul 15 16:11:16.977294 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:16.977272    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7426-140545741309248"
Jul 15 16:11:16.998363 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:16.998336    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7426-140545741309248_8ba86dc8-dd4f-42cd-8b1c-8b8f9ac41237/test-curl-7426-140545741309248/0.log"
Jul 15 16:11:17.022948 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:17.022916    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7426-140545741309248"]
Jul 15 16:11:17.028766 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:17.028743    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7426-140545741309248"]
Jul 15 16:11:17.067388 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:17.067363    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vtclw\" (UniqueName: \"kubernetes.io/projected/8ba86dc8-dd4f-42cd-8b1c-8b8f9ac41237-kube-api-access-vtclw\") pod \"8ba86dc8-dd4f-42cd-8b1c-8b8f9ac41237\" (UID: \"8ba86dc8-dd4f-42cd-8b1c-8b8f9ac41237\") "
Jul 15 16:11:17.069393 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:17.069367    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ba86dc8-dd4f-42cd-8b1c-8b8f9ac41237-kube-api-access-vtclw" (OuterVolumeSpecName: "kube-api-access-vtclw") pod "8ba86dc8-dd4f-42cd-8b1c-8b8f9ac41237" (UID: "8ba86dc8-dd4f-42cd-8b1c-8b8f9ac41237"). InnerVolumeSpecName "kube-api-access-vtclw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:11:17.168858 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:17.168782    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vtclw\" (UniqueName: \"kubernetes.io/projected/8ba86dc8-dd4f-42cd-8b1c-8b8f9ac41237-kube-api-access-vtclw\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 16:11:17.848028 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:17.847981    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f23ae613e5e1ac2853c5dbeae5c75dec6412ed367558248616fd791f72f7637a"
Jul 15 16:11:17.848028 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:17.847989    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7426-140545741309248"
Jul 15 16:11:17.857766 ip-10-0-138-107 kubenswrapper[2564]: E0715 16:11:17.857738    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7426-140545741309248\" is forbidden: User \"system:node:ip-10-0-138-107.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-107.ec2.internal' and this object" podUID="8ba86dc8-dd4f-42cd-8b1c-8b8f9ac41237" pod="opendatahub/test-curl-7426-140545741309248"
Jul 15 16:11:18.229936 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:18.229854    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ba86dc8-dd4f-42cd-8b1c-8b8f9ac41237" path="/var/lib/kubelet/pods/8ba86dc8-dd4f-42cd-8b1c-8b8f9ac41237/volumes"
Jul 15 16:11:20.690157 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:20.690119    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:11:20.797509 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:20.797455    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:11:30.744473 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:30.744388    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:11:35.273501 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:35.273469    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:11:41.266600 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:41.266558    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:11:41.337212 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:41.337181    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:11:45.903907 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:45.903874    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk"]
Jul 15 16:11:45.904358 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:45.904159    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk" podUID="fbd893bd-b196-4dd4-842f-1783b533b000" containerName="istio-proxy" containerID="cri-o://c55f37745311bec0735f57e62043f61ac776e93e0cd3aeef595fe1c9f2063f0f" gracePeriod=30
Jul 15 16:11:45.927589 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:45.927563    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:11:46.159871 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:46.159792    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:11:46.850802 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:46.850764    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:11:46.951829 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:46.951789    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:11:51.153206 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:51.153185    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk"
Jul 15 16:11:51.251726 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:51.251643    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbd893bd-b196-4dd4-842f-1783b533b000-credential-socket\") pod \"fbd893bd-b196-4dd4-842f-1783b533b000\" (UID: \"fbd893bd-b196-4dd4-842f-1783b533b000\") "
Jul 15 16:11:51.251726 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:51.251677    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7bxzv\" (UniqueName: \"kubernetes.io/projected/fbd893bd-b196-4dd4-842f-1783b533b000-kube-api-access-7bxzv\") pod \"fbd893bd-b196-4dd4-842f-1783b533b000\" (UID: \"fbd893bd-b196-4dd4-842f-1783b533b000\") "
Jul 15 16:11:51.251726 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:51.251696    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fbd893bd-b196-4dd4-842f-1783b533b000-istio-token\") pod \"fbd893bd-b196-4dd4-842f-1783b533b000\" (UID: \"fbd893bd-b196-4dd4-842f-1783b533b000\") "
Jul 15 16:11:51.252040 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:51.251767    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fbd893bd-b196-4dd4-842f-1783b533b000-workload-certs\") pod \"fbd893bd-b196-4dd4-842f-1783b533b000\" (UID: \"fbd893bd-b196-4dd4-842f-1783b533b000\") "
Jul 15 16:11:51.252040 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:51.251797    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fbd893bd-b196-4dd4-842f-1783b533b000-istio-podinfo\") pod \"fbd893bd-b196-4dd4-842f-1783b533b000\" (UID: \"fbd893bd-b196-4dd4-842f-1783b533b000\") "
Jul 15 16:11:51.252040 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:51.251817    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fbd893bd-b196-4dd4-842f-1783b533b000-istio-data\") pod \"fbd893bd-b196-4dd4-842f-1783b533b000\" (UID: \"fbd893bd-b196-4dd4-842f-1783b533b000\") "
Jul 15 16:11:51.252040 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:51.251838    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbd893bd-b196-4dd4-842f-1783b533b000-workload-socket\") pod \"fbd893bd-b196-4dd4-842f-1783b533b000\" (UID: \"fbd893bd-b196-4dd4-842f-1783b533b000\") "
Jul 15 16:11:51.252040 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:51.251888    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fbd893bd-b196-4dd4-842f-1783b533b000-istio-envoy\") pod \"fbd893bd-b196-4dd4-842f-1783b533b000\" (UID: \"fbd893bd-b196-4dd4-842f-1783b533b000\") "
Jul 15 16:11:51.252040 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:51.251917    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fbd893bd-b196-4dd4-842f-1783b533b000-istiod-ca-cert\") pod \"fbd893bd-b196-4dd4-842f-1783b533b000\" (UID: \"fbd893bd-b196-4dd4-842f-1783b533b000\") "
Jul 15 16:11:51.252340 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:51.252035    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbd893bd-b196-4dd4-842f-1783b533b000-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fbd893bd-b196-4dd4-842f-1783b533b000" (UID: "fbd893bd-b196-4dd4-842f-1783b533b000"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:11:51.252340 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:51.252178    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbd893bd-b196-4dd4-842f-1783b533b000-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fbd893bd-b196-4dd4-842f-1783b533b000" (UID: "fbd893bd-b196-4dd4-842f-1783b533b000"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:11:51.252340 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:51.252259    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbd893bd-b196-4dd4-842f-1783b533b000-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fbd893bd-b196-4dd4-842f-1783b533b000" (UID: "fbd893bd-b196-4dd4-842f-1783b533b000"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:11:51.252550 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:51.252516    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fbd893bd-b196-4dd4-842f-1783b533b000-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fbd893bd-b196-4dd4-842f-1783b533b000" (UID: "fbd893bd-b196-4dd4-842f-1783b533b000"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 16:11:51.252619 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:51.252536    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbd893bd-b196-4dd4-842f-1783b533b000-workload-socket\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 16:11:51.252680 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:51.252644    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbd893bd-b196-4dd4-842f-1783b533b000-credential-socket\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 16:11:51.252900 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:51.252869    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbd893bd-b196-4dd4-842f-1783b533b000-istio-data" (OuterVolumeSpecName: "istio-data") pod "fbd893bd-b196-4dd4-842f-1783b533b000" (UID: "fbd893bd-b196-4dd4-842f-1783b533b000"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:11:51.254195 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:51.254171    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbd893bd-b196-4dd4-842f-1783b533b000-kube-api-access-7bxzv" (OuterVolumeSpecName: "kube-api-access-7bxzv") pod "fbd893bd-b196-4dd4-842f-1783b533b000" (UID: "fbd893bd-b196-4dd4-842f-1783b533b000"). InnerVolumeSpecName "kube-api-access-7bxzv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:11:51.254318 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:51.254192    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbd893bd-b196-4dd4-842f-1783b533b000-istio-token" (OuterVolumeSpecName: "istio-token") pod "fbd893bd-b196-4dd4-842f-1783b533b000" (UID: "fbd893bd-b196-4dd4-842f-1783b533b000"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:11:51.254496 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:51.254471    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbd893bd-b196-4dd4-842f-1783b533b000-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fbd893bd-b196-4dd4-842f-1783b533b000" (UID: "fbd893bd-b196-4dd4-842f-1783b533b000"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:11:51.254586 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:51.254526    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fbd893bd-b196-4dd4-842f-1783b533b000-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fbd893bd-b196-4dd4-842f-1783b533b000" (UID: "fbd893bd-b196-4dd4-842f-1783b533b000"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 16:11:51.353260 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:51.353226    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fbd893bd-b196-4dd4-842f-1783b533b000-workload-certs\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 16:11:51.353260 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:51.353255    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fbd893bd-b196-4dd4-842f-1783b533b000-istio-podinfo\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 16:11:51.353260 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:51.353265    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fbd893bd-b196-4dd4-842f-1783b533b000-istio-data\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 16:11:51.353472 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:51.353273    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fbd893bd-b196-4dd4-842f-1783b533b000-istio-envoy\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 16:11:51.353472 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:51.353280    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fbd893bd-b196-4dd4-842f-1783b533b000-istiod-ca-cert\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 16:11:51.353472 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:51.353288    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7bxzv\" (UniqueName: \"kubernetes.io/projected/fbd893bd-b196-4dd4-842f-1783b533b000-kube-api-access-7bxzv\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 16:11:51.353472 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:51.353298    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fbd893bd-b196-4dd4-842f-1783b533b000-istio-token\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\""
Jul 15 16:11:52.014740 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:52.014708    2564 generic.go:356] "Generic (PLEG): container finished" podID="fbd893bd-b196-4dd4-842f-1783b533b000" containerID="c55f37745311bec0735f57e62043f61ac776e93e0cd3aeef595fe1c9f2063f0f" exitCode=0
Jul 15 16:11:52.014938 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:52.014756    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk"
Jul 15 16:11:52.014938 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:52.014782    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk" event={"ID":"fbd893bd-b196-4dd4-842f-1783b533b000","Type":"ContainerDied","Data":"c55f37745311bec0735f57e62043f61ac776e93e0cd3aeef595fe1c9f2063f0f"}
Jul 15 16:11:52.014938 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:52.014832    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk" event={"ID":"fbd893bd-b196-4dd4-842f-1783b533b000","Type":"ContainerDied","Data":"0ee61081760adcba12c5e9b7b510358d72ac7b6f6fa0326766132566dd090cd8"}
Jul 15 16:11:52.014938 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:52.014860    2564 scope.go:117] "RemoveContainer" containerID="c55f37745311bec0735f57e62043f61ac776e93e0cd3aeef595fe1c9f2063f0f"
Jul 15 16:11:52.023884 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:52.023721    2564 scope.go:117] "RemoveContainer" containerID="b20371a8bad7392cadbd1e6e3c35a673ab4cfe5477e18a0084163e7df2b62bb8"
Jul 15 16:11:52.031268 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:52.031249    2564 scope.go:117] "RemoveContainer" containerID="c55f37745311bec0735f57e62043f61ac776e93e0cd3aeef595fe1c9f2063f0f"
Jul 15 16:11:52.031494 ip-10-0-138-107 kubenswrapper[2564]: E0715 16:11:52.031476    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c55f37745311bec0735f57e62043f61ac776e93e0cd3aeef595fe1c9f2063f0f\": container with ID starting with c55f37745311bec0735f57e62043f61ac776e93e0cd3aeef595fe1c9f2063f0f not found: ID does not exist" containerID="c55f37745311bec0735f57e62043f61ac776e93e0cd3aeef595fe1c9f2063f0f"
Jul 15 16:11:52.031556 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:52.031501    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c55f37745311bec0735f57e62043f61ac776e93e0cd3aeef595fe1c9f2063f0f"} err="failed to get container status \"c55f37745311bec0735f57e62043f61ac776e93e0cd3aeef595fe1c9f2063f0f\": rpc error: code = NotFound desc = could not find container \"c55f37745311bec0735f57e62043f61ac776e93e0cd3aeef595fe1c9f2063f0f\": container with ID starting with c55f37745311bec0735f57e62043f61ac776e93e0cd3aeef595fe1c9f2063f0f not found: ID does not exist"
Jul 15 16:11:52.031556 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:52.031516    2564 scope.go:117] "RemoveContainer" containerID="b20371a8bad7392cadbd1e6e3c35a673ab4cfe5477e18a0084163e7df2b62bb8"
Jul 15 16:11:52.031743 ip-10-0-138-107 kubenswrapper[2564]: E0715 16:11:52.031725    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b20371a8bad7392cadbd1e6e3c35a673ab4cfe5477e18a0084163e7df2b62bb8\": container with ID starting with b20371a8bad7392cadbd1e6e3c35a673ab4cfe5477e18a0084163e7df2b62bb8 not found: ID does not exist" containerID="b20371a8bad7392cadbd1e6e3c35a673ab4cfe5477e18a0084163e7df2b62bb8"
Jul 15 16:11:52.031782 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:52.031750    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b20371a8bad7392cadbd1e6e3c35a673ab4cfe5477e18a0084163e7df2b62bb8"} err="failed to get container status \"b20371a8bad7392cadbd1e6e3c35a673ab4cfe5477e18a0084163e7df2b62bb8\": rpc error: code = NotFound desc = could not find container \"b20371a8bad7392cadbd1e6e3c35a673ab4cfe5477e18a0084163e7df2b62bb8\": container with ID starting with b20371a8bad7392cadbd1e6e3c35a673ab4cfe5477e18a0084163e7df2b62bb8 not found: ID does not exist"
Jul 15 16:11:52.036563 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:52.036544    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk"]
Jul 15 16:11:52.039996 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:52.039976    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-0e8a6d-openshift-default-6c6d86fd99-z4ltk"]
Jul 15 16:11:52.229061 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:52.229029    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fbd893bd-b196-4dd4-842f-1783b533b000" path="/var/lib/kubelet/pods/fbd893bd-b196-4dd4-842f-1783b533b000/volumes"
Jul 15 16:11:54.466519 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:54.466481    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:11:54.568020 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:54.567970    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:11:56.767392 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:11:56.767361    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:12:01.391513 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:01.391478    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:12:07.446106 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:07.446057    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:12:07.600229 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:07.600188    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:12:12.054053 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:12.054000    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:12:12.670649 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:12.670614    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:12:12.726275 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:12.726249    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-8895cdf46-r8qzc_7d663bc6-0c06-4a6b-b3ef-110c7dc102b2/authorino/0.log"
Jul 15 16:12:18.010098 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:18.010068    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-zxthv_4453b8ac-b9f4-41ed-8e3f-bba488ac06b2/manager/0.log"
Jul 15 16:12:18.265395 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:18.265369    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5cd4d7f4b-8p4dt_08e4af4b-218a-4da1-89fd-70879c3f667e/manager/0.log"
Jul 15 16:12:18.383864 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:18.383841    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-q8bzp_7e8984c0-7e1a-4afd-94f0-6cdd0be45a72/server/0.log"
Jul 15 16:12:18.765251 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:18.765228    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-997df6bcb-m729w_fb86e760-6359-4782-951e-efdd754f92eb/copy-manifests/0.log"
Jul 15 16:12:18.773049 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:18.773001    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-997df6bcb-m729w_fb86e760-6359-4782-951e-efdd754f92eb/manager/0.log"
Jul 15 16:12:19.285824 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:19.285793    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-7f9fbcfccc-vt5w7_2ed8a773-3c36-4963-8b3d-58133f7b3e28/maas-api/0.log"
Jul 15 16:12:21.047983 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:21.047956    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-kj4g2_427413c9-36f1-4436-aeff-87dd01b082d0/postgres/0.log"
Jul 15 16:12:22.401651 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:22.401575    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-8895cdf46-r8qzc_7d663bc6-0c06-4a6b-b3ef-110c7dc102b2/authorino/0.log"
Jul 15 16:12:22.531459 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:22.531435    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-bt4wd_0c64aca6-02b3-4b3a-8b89-a56236f723e3/manager/0.log"
Jul 15 16:12:22.766139 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:22.766094    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-msb4m_96e9a46a-13b8-44a4-8957-5ce949b7cb55/kuadrant-console-plugin/0.log"
Jul 15 16:12:22.917480 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:22.917444    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-54xvn_4a202ae9-c06f-4d43-b2ec-95506cc0fc12/registry-server/0.log"
Jul 15 16:12:23.272368 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:23.272332    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-bk6sq_60a117be-18a8-4b05-93d6-cfc3b0f2b0cb/manager/0.log"
Jul 15 16:12:23.861794 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:23.861766    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-c788dcdb-5mzwg_be9de479-25d3-477b-ae77-1efaa1107bb4/kube-auth-proxy/0.log"
Jul 15 16:12:24.095333 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:24.095300    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-cvc9d_6305fffd-77fc-4b0f-8ea3-1cac9f591cf6/istio-proxy/1.log"
Jul 15 16:12:24.220588 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:24.220501    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-7fwng_1871f089-c640-4943-a0fa-e1c448360d7a/payload-pre-processing/0.log"
Jul 15 16:12:24.359985 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:24.359957    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-d479t_fa273192-872f-4d2d-bcdc-35e85bc99485/payload-processing/0.log"
Jul 15 16:12:24.808350 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:24.808303    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-kxzrj_361d3522-de9e-4e9a-8044-90870a465418/main/0.log"
Jul 15 16:12:24.924715 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:24.924683    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-257b2_7aa492f4-8db2-42e2-8fc8-5c1dfb6c1389/main/0.log"
Jul 15 16:12:25.062105 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:25.062001    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-5l6c7_b574fc8d-fe95-4449-a66f-2d506ccfc994/main/0.log"
Jul 15 16:12:25.296451 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:25.296423    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-8s6gj_3e02f457-254c-438b-9574-56b9d1cb2fd0/main/0.log"
Jul 15 16:12:30.432406 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:30.432370    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:12:30.813678 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:30.813643    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:12:30.893523 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:30.893491    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log" limit=1024
Jul 15 16:12:33.739210 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:33.739178    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-rbktn_3988961d-1cd0-4fd2-aa28-80610f3ed94b/global-pull-secret-syncer/0.log"
Jul 15 16:12:33.838300 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:33.838277    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-bz8r7_aa03530f-36a5-49a7-b513-1add7f6af1ce/konnectivity-agent/0.log"
Jul 15 16:12:33.952682 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:33.952659    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-107.ec2.internal_ab8a58b7f0cfe687e1e923428993b5f1/haproxy/0.log"
Jul 15 16:12:38.625640 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:38.625608    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-8895cdf46-r8qzc_7d663bc6-0c06-4a6b-b3ef-110c7dc102b2/authorino/0.log"
Jul 15 16:12:38.654062 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:38.654034    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-bt4wd_0c64aca6-02b3-4b3a-8b89-a56236f723e3/manager/0.log"
Jul 15 16:12:38.706930 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:38.706902    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-msb4m_96e9a46a-13b8-44a4-8957-5ce949b7cb55/kuadrant-console-plugin/0.log"
Jul 15 16:12:38.767250 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:38.767226    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-54xvn_4a202ae9-c06f-4d43-b2ec-95506cc0fc12/registry-server/0.log"
Jul 15 16:12:39.035074 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:39.035045    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-bk6sq_60a117be-18a8-4b05-93d6-cfc3b0f2b0cb/manager/0.log"
Jul 15 16:12:40.921829 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:40.921803    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gljcq_3b9c1313-c5b7-418b-87d3-f49279a40c79/node-exporter/0.log"
Jul 15 16:12:40.944748 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:40.944727    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gljcq_3b9c1313-c5b7-418b-87d3-f49279a40c79/kube-rbac-proxy/0.log"
Jul 15 16:12:40.969594 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:40.969576    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gljcq_3b9c1313-c5b7-418b-87d3-f49279a40c79/init-textfile/0.log"
Jul 15 16:12:43.662103 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:43.662070    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-xf74v/perf-node-gather-daemonset-t5tgz"]
Jul 15 16:12:43.662542 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:43.662451    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbd893bd-b196-4dd4-842f-1783b533b000" containerName="istio-proxy"
Jul 15 16:12:43.662542 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:43.662464    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbd893bd-b196-4dd4-842f-1783b533b000" containerName="istio-proxy"
Jul 15 16:12:43.662542 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:43.662490    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ba86dc8-dd4f-42cd-8b1c-8b8f9ac41237" containerName="test-curl-7426-140545741309248"
Jul 15 16:12:43.662542 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:43.662496    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ba86dc8-dd4f-42cd-8b1c-8b8f9ac41237" containerName="test-curl-7426-140545741309248"
Jul 15 16:12:43.662683 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:43.662550    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="fbd893bd-b196-4dd4-842f-1783b533b000" containerName="istio-proxy"
Jul 15 16:12:43.662683 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:43.662559    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="fbd893bd-b196-4dd4-842f-1783b533b000" containerName="istio-proxy"
Jul 15 16:12:43.662683 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:43.662568    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ba86dc8-dd4f-42cd-8b1c-8b8f9ac41237" containerName="test-curl-7426-140545741309248"
Jul 15 16:12:43.665644 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:43.665624    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xf74v/perf-node-gather-daemonset-t5tgz"
Jul 15 16:12:43.668327 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:43.668308    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-xf74v\"/\"default-dockercfg-76hpf\""
Jul 15 16:12:43.668422 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:43.668412    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xf74v\"/\"kube-root-ca.crt\""
Jul 15 16:12:43.669190 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:43.669176    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xf74v\"/\"openshift-service-ca.crt\""
Jul 15 16:12:43.676043 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:43.675993    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xf74v/perf-node-gather-daemonset-t5tgz"]
Jul 15 16:12:43.784191 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:43.784159    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/649cb0f7-6dc5-44b4-bab3-68db562b127a-lib-modules\") pod \"perf-node-gather-daemonset-t5tgz\" (UID: \"649cb0f7-6dc5-44b4-bab3-68db562b127a\") " pod="openshift-must-gather-xf74v/perf-node-gather-daemonset-t5tgz"
Jul 15 16:12:43.784191 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:43.784193    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/649cb0f7-6dc5-44b4-bab3-68db562b127a-podres\") pod \"perf-node-gather-daemonset-t5tgz\" (UID: \"649cb0f7-6dc5-44b4-bab3-68db562b127a\") " pod="openshift-must-gather-xf74v/perf-node-gather-daemonset-t5tgz"
Jul 15 16:12:43.784551 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:43.784216    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7wx5\" (UniqueName: \"kubernetes.io/projected/649cb0f7-6dc5-44b4-bab3-68db562b127a-kube-api-access-z7wx5\") pod \"perf-node-gather-daemonset-t5tgz\" (UID: \"649cb0f7-6dc5-44b4-bab3-68db562b127a\") " pod="openshift-must-gather-xf74v/perf-node-gather-daemonset-t5tgz"
Jul 15 16:12:43.784551 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:43.784391    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/649cb0f7-6dc5-44b4-bab3-68db562b127a-proc\") pod \"perf-node-gather-daemonset-t5tgz\" (UID: \"649cb0f7-6dc5-44b4-bab3-68db562b127a\") " pod="openshift-must-gather-xf74v/perf-node-gather-daemonset-t5tgz"
Jul 15 16:12:43.784551 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:43.784477    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/649cb0f7-6dc5-44b4-bab3-68db562b127a-sys\") pod \"perf-node-gather-daemonset-t5tgz\" (UID: \"649cb0f7-6dc5-44b4-bab3-68db562b127a\") " pod="openshift-must-gather-xf74v/perf-node-gather-daemonset-t5tgz"
Jul 15 16:12:43.885287 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:43.885256    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/649cb0f7-6dc5-44b4-bab3-68db562b127a-proc\") pod \"perf-node-gather-daemonset-t5tgz\" (UID: \"649cb0f7-6dc5-44b4-bab3-68db562b127a\") " pod="openshift-must-gather-xf74v/perf-node-gather-daemonset-t5tgz"
Jul 15 16:12:43.885484 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:43.885314    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/649cb0f7-6dc5-44b4-bab3-68db562b127a-sys\") pod \"perf-node-gather-daemonset-t5tgz\" (UID: \"649cb0f7-6dc5-44b4-bab3-68db562b127a\") " pod="openshift-must-gather-xf74v/perf-node-gather-daemonset-t5tgz"
Jul 15 16:12:43.885484 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:43.885343    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/649cb0f7-6dc5-44b4-bab3-68db562b127a-lib-modules\") pod \"perf-node-gather-daemonset-t5tgz\" (UID: \"649cb0f7-6dc5-44b4-bab3-68db562b127a\") " pod="openshift-must-gather-xf74v/perf-node-gather-daemonset-t5tgz"
Jul 15 16:12:43.885484 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:43.885359    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/649cb0f7-6dc5-44b4-bab3-68db562b127a-podres\") pod \"perf-node-gather-daemonset-t5tgz\" (UID: \"649cb0f7-6dc5-44b4-bab3-68db562b127a\") " pod="openshift-must-gather-xf74v/perf-node-gather-daemonset-t5tgz"
Jul 15 16:12:43.885484 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:43.885375    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7wx5\" (UniqueName: \"kubernetes.io/projected/649cb0f7-6dc5-44b4-bab3-68db562b127a-kube-api-access-z7wx5\") pod \"perf-node-gather-daemonset-t5tgz\" (UID: \"649cb0f7-6dc5-44b4-bab3-68db562b127a\") " pod="openshift-must-gather-xf74v/perf-node-gather-daemonset-t5tgz"
Jul 15 16:12:43.885484 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:43.885396    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/649cb0f7-6dc5-44b4-bab3-68db562b127a-proc\") pod \"perf-node-gather-daemonset-t5tgz\" (UID: \"649cb0f7-6dc5-44b4-bab3-68db562b127a\") " pod="openshift-must-gather-xf74v/perf-node-gather-daemonset-t5tgz"
Jul 15 16:12:43.885484 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:43.885443    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/649cb0f7-6dc5-44b4-bab3-68db562b127a-sys\") pod \"perf-node-gather-daemonset-t5tgz\" (UID: \"649cb0f7-6dc5-44b4-bab3-68db562b127a\") " pod="openshift-must-gather-xf74v/perf-node-gather-daemonset-t5tgz"
Jul 15 16:12:43.885700 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:43.885508    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/649cb0f7-6dc5-44b4-bab3-68db562b127a-lib-modules\") pod \"perf-node-gather-daemonset-t5tgz\" (UID: \"649cb0f7-6dc5-44b4-bab3-68db562b127a\") " pod="openshift-must-gather-xf74v/perf-node-gather-daemonset-t5tgz"
Jul 15 16:12:43.885700 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:43.885508    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/649cb0f7-6dc5-44b4-bab3-68db562b127a-podres\") pod \"perf-node-gather-daemonset-t5tgz\" (UID: \"649cb0f7-6dc5-44b4-bab3-68db562b127a\") " pod="openshift-must-gather-xf74v/perf-node-gather-daemonset-t5tgz"
Jul 15 16:12:43.894665 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:43.894644    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7wx5\" (UniqueName: \"kubernetes.io/projected/649cb0f7-6dc5-44b4-bab3-68db562b127a-kube-api-access-z7wx5\") pod \"perf-node-gather-daemonset-t5tgz\" (UID: \"649cb0f7-6dc5-44b4-bab3-68db562b127a\") " pod="openshift-must-gather-xf74v/perf-node-gather-daemonset-t5tgz"
Jul 15 16:12:43.975644 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:43.975577    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xf74v/perf-node-gather-daemonset-t5tgz"
Jul 15 16:12:44.110051 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:44.110021    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xf74v/perf-node-gather-daemonset-t5tgz"]
Jul 15 16:12:44.111969 ip-10-0-138-107 kubenswrapper[2564]: W0715 16:12:44.111939    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod649cb0f7_6dc5_44b4_bab3_68db562b127a.slice/crio-62feedb48871fc106789bb646fef967895dcacbb7c697865e257eb62f349c819 WatchSource:0}: Error finding container 62feedb48871fc106789bb646fef967895dcacbb7c697865e257eb62f349c819: Status 404 returned error can't find the container with id 62feedb48871fc106789bb646fef967895dcacbb7c697865e257eb62f349c819
Jul 15 16:12:44.250048 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:44.249959    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xf74v/perf-node-gather-daemonset-t5tgz" event={"ID":"649cb0f7-6dc5-44b4-bab3-68db562b127a","Type":"ContainerStarted","Data":"62feedb48871fc106789bb646fef967895dcacbb7c697865e257eb62f349c819"}
Jul 15 16:12:45.255746 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:45.255713    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xf74v/perf-node-gather-daemonset-t5tgz" event={"ID":"649cb0f7-6dc5-44b4-bab3-68db562b127a","Type":"ContainerStarted","Data":"3523e8c8d0143eb53b14da462f89ac42b97be3995bb2d105958669ecc338a902"}
Jul 15 16:12:45.256142 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:45.255836    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-xf74v/perf-node-gather-daemonset-t5tgz"
Jul 15 16:12:45.273121 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:45.273077    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-xf74v/perf-node-gather-daemonset-t5tgz" podStartSLOduration=2.273064256 podStartE2EDuration="2.273064256s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 16:12:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:12:45.271313365 +0000 UTC m=+2895.617216569" watchObservedRunningTime="2026-07-15 16:12:45.273064256 +0000 UTC m=+2895.618967449"
Jul 15 16:12:45.944483 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:45.944454    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4dk4d_d0a4fbae-6823-41cb-9e55-76a71200d50e/dns/0.log"
Jul 15 16:12:45.970192 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:45.970167    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4dk4d_d0a4fbae-6823-41cb-9e55-76a71200d50e/kube-rbac-proxy/0.log"
Jul 15 16:12:46.090812 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:46.090787    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4bhw5_52587e3b-cd74-43d1-86aa-29a127627f90/dns-node-resolver/0.log"
Jul 15 16:12:46.687689 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:46.687665    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dq4f9_bd4f0795-8b44-4ea5-9a78-6c790d60ab3d/node-ca/0.log"
Jul 15 16:12:47.822590 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:47.822562    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-c788dcdb-5mzwg_be9de479-25d3-477b-ae77-1efaa1107bb4/kube-auth-proxy/0.log"
Jul 15 16:12:47.871102 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:47.871068    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-cvc9d_6305fffd-77fc-4b0f-8ea3-1cac9f591cf6/istio-proxy/0.log"
Jul 15 16:12:47.932317 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:47.932294    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-cvc9d_6305fffd-77fc-4b0f-8ea3-1cac9f591cf6/istio-proxy/1.log"
Jul 15 16:12:47.971637 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:47.971611    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-7fwng_1871f089-c640-4943-a0fa-e1c448360d7a/payload-pre-processing/0.log"
Jul 15 16:12:48.009181 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:48.009151    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-d479t_fa273192-872f-4d2d-bcdc-35e85bc99485/payload-processing/0.log"
Jul 15 16:12:48.732105 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:48.732072    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7np6g_0f6fd386-c683-4903-8dcb-1a2d19d4697e/serve-healthcheck-canary/0.log"
Jul 15 16:12:49.342783 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:49.342761    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5ttpp_6aa4a480-d68b-4d9b-94c3-4e96179cea3b/kube-rbac-proxy/0.log"
Jul 15 16:12:49.367261 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:49.367238    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5ttpp_6aa4a480-d68b-4d9b-94c3-4e96179cea3b/exporter/0.log"
Jul 15 16:12:49.392401 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:49.392383    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5ttpp_6aa4a480-d68b-4d9b-94c3-4e96179cea3b/extractor/0.log"
Jul 15 16:12:51.269389 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:51.269360    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-xf74v/perf-node-gather-daemonset-t5tgz"
Jul 15 16:12:51.547071 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:51.546984    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-zxthv_4453b8ac-b9f4-41ed-8e3f-bba488ac06b2/manager/0.log"
Jul 15 16:12:51.912762 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:51.912686    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5cd4d7f4b-8p4dt_08e4af4b-218a-4da1-89fd-70879c3f667e/manager/0.log"
Jul 15 16:12:51.932690 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:51.932662    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-q8bzp_7e8984c0-7e1a-4afd-94f0-6cdd0be45a72/server/0.log"
Jul 15 16:12:52.075194 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:52.075166    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-997df6bcb-m729w_fb86e760-6359-4782-951e-efdd754f92eb/manager/0.log"
Jul 15 16:12:52.096465 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:52.096446    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-997df6bcb-m729w_fb86e760-6359-4782-951e-efdd754f92eb/copy-manifests/0.log"
Jul 15 16:12:54.514281 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:54.514244    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-c788dcdb-5mzwg_be9de479-25d3-477b-ae77-1efaa1107bb4/kube-auth-proxy/0.log"
Jul 15 16:12:54.552161 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:54.552136    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-cvc9d_6305fffd-77fc-4b0f-8ea3-1cac9f591cf6/istio-proxy/0.log"
Jul 15 16:12:54.611326 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:54.611296    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-cvc9d_6305fffd-77fc-4b0f-8ea3-1cac9f591cf6/istio-proxy/1.log"
Jul 15 16:12:54.637459 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:54.637424    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-7fwng_1871f089-c640-4943-a0fa-e1c448360d7a/payload-pre-processing/0.log"
Jul 15 16:12:54.664237 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:54.664212    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-d479t_fa273192-872f-4d2d-bcdc-35e85bc99485/payload-processing/0.log"
Jul 15 16:12:56.162111 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:56.162078    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-c788dcdb-5mzwg_be9de479-25d3-477b-ae77-1efaa1107bb4/kube-auth-proxy/0.log"
Jul 15 16:12:56.201115 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:56.201088    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-cvc9d_6305fffd-77fc-4b0f-8ea3-1cac9f591cf6/istio-proxy/0.log"
Jul 15 16:12:56.259735 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:56.259705    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-cvc9d_6305fffd-77fc-4b0f-8ea3-1cac9f591cf6/istio-proxy/1.log"
Jul 15 16:12:56.292973 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:56.292957    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-7fwng_1871f089-c640-4943-a0fa-e1c448360d7a/payload-pre-processing/0.log"
Jul 15 16:12:56.325418 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:56.325397    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-d479t_fa273192-872f-4d2d-bcdc-35e85bc99485/payload-processing/0.log"
Jul 15 16:12:58.805376 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:58.805350    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-2x8hw_75c12e56-4e63-4bf2-b1e5-9ccbfd9c43e3/migrator/0.log"
Jul 15 16:12:58.826131 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:12:58.826113    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-2x8hw_75c12e56-4e63-4bf2-b1e5-9ccbfd9c43e3/graceful-termination/0.log"
Jul 15 16:13:00.196567 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:13:00.196537    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2s2fn_83ea2fad-6953-4605-bd20-4ca74169f20d/kube-multus-additional-cni-plugins/0.log"
Jul 15 16:13:00.219400 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:13:00.219378    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2s2fn_83ea2fad-6953-4605-bd20-4ca74169f20d/egress-router-binary-copy/0.log"
Jul 15 16:13:00.242713 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:13:00.242694    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2s2fn_83ea2fad-6953-4605-bd20-4ca74169f20d/cni-plugins/0.log"
Jul 15 16:13:00.270389 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:13:00.270365    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2s2fn_83ea2fad-6953-4605-bd20-4ca74169f20d/bond-cni-plugin/0.log"
Jul 15 16:13:00.293181 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:13:00.293162    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2s2fn_83ea2fad-6953-4605-bd20-4ca74169f20d/routeoverride-cni/0.log"
Jul 15 16:13:00.316479 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:13:00.316457    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2s2fn_83ea2fad-6953-4605-bd20-4ca74169f20d/whereabouts-cni-bincopy/0.log"
Jul 15 16:13:00.341123 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:13:00.341104    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2s2fn_83ea2fad-6953-4605-bd20-4ca74169f20d/whereabouts-cni/0.log"
Jul 15 16:13:00.812357 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:13:00.812322    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-djdlq_15e11302-d7ea-4408-b48b-01b0aad5a6dd/kube-multus/0.log"
Jul 15 16:13:00.923497 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:13:00.923468    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-w7zbl_60d786ac-9c8b-48df-8e67-6aa7e976718d/network-metrics-daemon/0.log"
Jul 15 16:13:00.942308 ip-10-0-138-107 kubenswrapper[2564]: I0715 16:13:00.942263    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-w7zbl_60d786ac-9c8b-48df-8e67-6aa7e976718d/kube-rbac-proxy/0.log"