Jul 23 13:38:34.294785 ip-10-0-140-103 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 23 13:38:34.294792 ip-10-0-140-103 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 23 13:38:34.294802 ip-10-0-140-103 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 23 13:38:34.295147 ip-10-0-140-103 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 23 13:38:44.502497 ip-10-0-140-103 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 23 13:38:44.502517 ip-10-0-140-103 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot d00d5b19254f497c960f3cc0a3b0ee4f --
Jul 23 13:40:28.458329 ip-10-0-140-103 systemd[1]: Starting Kubernetes Kubelet...
Jul 23 13:40:28.888838 ip-10-0-140-103 kubenswrapper[2573]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 23 13:40:28.888838 ip-10-0-140-103 kubenswrapper[2573]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 23 13:40:28.888838 ip-10-0-140-103 kubenswrapper[2573]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 23 13:40:28.888838 ip-10-0-140-103 kubenswrapper[2573]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 23 13:40:28.888838 ip-10-0-140-103 kubenswrapper[2573]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 23 13:40:28.888838 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.806842    2573 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 23 13:40:28.888838 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814168    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 13:40:28.888838 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814182    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 13:40:28.888838 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814186    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 13:40:28.888838 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814189    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 13:40:28.888838 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814194    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 13:40:28.888838 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814197    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 13:40:28.888838 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814200    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 13:40:28.888838 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814203    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 13:40:28.890060 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814206    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 13:40:28.890060 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814211    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 13:40:28.890060 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814215    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 13:40:28.890060 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814218    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 13:40:28.890060 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814220    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 13:40:28.890060 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814223    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 13:40:28.890060 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814226    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 13:40:28.890060 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814229    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 13:40:28.890060 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814232    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 13:40:28.890060 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814235    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 13:40:28.890060 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814242    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 13:40:28.890060 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814245    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 13:40:28.890060 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814248    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 13:40:28.890060 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814250    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 13:40:28.890060 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814253    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 13:40:28.890060 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814256    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 13:40:28.890060 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814258    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 13:40:28.890060 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814261    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 13:40:28.890060 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814263    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 13:40:28.890975 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814266    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 13:40:28.890975 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814269    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 13:40:28.890975 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814272    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 13:40:28.890975 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814276    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 13:40:28.890975 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814278    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 13:40:28.890975 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814281    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 13:40:28.890975 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814284    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 13:40:28.890975 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814286    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 13:40:28.890975 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814289    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 13:40:28.890975 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814292    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 13:40:28.890975 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814295    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 13:40:28.890975 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814298    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 13:40:28.890975 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814300    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 13:40:28.890975 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814303    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 13:40:28.890975 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814305    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 13:40:28.890975 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814309    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 13:40:28.890975 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814311    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 13:40:28.890975 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814314    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 13:40:28.890975 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814316    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 13:40:28.890975 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814319    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 13:40:28.891636 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814321    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 13:40:28.891636 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814324    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 13:40:28.891636 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814326    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 13:40:28.891636 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814330    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 13:40:28.891636 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814333    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 13:40:28.891636 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814335    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 13:40:28.891636 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814338    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 13:40:28.891636 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814340    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 13:40:28.891636 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814343    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 13:40:28.891636 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814345    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 13:40:28.891636 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814348    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 13:40:28.891636 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814350    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 13:40:28.891636 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814355    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 13:40:28.891636 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814360    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 13:40:28.891636 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814363    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 13:40:28.891636 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814366    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 13:40:28.891636 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814369    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 13:40:28.891636 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814372    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 13:40:28.891636 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814374    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 13:40:28.892364 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814378    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 13:40:28.892364 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814381    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 13:40:28.892364 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814384    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 13:40:28.892364 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814387    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 13:40:28.892364 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814389    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 13:40:28.892364 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814392    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 13:40:28.892364 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814395    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 13:40:28.892364 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814398    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 13:40:28.892364 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814400    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 13:40:28.892364 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814403    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 13:40:28.892364 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814405    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 13:40:28.892364 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814408    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 13:40:28.892364 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814411    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 13:40:28.892364 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814414    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 13:40:28.892364 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814416    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 13:40:28.892364 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814418    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 13:40:28.892364 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814421    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 13:40:28.892364 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814424    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 13:40:28.892364 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814426    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 13:40:28.892364 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814429    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 13:40:28.893079 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814434    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 13:40:28.893079 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814436    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 13:40:28.893079 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814439    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 13:40:28.893079 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814441    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 13:40:28.893079 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814444    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 13:40:28.893079 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814446    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 13:40:28.893079 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814449    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 13:40:28.893079 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814451    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 13:40:28.893079 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814454    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 13:40:28.893079 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814458    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 13:40:28.893079 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814462    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 13:40:28.893079 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814465    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 13:40:28.893079 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.814468    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 13:40:28.893079 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815227    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 13:40:28.893079 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815235    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 13:40:28.893079 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815239    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 13:40:28.893079 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815242    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 13:40:28.893079 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815246    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 13:40:28.893079 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815249    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 13:40:28.893658 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815252    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 13:40:28.893658 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815255    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 13:40:28.893658 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815258    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 13:40:28.893658 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815261    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 13:40:28.893658 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815264    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 13:40:28.893658 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815266    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 13:40:28.893658 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815269    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 13:40:28.893658 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815272    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 13:40:28.893658 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815274    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 13:40:28.893658 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815277    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 13:40:28.893658 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815280    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 13:40:28.893658 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815284    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 13:40:28.893658 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815288    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 13:40:28.893658 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815291    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 13:40:28.893658 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815294    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 13:40:28.893658 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815296    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 13:40:28.893658 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815299    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 13:40:28.893658 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815302    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 13:40:28.893658 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815304    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 13:40:28.894424 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815307    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 13:40:28.894424 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815310    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 13:40:28.894424 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815313    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 13:40:28.894424 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815315    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 13:40:28.894424 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815320    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 13:40:28.894424 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815324    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 13:40:28.894424 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815328    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 13:40:28.894424 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815331    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 13:40:28.894424 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815333    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 13:40:28.894424 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815336    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 13:40:28.894424 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815339    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 13:40:28.894424 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815342    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 13:40:28.894424 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815345    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 13:40:28.894424 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815348    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 13:40:28.894424 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815352    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 13:40:28.894424 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815355    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 13:40:28.894424 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815359    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 13:40:28.894424 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815361    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 13:40:28.894424 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815364    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 13:40:28.894424 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815366    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 13:40:28.895200 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815369    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 13:40:28.895200 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815372    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 13:40:28.895200 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815374    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 13:40:28.895200 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815377    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 13:40:28.895200 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815380    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 13:40:28.895200 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815382    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 13:40:28.895200 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815385    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 13:40:28.895200 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815388    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 13:40:28.895200 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815390    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 13:40:28.895200 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815393    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 13:40:28.895200 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815396    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 13:40:28.895200 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815398    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 13:40:28.895200 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815401    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 13:40:28.895200 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815403    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 13:40:28.895200 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815405    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 13:40:28.895200 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815408    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 13:40:28.895200 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815411    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 13:40:28.895200 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815414    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 13:40:28.895200 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815417    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 13:40:28.895200 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815420    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 13:40:28.895795 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815423    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 13:40:28.895795 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815426    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 13:40:28.895795 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815429    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 13:40:28.895795 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815431    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 13:40:28.895795 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815433    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 13:40:28.895795 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815438    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 13:40:28.895795 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815441    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 13:40:28.895795 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815443    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 13:40:28.895795 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815446    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 13:40:28.895795 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815448    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 13:40:28.895795 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815451    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 13:40:28.895795 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815453    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 13:40:28.895795 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815456    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 13:40:28.895795 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815458    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 13:40:28.895795 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815460    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 13:40:28.895795 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815463    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 13:40:28.895795 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815466    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 13:40:28.895795 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815468    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 13:40:28.895795 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815471    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 13:40:28.895795 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815473    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 13:40:28.896539 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815476    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 13:40:28.896539 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815478    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 13:40:28.896539 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815481    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 13:40:28.896539 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815483    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 13:40:28.896539 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815488    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 13:40:28.896539 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815492    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 13:40:28.896539 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815494    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 13:40:28.896539 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815498    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 13:40:28.896539 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815500    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 13:40:28.896539 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815503    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 13:40:28.896539 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815506    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 13:40:28.896539 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815508    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 13:40:28.896539 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815511    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 13:40:28.896539 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815513    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 13:40:28.896539 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815893    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 13:40:28.896539 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815898    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 13:40:28.896539 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815901    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 13:40:28.896539 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815903    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 13:40:28.896539 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815907    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 13:40:28.897205 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815909    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 13:40:28.897205 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815913    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 13:40:28.897205 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815916    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 13:40:28.897205 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815919    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 13:40:28.897205 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815921    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 13:40:28.897205 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815924    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 13:40:28.897205 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815927    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 13:40:28.897205 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815929    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 13:40:28.897205 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815931    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 13:40:28.897205 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815936    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 13:40:28.897205 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815939    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 13:40:28.897205 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815942    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 13:40:28.897205 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815944    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 13:40:28.897205 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815947    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 13:40:28.897205 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815950    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 13:40:28.897205 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815952    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 13:40:28.897205 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815955    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 13:40:28.897205 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815958    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 13:40:28.897205 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815960    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 13:40:28.897205 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815963    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 13:40:28.898156 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815966    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 13:40:28.898156 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815968    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 13:40:28.898156 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815971    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 13:40:28.898156 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815973    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 13:40:28.898156 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815976    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 13:40:28.898156 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815978    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 13:40:28.898156 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815983    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 13:40:28.898156 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815985    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 13:40:28.898156 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815989    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 13:40:28.898156 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815993    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 13:40:28.898156 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815996    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 13:40:28.898156 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.815999    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 13:40:28.898156 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816003    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 13:40:28.898156 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816006    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 13:40:28.898156 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816026    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 13:40:28.898156 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816030    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 13:40:28.898156 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816032    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 13:40:28.898156 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816035    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 13:40:28.898156 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816038    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 13:40:28.898156 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816041    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 13:40:28.899237 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816043    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 13:40:28.899237 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816047    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 13:40:28.899237 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816050    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 13:40:28.899237 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816053    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 13:40:28.899237 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816055    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 13:40:28.899237 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816058    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 13:40:28.899237 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816060    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 13:40:28.899237 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816063    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 13:40:28.899237 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816065    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 13:40:28.899237 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816068    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 13:40:28.899237 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816070    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 13:40:28.899237 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816073    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 13:40:28.899237 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816075    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 13:40:28.899237 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816078    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 13:40:28.899237 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816080    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 13:40:28.899237 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816083    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 13:40:28.899237 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816085    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 13:40:28.899237 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816088    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 13:40:28.899237 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816092    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 13:40:28.899237 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816094    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 13:40:28.900326 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816097    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 13:40:28.900326 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816099    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 13:40:28.900326 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816102    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 13:40:28.900326 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816104    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 13:40:28.900326 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816106    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 13:40:28.900326 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816109    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 13:40:28.900326 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816112    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 13:40:28.900326 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816114    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 13:40:28.900326 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816117    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 13:40:28.900326 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816119    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 13:40:28.900326 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816122    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 13:40:28.900326 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816124    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 13:40:28.900326 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816127    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 13:40:28.900326 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816131    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 13:40:28.900326 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816133    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 13:40:28.900326 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816136    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 13:40:28.900326 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816139    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 13:40:28.900326 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816142    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 13:40:28.900326 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816144    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 13:40:28.900326 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816147    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 13:40:28.901558 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816150    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 13:40:28.901558 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816153    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 13:40:28.901558 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816156    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 13:40:28.901558 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816159    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 13:40:28.901558 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816161    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 13:40:28.901558 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816164    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 13:40:28.901558 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816167    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 13:40:28.901558 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816169    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 13:40:28.901558 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816172    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 13:40:28.901558 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816174    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 13:40:28.901558 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816179    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 13:40:28.901558 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816183    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 13:40:28.901558 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816186    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 13:40:28.901558 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816188    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 13:40:28.901558 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816266    2573 flags.go:64] FLAG: --address="0.0.0.0"
Jul 23 13:40:28.901558 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816276    2573 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 23 13:40:28.901558 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816285    2573 flags.go:64] FLAG: --anonymous-auth="true"
Jul 23 13:40:28.901558 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816291    2573 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 23 13:40:28.901558 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816299    2573 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 23 13:40:28.902609 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816304    2573 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 23 13:40:28.902609 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816310    2573 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 23 13:40:28.902609 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816315    2573 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 23 13:40:28.902609 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816318    2573 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 23 13:40:28.902609 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816321    2573 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 23 13:40:28.902609 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816325    2573 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 23 13:40:28.902609 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816330    2573 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 23 13:40:28.902609 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816334    2573 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 23 13:40:28.902609 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816337    2573 flags.go:64] FLAG: --cgroup-root=""
Jul 23 13:40:28.902609 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816339    2573 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 23 13:40:28.902609 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816343    2573 flags.go:64] FLAG: --client-ca-file=""
Jul 23 13:40:28.902609 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816346    2573 flags.go:64] FLAG: --cloud-provider="external"
Jul 23 13:40:28.902609 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816349    2573 flags.go:64] FLAG: --cluster-dns="[]"
Jul 23 13:40:28.902609 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816354    2573 flags.go:64] FLAG: --cluster-domain=""
Jul 23 13:40:28.902609 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816357    2573 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 23 13:40:28.902609 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816360    2573 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 23 13:40:28.902609 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816363    2573 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 23 13:40:28.902609 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816367    2573 flags.go:64] FLAG: --container-log-max-files="5"
Jul 23 13:40:28.902609 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816370    2573 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 23 13:40:28.902609 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816373    2573 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 23 13:40:28.902609 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816376    2573 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 23 13:40:28.902609 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816379    2573 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 23 13:40:28.902609 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816383    2573 flags.go:64] FLAG: --contention-profiling="false"
Jul 23 13:40:28.902609 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816387    2573 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 23 13:40:28.904310 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816391    2573 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 23 13:40:28.904310 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816394    2573 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 23 13:40:28.904310 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816397    2573 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 23 13:40:28.904310 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816402    2573 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 23 13:40:28.904310 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816405    2573 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 23 13:40:28.904310 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816408    2573 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 23 13:40:28.904310 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816411    2573 flags.go:64] FLAG: --enable-load-reader="false"
Jul 23 13:40:28.904310 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816414    2573 flags.go:64] FLAG: --enable-server="true"
Jul 23 13:40:28.904310 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816417    2573 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 23 13:40:28.904310 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816422    2573 flags.go:64] FLAG: --event-burst="100"
Jul 23 13:40:28.904310 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816425    2573 flags.go:64] FLAG: --event-qps="50"
Jul 23 13:40:28.904310 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816428    2573 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 23 13:40:28.904310 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816431    2573 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 23 13:40:28.904310 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816434    2573 flags.go:64] FLAG: --eviction-hard=""
Jul 23 13:40:28.904310 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816439    2573 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 23 13:40:28.904310 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816442    2573 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 23 13:40:28.904310 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816445    2573 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 23 13:40:28.904310 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816448    2573 flags.go:64] FLAG: --eviction-soft=""
Jul 23 13:40:28.904310 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816451    2573 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 23 13:40:28.904310 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816454    2573 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 23 13:40:28.904310 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816457    2573 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 23 13:40:28.904310 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816460    2573 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 23 13:40:28.904310 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816463    2573 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 23 13:40:28.904310 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816466    2573 flags.go:64] FLAG: --fail-swap-on="true"
Jul 23 13:40:28.904310 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816468    2573 flags.go:64] FLAG: --feature-gates=""
Jul 23 13:40:28.903913 ip-10-0-140-103 systemd[1]: Started Kubernetes Kubelet.
Jul 23 13:40:28.907818 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816472    2573 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 23 13:40:28.907818 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816475    2573 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 23 13:40:28.907818 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816479    2573 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 23 13:40:28.907818 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816482    2573 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 23 13:40:28.907818 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816485    2573 flags.go:64] FLAG: --healthz-port="10248"
Jul 23 13:40:28.907818 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816487    2573 flags.go:64] FLAG: --help="false"
Jul 23 13:40:28.907818 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816492    2573 flags.go:64] FLAG: --hostname-override="ip-10-0-140-103.ec2.internal"
Jul 23 13:40:28.907818 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816495    2573 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 23 13:40:28.907818 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816498    2573 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 23 13:40:28.907818 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816500    2573 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 23 13:40:28.907818 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816504    2573 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 23 13:40:28.907818 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816507    2573 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 23 13:40:28.907818 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816510    2573 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 23 13:40:28.907818 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816513    2573 flags.go:64] FLAG: --image-service-endpoint=""
Jul 23 13:40:28.907818 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816516    2573 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 23 13:40:28.907818 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816519    2573 flags.go:64] FLAG: --kube-api-burst="100"
Jul 23 13:40:28.907818 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816522    2573 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 23 13:40:28.907818 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816525    2573 flags.go:64] FLAG: --kube-api-qps="50"
Jul 23 13:40:28.907818 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816528    2573 flags.go:64] FLAG: --kube-reserved=""
Jul 23 13:40:28.907818 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816531    2573 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 23 13:40:28.907818 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816533    2573 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 23 13:40:28.907818 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816539    2573 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 23 13:40:28.907818 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816542    2573 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 23 13:40:28.907818 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816545    2573 flags.go:64] FLAG: --lock-file=""
Jul 23 13:40:28.909452 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816547    2573 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 23 13:40:28.909452 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816550    2573 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 23 13:40:28.909452 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816553    2573 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 23 13:40:28.909452 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816558    2573 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 23 13:40:28.909452 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816561    2573 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 23 13:40:28.909452 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816564    2573 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 23 13:40:28.909452 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816567    2573 flags.go:64] FLAG: --logging-format="text"
Jul 23 13:40:28.909452 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816569    2573 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 23 13:40:28.909452 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816573    2573 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 23 13:40:28.909452 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816575    2573 flags.go:64] FLAG: --manifest-url=""
Jul 23 13:40:28.909452 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816578    2573 flags.go:64] FLAG: --manifest-url-header=""
Jul 23 13:40:28.909452 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816583    2573 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 23 13:40:28.909452 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816586    2573 flags.go:64] FLAG: --max-open-files="1000000"
Jul 23 13:40:28.909452 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816590    2573 flags.go:64] FLAG: --max-pods="110"
Jul 23 13:40:28.909452 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816594    2573 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 23 13:40:28.909452 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816597    2573 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 23 13:40:28.909452 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816600    2573 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 23 13:40:28.909452 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816602    2573 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 23 13:40:28.909452 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816605    2573 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 23 13:40:28.909452 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816608    2573 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 23 13:40:28.909452 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816611    2573 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 23 13:40:28.909452 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816618    2573 flags.go:64] FLAG: --node-status-max-images="50"
Jul 23 13:40:28.909452 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816622    2573 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 23 13:40:28.909452 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816625    2573 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 23 13:40:28.909452 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816628    2573 flags.go:64] FLAG: --pod-cidr=""
Jul 23 13:40:28.910490 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816631    2573 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 23 13:40:28.910490 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816637    2573 flags.go:64] FLAG: --pod-manifest-path=""
Jul 23 13:40:28.910490 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816640    2573 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 23 13:40:28.910490 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816643    2573 flags.go:64] FLAG: --pods-per-core="0"
Jul 23 13:40:28.910490 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816646    2573 flags.go:64] FLAG: --port="10250"
Jul 23 13:40:28.910490 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816651    2573 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 23 13:40:28.910490 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816653    2573 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0012e1236a2af0f14"
Jul 23 13:40:28.910490 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816657    2573 flags.go:64] FLAG: --qos-reserved=""
Jul 23 13:40:28.910490 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816659    2573 flags.go:64] FLAG: --read-only-port="10255"
Jul 23 13:40:28.910490 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816662    2573 flags.go:64] FLAG: --register-node="true"
Jul 23 13:40:28.910490 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816665    2573 flags.go:64] FLAG: --register-with-taints=""
Jul 23 13:40:28.910490 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816669    2573 flags.go:64] FLAG: --registry-burst="10"
Jul 23 13:40:28.910490 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816672    2573 flags.go:64] FLAG: --registry-qps="5"
Jul 23 13:40:28.910490 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816674    2573 flags.go:64] FLAG: --reserved-cpus=""
Jul 23 13:40:28.910490 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816677    2573 flags.go:64] FLAG: --reserved-memory=""
Jul 23 13:40:28.910490 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816681    2573 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 23 13:40:28.910490 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816684    2573 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 23 13:40:28.910490 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816687    2573 flags.go:64] FLAG: --rotate-certificates="false"
Jul 23 13:40:28.910490 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816690    2573 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 23 13:40:28.910490 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816692    2573 flags.go:64] FLAG: --runonce="false"
Jul 23 13:40:28.910490 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816695    2573 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 23 13:40:28.910490 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816702    2573 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 23 13:40:28.910490 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816705    2573 flags.go:64] FLAG: --seccomp-default="false"
Jul 23 13:40:28.910490 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816708    2573 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 23 13:40:28.910490 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816711    2573 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 23 13:40:28.911777 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816714    2573 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 23 13:40:28.911777 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816717    2573 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 23 13:40:28.911777 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816720    2573 flags.go:64] FLAG: --storage-driver-password="root"
Jul 23 13:40:28.911777 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816723    2573 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 23 13:40:28.911777 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816726    2573 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 23 13:40:28.911777 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816729    2573 flags.go:64] FLAG: --storage-driver-user="root"
Jul 23 13:40:28.911777 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816732    2573 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 23 13:40:28.911777 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816735    2573 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 23 13:40:28.911777 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816738    2573 flags.go:64] FLAG: --system-cgroups=""
Jul 23 13:40:28.911777 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816741    2573 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 23 13:40:28.911777 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816746    2573 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 23 13:40:28.911777 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816749    2573 flags.go:64] FLAG: --tls-cert-file=""
Jul 23 13:40:28.911777 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816753    2573 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 23 13:40:28.911777 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816758    2573 flags.go:64] FLAG: --tls-min-version=""
Jul 23 13:40:28.911777 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816761    2573 flags.go:64] FLAG: --tls-private-key-file=""
Jul 23 13:40:28.911777 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816763    2573 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 23 13:40:28.911777 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816766    2573 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 23 13:40:28.911777 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816769    2573 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 23 13:40:28.911777 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816772    2573 flags.go:64] FLAG: --v="2"
Jul 23 13:40:28.911777 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816776    2573 flags.go:64] FLAG: --version="false"
Jul 23 13:40:28.911777 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816781    2573 flags.go:64] FLAG: --vmodule=""
Jul 23 13:40:28.911777 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816784    2573 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 23 13:40:28.911777 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.816788    2573 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 23 13:40:28.911777 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816905    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 13:40:28.913299 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816910    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 13:40:28.913299 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816913    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 13:40:28.913299 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816917    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 13:40:28.913299 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816921    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 13:40:28.913299 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816926    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 13:40:28.913299 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816929    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 13:40:28.913299 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816931    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 13:40:28.913299 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816935    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 13:40:28.913299 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816938    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 13:40:28.913299 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816940    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 13:40:28.913299 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816943    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 13:40:28.913299 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816945    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 13:40:28.913299 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816948    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 13:40:28.913299 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816952    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 13:40:28.913299 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816954    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 13:40:28.913299 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816957    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 13:40:28.913299 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816959    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 13:40:28.913299 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816962    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 13:40:28.913299 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816965    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 13:40:28.913299 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816969    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 13:40:28.914148 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816973    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 13:40:28.914148 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816975    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 13:40:28.914148 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816977    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 13:40:28.914148 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816980    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 13:40:28.914148 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816983    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 13:40:28.914148 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816985    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 13:40:28.914148 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816988    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 13:40:28.914148 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816990    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 13:40:28.914148 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816993    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 13:40:28.914148 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816995    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 13:40:28.914148 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.816998    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 13:40:28.914148 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.817000    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 13:40:28.914148 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.817003    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 13:40:28.914148 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.817006    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 13:40:28.914148 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.817032    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 13:40:28.914148 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.817036    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 13:40:28.914148 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.817040    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 13:40:28.914148 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.817042    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 13:40:28.914148 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.817045    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 13:40:28.914148 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.817047    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 13:40:28.914960 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.817050    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 13:40:28.914960 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.817053    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 13:40:28.914960 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.817056    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 13:40:28.914960 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.817058    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 13:40:28.914960 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.817061    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 13:40:28.914960 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.817064    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 13:40:28.914960 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.817066    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 13:40:28.914960 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.817069    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 13:40:28.914960 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.817072    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 13:40:28.914960 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.817074    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 13:40:28.914960 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.817078    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 13:40:28.914960 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.817080    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 13:40:28.914960 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.817084    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 13:40:28.914960 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.817087    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 13:40:28.914960 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.817090    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 13:40:28.914960 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.817092    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 13:40:28.914960 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.817095    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 13:40:28.914960 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.817097    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 13:40:28.914960 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.817100    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 13:40:28.914960 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.817102    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 13:40:28.916321 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.817105    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 13:40:28.916321 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.817107    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 13:40:28.916321 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.817110    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 13:40:28.916321 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.817113    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 13:40:28.916321 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.817115    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 13:40:28.916321 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.817118    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 13:40:28.916321 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.817120    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 13:40:28.916321 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.817123    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 13:40:28.916321 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.817127    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 13:40:28.916321 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.817129    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 13:40:28.916321 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.817132    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 13:40:28.916321 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.817135    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 13:40:28.916321 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.817137    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 13:40:28.916321 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.817140    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 13:40:28.916321 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.817142    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 13:40:28.916321 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.817145    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 13:40:28.916321 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.817148    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 13:40:28.916321 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.817150    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 13:40:28.916321 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.817153    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 13:40:28.916321 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.817156    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 13:40:28.917425 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.817158    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 13:40:28.917425 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.817161    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 13:40:28.917425 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.817163    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 13:40:28.917425 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.817166    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 13:40:28.917425 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.817171    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 13:40:28.917425 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.817175    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 13:40:28.917425 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.817179    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 13:40:28.917425 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.817182    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 13:40:28.917425 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.817186    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 13:40:28.917425 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.817189    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 13:40:28.917425 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.817191    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 13:40:28.917425 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.817194    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 13:40:28.917425 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.817196    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 13:40:28.917425 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.817199    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 13:40:28.917425 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.817201    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 13:40:28.917425 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.817204    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 13:40:28.917425 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.817206    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 13:40:28.917425 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.817209    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 13:40:29.001511 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.817742    2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 23 13:40:29.001511 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.827205    2573 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 23 13:40:29.001511 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.827226    2573 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 23 13:40:29.001511 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.827882    2573 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 23 13:40:29.001511 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.827893    2573 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 23 13:40:29.001511 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.827969    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 13:40:29.001511 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.827976    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 13:40:29.001511 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.827982    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 13:40:29.001511 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.827987    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 13:40:29.001511 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.827992    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 13:40:29.001511 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.827997    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 13:40:29.001511 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828001    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 13:40:29.001511 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828005    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 13:40:29.001511 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828025    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 13:40:29.001511 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828030    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 13:40:29.002148 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828034    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 13:40:29.002148 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828038    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 13:40:29.002148 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828042    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 13:40:29.002148 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828046    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 13:40:29.002148 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828049    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 13:40:29.002148 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828053    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 13:40:29.002148 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828057    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 13:40:29.002148 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828061    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 13:40:29.002148 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828065    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 13:40:29.002148 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828069    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 13:40:29.002148 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828072    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 13:40:29.002148 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828076    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 13:40:29.002148 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828079    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 13:40:29.002148 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828083    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 13:40:29.002148 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828087    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 13:40:29.002148 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828092    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 13:40:29.002148 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828095    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 13:40:29.002148 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828099    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 13:40:29.002148 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828103    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 13:40:29.002148 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828109    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 13:40:29.006647 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828113    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 13:40:29.006647 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828117    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 13:40:29.006647 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828120    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 13:40:29.006647 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828124    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 13:40:29.006647 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828128    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 13:40:29.006647 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828132    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 13:40:29.006647 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828136    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 13:40:29.006647 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828139    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 13:40:29.006647 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828143    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 13:40:29.006647 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828147    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 13:40:29.006647 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828151    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 13:40:29.006647 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828155    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 13:40:29.006647 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828158    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 13:40:29.006647 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828162    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 13:40:29.006647 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828166    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 13:40:29.006647 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828172    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 13:40:29.006647 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828178    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 13:40:29.006647 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828182    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 13:40:29.006647 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828185    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 13:40:29.007328 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828189    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 13:40:29.007328 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828193    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 13:40:29.007328 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828197    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 13:40:29.007328 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828202    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 13:40:29.007328 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828206    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 13:40:29.007328 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828209    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 13:40:29.007328 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828213    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 13:40:29.007328 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828219    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 13:40:29.007328 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828224    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 13:40:29.007328 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828228    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 13:40:29.007328 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828231    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 13:40:29.007328 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828235    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 13:40:29.007328 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828238    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 13:40:29.007328 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828243    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 13:40:29.007328 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828247    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 13:40:29.007328 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828251    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 13:40:29.007328 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828255    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 13:40:29.007328 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828258    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 13:40:29.007328 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828261    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 13:40:29.007328 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828265    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 13:40:29.008007 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828269    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 13:40:29.008007 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828272    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 13:40:29.008007 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828276    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 13:40:29.008007 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828280    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 13:40:29.008007 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828283    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 13:40:29.008007 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828287    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 13:40:29.008007 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828291    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 13:40:29.008007 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828296    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 13:40:29.008007 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828301    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 13:40:29.008007 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828306    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 13:40:29.008007 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828310    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 13:40:29.008007 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828314    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 13:40:29.008007 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828319    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 13:40:29.008007 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828323    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 13:40:29.008007 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828328    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 13:40:29.008007 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828333    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 13:40:29.008007 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828338    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 13:40:29.008007 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828342    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 13:40:29.008007 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828346    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 13:40:29.008623 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828354    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 13:40:29.008623 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828359    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 13:40:29.008623 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828363    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 13:40:29.008623 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828367    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 13:40:29.008623 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828371    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 13:40:29.008623 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828375    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 13:40:29.008623 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828379    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 13:40:29.008623 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828383    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 13:40:29.008623 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828387    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 13:40:29.008623 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828391    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 13:40:29.008623 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828394    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 13:40:29.008623 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.828401    2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 23 13:40:29.008623 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828560    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 13:40:29.008623 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828567    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 13:40:29.008623 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828571    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 13:40:29.009324 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828576    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 13:40:29.009324 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828580    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 13:40:29.009324 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828584    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 13:40:29.009324 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828588    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 13:40:29.009324 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828591    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 13:40:29.009324 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828595    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 13:40:29.009324 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828598    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 13:40:29.009324 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828602    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 13:40:29.009324 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828605    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 13:40:29.009324 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828609    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 13:40:29.009324 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828613    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 13:40:29.009324 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828617    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 13:40:29.009324 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828622    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 13:40:29.009324 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828628    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 13:40:29.009324 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828632    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 13:40:29.009324 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828636    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 13:40:29.009324 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828639    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 13:40:29.009324 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828643    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 13:40:29.009324 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828650    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 13:40:29.009922 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828653    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 13:40:29.009922 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828659    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 13:40:29.009922 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828664    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 13:40:29.009922 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828668    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 13:40:29.009922 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828673    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 13:40:29.009922 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828677    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 13:40:29.009922 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828682    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 13:40:29.009922 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828686    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 13:40:29.009922 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828690    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 13:40:29.009922 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828694    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 13:40:29.009922 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828698    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 13:40:29.009922 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828701    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 13:40:29.009922 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828705    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 13:40:29.009922 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828709    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 13:40:29.009922 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828713    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 13:40:29.009922 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828717    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 13:40:29.009922 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828720    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 13:40:29.009922 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828724    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 13:40:29.009922 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828728    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 13:40:29.009922 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828731    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 13:40:29.010626 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828735    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 13:40:29.010626 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828739    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 13:40:29.010626 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828742    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 13:40:29.010626 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828746    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 13:40:29.010626 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828750    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 13:40:29.010626 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828754    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 13:40:29.010626 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828757    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 13:40:29.010626 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828761    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 13:40:29.010626 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828765    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 13:40:29.010626 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828768    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 13:40:29.010626 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828772    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 13:40:29.010626 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828779    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 13:40:29.010626 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828782    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 13:40:29.010626 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828786    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 13:40:29.010626 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828790    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 13:40:29.010626 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828793    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 13:40:29.010626 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828797    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 13:40:29.010626 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828801    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 13:40:29.010626 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828804    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 13:40:29.010626 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828809    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 13:40:29.011195 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828813    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 13:40:29.011195 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828817    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 13:40:29.011195 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828820    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 13:40:29.011195 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828824    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 13:40:29.011195 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828828    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 13:40:29.011195 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828832    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 13:40:29.011195 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828835    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 13:40:29.011195 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828839    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 13:40:29.011195 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828842    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 13:40:29.011195 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828846    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 13:40:29.011195 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828849    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 13:40:29.011195 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828853    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 13:40:29.011195 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828857    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 13:40:29.011195 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828863    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 13:40:29.011195 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828867    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 13:40:29.011195 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828871    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 13:40:29.011195 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828875    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 13:40:29.011195 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828879    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 13:40:29.011195 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828882    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 13:40:29.011195 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828886    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 13:40:29.011894 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828890    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 13:40:29.011894 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828894    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 13:40:29.011894 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828898    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 13:40:29.011894 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828905    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 13:40:29.011894 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828909    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 13:40:29.011894 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828912    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 13:40:29.011894 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828916    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 13:40:29.011894 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828920    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 13:40:29.011894 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828923    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 13:40:29.011894 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828927    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 13:40:29.011894 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828931    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 13:40:29.011894 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828934    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 13:40:29.011894 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828939    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 13:40:29.011894 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828943    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 13:40:29.011894 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828946    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 13:40:29.011894 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828950    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 13:40:29.011894 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:28.828954    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 13:40:29.012393 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.828960    2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 23 13:40:29.012393 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.829136    2573 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 23 13:40:29.012393 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.845872    2573 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 23 13:40:29.012393 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.847288    2573 server.go:1019] "Starting client certificate rotation"
Jul 23 13:40:29.012393 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.847386    2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 23 13:40:29.012393 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.847419    2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 23 13:40:29.012393 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.849860    2573 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 23 13:40:29.012393 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.851023    2573 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 23 13:40:29.012393 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.866159    2573 log.go:25] "Validated CRI v1 runtime API"
Jul 23 13:40:29.012393 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.869675    2573 log.go:25] "Validated CRI v1 image API"
Jul 23 13:40:29.012393 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.870297    2573 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 23 13:40:29.012393 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.872587    2573 fs.go:135] Filesystem UUIDs: map[4d77514d-0623-43d1-a4c7-6a6c46c4ccb8:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 cb3c8c6a-d7d6-4f93-a22c-cc391c9c42b1:/dev/nvme0n1p4]
Jul 23 13:40:29.118949 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.872602    2573 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 23 13:40:29.123183 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.876728    2573 manager.go:216] Machine: {Timestamp:2026-07-23 13:40:28.876247474 +0000 UTC m=+0.315748385 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102491 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24a1f61a12e6d4ea43f42a005b12ee SystemUUID:ec24a1f6-1a12-e6d4-ea43-f42a005b12ee BootID:d00d5b19-254f-497c-960f-3cc0a3b0ee4f Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:0e:c8:96:40:b9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:0e:c8:96:40:b9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ba:87:09:b5:af:53 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 23 13:40:29.123183 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.876831    2573 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 23 13:40:29.123183 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.876948    2573 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 23 13:40:29.123183 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.879153    2573 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 23 13:40:29.123183 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.879177    2573 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-103.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 23 13:40:29.123183 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.879892    2573 topology_manager.go:138] "Creating topology manager with none policy"
Jul 23 13:40:29.123183 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.879901    2573 container_manager_linux.go:309] "Creating device plugin manager"
Jul 23 13:40:29.123183 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.879909    2573 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 23 13:40:29.123785 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.880494    2573 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 23 13:40:29.123785 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.881997    2573 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 23 13:40:29.123785 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.883988    2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 23 13:40:29.123785 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.889111    2573 state_mem.go:36] "Initialized new in-memory state store"
Jul 23 13:40:29.123785 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.889327    2573 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 23 13:40:29.123785 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.889368    2573 kubelet.go:486] "Attempting to sync node with API server"
Jul 23 13:40:29.123785 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.889384    2573 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 23 13:40:29.123785 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.889406    2573 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 23 13:40:29.123785 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.889428    2573 kubelet.go:398] "Adding apiserver pod source"
Jul 23 13:40:29.123785 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.889442    2573 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 23 13:40:29.123785 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.889932    2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 23 13:40:29.123785 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.889968    2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 23 13:40:29.123785 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.892734    2573 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 23 13:40:29.123785 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.894984    2573 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 23 13:40:29.123785 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.895046    2573 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 23 13:40:29.123785 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.896221    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 23 13:40:29.123785 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.896243    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 23 13:40:29.123785 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.896253    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 23 13:40:29.123785 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.896262    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 23 13:40:29.123785 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.896275    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 23 13:40:29.123785 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.896284    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 23 13:40:29.123785 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.896297    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 23 13:40:29.123785 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.896307    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 23 13:40:29.123785 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.896318    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 23 13:40:29.123785 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.896327    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 23 13:40:29.123785 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.896342    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 23 13:40:29.123785 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.896351    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 23 13:40:29.123785 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.897074    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 23 13:40:29.123785 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.897094    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 23 13:40:29.123785 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.902997    2573 server.go:1268] "Started kubelet"
Jul 23 13:40:29.123785 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.903063    2573 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 23 13:40:29.123785 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.903203    2573 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 23 13:40:29.123785 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.903247    2573 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 23 13:40:29.123785 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.905377    2573 server.go:310] "Adding debug handlers to kubelet server"
Jul 23 13:40:29.123785 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.905378    2573 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 23 13:40:29.123785 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.911669    2573 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 23 13:40:29.123785 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.911681    2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 23 13:40:29.123785 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:28.911915    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-103.ec2.internal\" not found"
Jul 23 13:40:29.123785 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.912421    2573 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 23 13:40:29.123785 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.912429    2573 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 23 13:40:29.123785 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.912453    2573 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 23 13:40:29.123785 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.912606    2573 reconstruct.go:97] "Volume reconstruction finished"
Jul 23 13:40:29.123785 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.912618    2573 reconciler.go:29] "Reconciler: start to sync state"
Jul 23 13:40:29.123785 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.914710    2573 factory.go:55] Registering systemd factory
Jul 23 13:40:29.123785 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.914727    2573 factory.go:223] Registration of the systemd container factory successfully
Jul 23 13:40:29.123785 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.915043    2573 factory.go:153] Registering CRI-O factory
Jul 23 13:40:29.125115 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.915056    2573 factory.go:223] Registration of the crio container factory successfully
Jul 23 13:40:29.125115 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.915103    2573 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 23 13:40:29.125115 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.915127    2573 factory.go:103] Registering Raw factory
Jul 23 13:40:29.125115 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.915145    2573 manager.go:1196] Started watching for new ooms in manager
Jul 23 13:40:29.125115 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:28.915344    2573 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 23 13:40:29.125115 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.915555    2573 manager.go:349] Starting recovery of all containers
Jul 23 13:40:29.125115 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:28.919100    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 23 13:40:29.125115 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.919153    2573 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-103.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 23 13:40:29.125115 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:28.919208    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 23 13:40:29.125115 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:28.922630    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-103.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 23 13:40:29.125115 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:28.919244    2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-103.ec2.internal.18c4eee726e4b70f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-103.ec2.internal,UID:ip-10-0-140-103.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-103.ec2.internal,},FirstTimestamp:2026-07-23 13:40:28.902938383 +0000 UTC m=+0.342439299,LastTimestamp:2026-07-23 13:40:28.902938383 +0000 UTC m=+0.342439299,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-103.ec2.internal,}"
Jul 23 13:40:29.125115 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:28.922766    2573 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-103.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 23 13:40:29.125115 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.928553    2573 manager.go:354] Recovery completed
Jul 23 13:40:29.125115 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.938559    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 13:40:29.125115 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.940691    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-103.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 13:40:29.125115 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.940722    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-103.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 13:40:29.125115 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.940735    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-103.ec2.internal" event="NodeHasSufficientPID"
Jul 23 13:40:29.125115 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.941334    2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ggg69"
Jul 23 13:40:29.125115 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.941393    2573 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 23 13:40:29.125115 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.941401    2573 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 23 13:40:29.125115 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.941420    2573 state_mem.go:36] "Initialized new in-memory state store"
Jul 23 13:40:29.125115 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.943583    2573 policy_none.go:49] "None policy: Start"
Jul 23 13:40:29.125115 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.943598    2573 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 23 13:40:29.125115 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.943611    2573 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 23 13:40:29.125115 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.945584    2573 policy_none.go:47] "Start"
Jul 23 13:40:29.125115 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.946480    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 13:40:29.126153 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:28.946855    2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-103.ec2.internal.18c4eee729250fb8  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-103.ec2.internal,UID:ip-10-0-140-103.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-103.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-103.ec2.internal,},FirstTimestamp:2026-07-23 13:40:28.940709816 +0000 UTC m=+0.380210727,LastTimestamp:2026-07-23 13:40:28.940709816 +0000 UTC m=+0.380210727,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-103.ec2.internal,}"
Jul 23 13:40:29.126153 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.947299    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-103.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 13:40:29.126153 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.947321    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-103.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 13:40:29.126153 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.947331    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-103.ec2.internal" event="NodeHasSufficientPID"
Jul 23 13:40:29.126153 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.949564    2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ggg69"
Jul 23 13:40:29.126153 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.989990    2573 manager.go:337] "Starting Device Plugin manager"
Jul 23 13:40:29.126153 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:28.990040    2573 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 23 13:40:29.126153 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.990051    2573 server.go:87] "Starting device plugin registration server"
Jul 23 13:40:29.126153 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.990343    2573 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 23 13:40:29.126153 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.990356    2573 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 23 13:40:29.126153 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.990440    2573 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 23 13:40:29.126153 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.990519    2573 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 23 13:40:29.126153 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:28.990691    2573 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 23 13:40:29.126153 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:28.991226    2573 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 23 13:40:29.126153 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:28.991287    2573 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-103.ec2.internal\" not found"
Jul 23 13:40:29.126153 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:29.059743    2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 23 13:40:29.126153 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:29.061030    2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 23 13:40:29.126153 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:29.061067    2573 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 23 13:40:29.126153 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:29.061094    2573 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 23 13:40:29.126153 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:29.061129    2573 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 23 13:40:29.126153 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:29.063615    2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 13:40:29.126153 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:29.090874    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 13:40:29.126153 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:29.091887    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-103.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 13:40:29.126153 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:29.091919    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-103.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 13:40:29.126153 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:29.091932    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-103.ec2.internal" event="NodeHasSufficientPID"
Jul 23 13:40:29.126153 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:29.091955    2573 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-103.ec2.internal"
Jul 23 13:40:29.126153 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:29.102338    2573 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-103.ec2.internal"
Jul 23 13:40:29.126153 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:29.102363    2573 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-103.ec2.internal\": node \"ip-10-0-140-103.ec2.internal\" not found"
Jul 23 13:40:29.216932 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:29.133600    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-103.ec2.internal\" not found"
Jul 23 13:40:29.216932 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:29.161906    2573 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-103.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-103.ec2.internal"]
Jul 23 13:40:29.216932 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:29.162017    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 13:40:29.216932 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:29.165132    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-103.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 13:40:29.216932 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:29.165166    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-103.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 13:40:29.216932 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:29.165180    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-103.ec2.internal" event="NodeHasSufficientPID"
Jul 23 13:40:29.216932 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:29.167718    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 13:40:29.216932 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:29.167845    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-103.ec2.internal"
Jul 23 13:40:29.216932 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:29.167877    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 13:40:29.216932 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:29.168539    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-103.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 13:40:29.216932 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:29.168566    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-103.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 13:40:29.216932 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:29.168541    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-103.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 13:40:29.216932 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:29.168576    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-103.ec2.internal" event="NodeHasSufficientPID"
Jul 23 13:40:29.216932 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:29.168588    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-103.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 13:40:29.216932 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:29.168599    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-103.ec2.internal" event="NodeHasSufficientPID"
Jul 23 13:40:29.216932 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:29.170885    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-103.ec2.internal"
Jul 23 13:40:29.216932 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:29.170911    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 13:40:29.216932 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:29.172659    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-103.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 13:40:29.216932 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:29.172691    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-103.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 13:40:29.216932 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:29.172708    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-103.ec2.internal" event="NodeHasSufficientPID"
Jul 23 13:40:29.216932 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:29.210784    2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-103.ec2.internal\" not found" node="ip-10-0-140-103.ec2.internal"
Jul 23 13:40:29.216932 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:29.214443    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f8dcf2cbeaa60b98c88ce64f87e7f4a6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-103.ec2.internal\" (UID: \"f8dcf2cbeaa60b98c88ce64f87e7f4a6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-103.ec2.internal"
Jul 23 13:40:29.216932 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:29.214465    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f8dcf2cbeaa60b98c88ce64f87e7f4a6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-103.ec2.internal\" (UID: \"f8dcf2cbeaa60b98c88ce64f87e7f4a6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-103.ec2.internal"
Jul 23 13:40:29.216932 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:29.214483    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/60c2af9a1aa3e406170805fd92ab7b78-config\") pod \"kube-apiserver-proxy-ip-10-0-140-103.ec2.internal\" (UID: \"60c2af9a1aa3e406170805fd92ab7b78\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-103.ec2.internal"
Jul 23 13:40:29.219494 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:29.218354    2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-103.ec2.internal\" not found" node="ip-10-0-140-103.ec2.internal"
Jul 23 13:40:29.369566 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:29.234620    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-103.ec2.internal\" not found"
Jul 23 13:40:29.369566 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:29.319845    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f8dcf2cbeaa60b98c88ce64f87e7f4a6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-103.ec2.internal\" (UID: \"f8dcf2cbeaa60b98c88ce64f87e7f4a6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-103.ec2.internal"
Jul 23 13:40:29.369566 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:29.319876    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f8dcf2cbeaa60b98c88ce64f87e7f4a6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-103.ec2.internal\" (UID: \"f8dcf2cbeaa60b98c88ce64f87e7f4a6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-103.ec2.internal"
Jul 23 13:40:29.369566 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:29.319895    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/60c2af9a1aa3e406170805fd92ab7b78-config\") pod \"kube-apiserver-proxy-ip-10-0-140-103.ec2.internal\" (UID: \"60c2af9a1aa3e406170805fd92ab7b78\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-103.ec2.internal"
Jul 23 13:40:29.369566 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:29.319935    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f8dcf2cbeaa60b98c88ce64f87e7f4a6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-103.ec2.internal\" (UID: \"f8dcf2cbeaa60b98c88ce64f87e7f4a6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-103.ec2.internal"
Jul 23 13:40:29.369566 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:29.319942    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f8dcf2cbeaa60b98c88ce64f87e7f4a6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-103.ec2.internal\" (UID: \"f8dcf2cbeaa60b98c88ce64f87e7f4a6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-103.ec2.internal"
Jul 23 13:40:29.369566 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:29.319981    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/60c2af9a1aa3e406170805fd92ab7b78-config\") pod \"kube-apiserver-proxy-ip-10-0-140-103.ec2.internal\" (UID: \"60c2af9a1aa3e406170805fd92ab7b78\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-103.ec2.internal"
Jul 23 13:40:29.369566 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:29.335386    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-103.ec2.internal\" not found"
Jul 23 13:40:29.539038 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:29.436519    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-103.ec2.internal\" not found"
Jul 23 13:40:29.539038 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:29.517946    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-103.ec2.internal"
Jul 23 13:40:29.539038 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:29.521537    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-103.ec2.internal"
Jul 23 13:40:29.539038 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:29.537143    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-103.ec2.internal\" not found"
Jul 23 13:40:29.638578 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:29.638461    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-103.ec2.internal\" not found"
Jul 23 13:40:29.739024 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:29.738974    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-103.ec2.internal\" not found"
Jul 23 13:40:29.839508 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:29.839476    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-103.ec2.internal\" not found"
Jul 23 13:40:29.847204 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:29.847172    2573 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 23 13:40:29.847383 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:29.847363    2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 23 13:40:29.940707 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:29.940622    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-103.ec2.internal\" not found"
Jul 23 13:40:29.954567 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:29.954519    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-22 13:35:29 +0000 UTC" deadline="2028-04-18 20:35:53.577697942 +0000 UTC"
Jul 23 13:40:29.954567 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:29.954559    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15246h55m23.623143519s"
Jul 23 13:40:30.010487 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.010459    2573 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 13:40:30.012573 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.012556    2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-103.ec2.internal"
Jul 23 13:40:30.029200 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.029174    2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 23 13:40:30.031020 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.031006    2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-103.ec2.internal"
Jul 23 13:40:30.039558 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.039538    2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 23 13:40:30.117008 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.116969    2573 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 13:40:30.292422 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:30.292369    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60c2af9a1aa3e406170805fd92ab7b78.slice/crio-371e9a0c447e9fe06ec58db9974aa68070f194f359622f0f9d63cfd0dfbeb5d8 WatchSource:0}: Error finding container 371e9a0c447e9fe06ec58db9974aa68070f194f359622f0f9d63cfd0dfbeb5d8: Status 404 returned error can't find the container with id 371e9a0c447e9fe06ec58db9974aa68070f194f359622f0f9d63cfd0dfbeb5d8
Jul 23 13:40:30.299576 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.299552    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 13:40:30.303593 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.303574    2573 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 13:40:30.304994 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:30.304971    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8dcf2cbeaa60b98c88ce64f87e7f4a6.slice/crio-20f6d3192746328b5982be3dbce3e02c8b1eca0366a419b4098498490c4429bf WatchSource:0}: Error finding container 20f6d3192746328b5982be3dbce3e02c8b1eca0366a419b4098498490c4429bf: Status 404 returned error can't find the container with id 20f6d3192746328b5982be3dbce3e02c8b1eca0366a419b4098498490c4429bf
Jul 23 13:40:30.890594 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.890562    2573 apiserver.go:52] "Watching apiserver"
Jul 23 13:40:30.902525 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.902201    2573 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 23 13:40:30.903526 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.903487    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-103.ec2.internal","openshift-network-diagnostics/network-check-target-rvjth","openshift-ovn-kubernetes/ovnkube-node-bpbpp","kube-system/konnectivity-agent-2p6xl","kube-system/kube-apiserver-proxy-ip-10-0-140-103.ec2.internal","openshift-image-registry/node-ca-5gxsc","openshift-multus/multus-additional-cni-plugins-65xv7","openshift-multus/multus-wk2bh","openshift-multus/network-metrics-daemon-74ntz","openshift-network-operator/iptables-alerter-h6fvc","kube-system/global-pull-secret-syncer-wx249","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5n45","openshift-cluster-node-tuning-operator/tuned-4rr68","openshift-dns/node-resolver-h5h9z"]
Jul 23 13:40:30.906584 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.906557    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-65xv7"
Jul 23 13:40:30.909383 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.908999    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wx249"
Jul 23 13:40:30.909383 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:30.909268    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wx249" podUID="ebc1dbc1-a42e-4498-8678-0f6a33a11f5f"
Jul 23 13:40:30.909663 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.909618    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 23 13:40:30.911063 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.910813    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-8qxnw\""
Jul 23 13:40:30.911184 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.911169    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 23 13:40:30.911866 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.911456    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 23 13:40:30.911866 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.911551    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bpbpp"
Jul 23 13:40:30.911866 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.911584    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 23 13:40:30.911866 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.911612    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 23 13:40:30.914232 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.913387    2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 23 13:40:30.914232 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.914046    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 23 13:40:30.914412 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.914315    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-f6k7q\""
Jul 23 13:40:30.914591 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.914462    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 23 13:40:30.915246 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.914890    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 23 13:40:30.915246 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.915131    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 23 13:40:30.915246 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.915140    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 23 13:40:30.915498 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.915470    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 23 13:40:30.915790 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.915762    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2p6xl"
Jul 23 13:40:30.918078 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.918057    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-btdbd\""
Jul 23 13:40:30.918179 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.918064    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 23 13:40:30.918482 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.918463    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 23 13:40:30.919380 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.919359    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-h5h9z"
Jul 23 13:40:30.921622 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.921602    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 23 13:40:30.921800 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.921780    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-xvl4f\""
Jul 23 13:40:30.921906 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.921892    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5gxsc"
Jul 23 13:40:30.923965 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.923913    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 23 13:40:30.924486 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.924463    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-m76cg\""
Jul 23 13:40:30.924803 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.924784    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 23 13:40:30.924965 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.924938    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 23 13:40:30.925043 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.925004    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-74ntz"
Jul 23 13:40:30.925156 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:30.925129    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-74ntz" podUID="f460d16d-e05e-45bb-b8cb-71fd972809f5"
Jul 23 13:40:30.925454 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.925436    2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 23 13:40:30.925609 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.925565    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 23 13:40:30.927187 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.927168    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4rr68"
Jul 23 13:40:30.928165 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.928139    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/98e8320f-eba6-438b-aad3-1905aee071d8-ovnkube-config\") pod \"ovnkube-node-bpbpp\" (UID: \"98e8320f-eba6-438b-aad3-1905aee071d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpbpp"
Jul 23 13:40:30.928262 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.928183    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e492bdc2-dfd1-4b82-a8fc-37f82765cdb4-system-cni-dir\") pod \"multus-additional-cni-plugins-65xv7\" (UID: \"e492bdc2-dfd1-4b82-a8fc-37f82765cdb4\") " pod="openshift-multus/multus-additional-cni-plugins-65xv7"
Jul 23 13:40:30.928262 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.928210    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/98e8320f-eba6-438b-aad3-1905aee071d8-host-slash\") pod \"ovnkube-node-bpbpp\" (UID: \"98e8320f-eba6-438b-aad3-1905aee071d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpbpp"
Jul 23 13:40:30.928262 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.928243    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/98e8320f-eba6-438b-aad3-1905aee071d8-run-openvswitch\") pod \"ovnkube-node-bpbpp\" (UID: \"98e8320f-eba6-438b-aad3-1905aee071d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpbpp"
Jul 23 13:40:30.928262 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.928262    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/98e8320f-eba6-438b-aad3-1905aee071d8-ovn-node-metrics-cert\") pod \"ovnkube-node-bpbpp\" (UID: \"98e8320f-eba6-438b-aad3-1905aee071d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpbpp"
Jul 23 13:40:30.928506 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.928309    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/119f8d52-ffb3-43c7-922e-e0bc75740bd2-agent-certs\") pod \"konnectivity-agent-2p6xl\" (UID: \"119f8d52-ffb3-43c7-922e-e0bc75740bd2\") " pod="kube-system/konnectivity-agent-2p6xl"
Jul 23 13:40:30.928506 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.928378    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e492bdc2-dfd1-4b82-a8fc-37f82765cdb4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-65xv7\" (UID: \"e492bdc2-dfd1-4b82-a8fc-37f82765cdb4\") " pod="openshift-multus/multus-additional-cni-plugins-65xv7"
Jul 23 13:40:30.928506 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.928420    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ebc1dbc1-a42e-4498-8678-0f6a33a11f5f-kubelet-config\") pod \"global-pull-secret-syncer-wx249\" (UID: \"ebc1dbc1-a42e-4498-8678-0f6a33a11f5f\") " pod="kube-system/global-pull-secret-syncer-wx249"
Jul 23 13:40:30.928506 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.928451    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/98e8320f-eba6-438b-aad3-1905aee071d8-log-socket\") pod \"ovnkube-node-bpbpp\" (UID: \"98e8320f-eba6-438b-aad3-1905aee071d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpbpp"
Jul 23 13:40:30.928506 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.928475    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/98e8320f-eba6-438b-aad3-1905aee071d8-host-cni-netd\") pod \"ovnkube-node-bpbpp\" (UID: \"98e8320f-eba6-438b-aad3-1905aee071d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpbpp"
Jul 23 13:40:30.928506 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.928497    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e492bdc2-dfd1-4b82-a8fc-37f82765cdb4-cnibin\") pod \"multus-additional-cni-plugins-65xv7\" (UID: \"e492bdc2-dfd1-4b82-a8fc-37f82765cdb4\") " pod="openshift-multus/multus-additional-cni-plugins-65xv7"
Jul 23 13:40:30.928812 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.928520    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e492bdc2-dfd1-4b82-a8fc-37f82765cdb4-cni-binary-copy\") pod \"multus-additional-cni-plugins-65xv7\" (UID: \"e492bdc2-dfd1-4b82-a8fc-37f82765cdb4\") " pod="openshift-multus/multus-additional-cni-plugins-65xv7"
Jul 23 13:40:30.928812 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.928542    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/98e8320f-eba6-438b-aad3-1905aee071d8-host-kubelet\") pod \"ovnkube-node-bpbpp\" (UID: \"98e8320f-eba6-438b-aad3-1905aee071d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpbpp"
Jul 23 13:40:30.928812 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.928567    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/98e8320f-eba6-438b-aad3-1905aee071d8-run-systemd\") pod \"ovnkube-node-bpbpp\" (UID: \"98e8320f-eba6-438b-aad3-1905aee071d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpbpp"
Jul 23 13:40:30.928812 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.928590    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e492bdc2-dfd1-4b82-a8fc-37f82765cdb4-os-release\") pod \"multus-additional-cni-plugins-65xv7\" (UID: \"e492bdc2-dfd1-4b82-a8fc-37f82765cdb4\") " pod="openshift-multus/multus-additional-cni-plugins-65xv7"
Jul 23 13:40:30.928812 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.928614    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/98e8320f-eba6-438b-aad3-1905aee071d8-etc-openvswitch\") pod \"ovnkube-node-bpbpp\" (UID: \"98e8320f-eba6-438b-aad3-1905aee071d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpbpp"
Jul 23 13:40:30.928812 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.928637    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/98e8320f-eba6-438b-aad3-1905aee071d8-run-ovn\") pod \"ovnkube-node-bpbpp\" (UID: \"98e8320f-eba6-438b-aad3-1905aee071d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpbpp"
Jul 23 13:40:30.928812 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.928662    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/98e8320f-eba6-438b-aad3-1905aee071d8-env-overrides\") pod \"ovnkube-node-bpbpp\" (UID: \"98e8320f-eba6-438b-aad3-1905aee071d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpbpp"
Jul 23 13:40:30.928812 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.928686    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e492bdc2-dfd1-4b82-a8fc-37f82765cdb4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-65xv7\" (UID: \"e492bdc2-dfd1-4b82-a8fc-37f82765cdb4\") " pod="openshift-multus/multus-additional-cni-plugins-65xv7"
Jul 23 13:40:30.928812 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.928713    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/98e8320f-eba6-438b-aad3-1905aee071d8-systemd-units\") pod \"ovnkube-node-bpbpp\" (UID: \"98e8320f-eba6-438b-aad3-1905aee071d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpbpp"
Jul 23 13:40:30.928812 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.928737    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/98e8320f-eba6-438b-aad3-1905aee071d8-var-lib-openvswitch\") pod \"ovnkube-node-bpbpp\" (UID: \"98e8320f-eba6-438b-aad3-1905aee071d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpbpp"
Jul 23 13:40:30.928812 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.928759    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/98e8320f-eba6-438b-aad3-1905aee071d8-node-log\") pod \"ovnkube-node-bpbpp\" (UID: \"98e8320f-eba6-438b-aad3-1905aee071d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpbpp"
Jul 23 13:40:30.928812 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.928797    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/98e8320f-eba6-438b-aad3-1905aee071d8-ovnkube-script-lib\") pod \"ovnkube-node-bpbpp\" (UID: \"98e8320f-eba6-438b-aad3-1905aee071d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpbpp"
Jul 23 13:40:30.929427 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.928828    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwn26\" (UniqueName: \"kubernetes.io/projected/e492bdc2-dfd1-4b82-a8fc-37f82765cdb4-kube-api-access-kwn26\") pod \"multus-additional-cni-plugins-65xv7\" (UID: \"e492bdc2-dfd1-4b82-a8fc-37f82765cdb4\") " pod="openshift-multus/multus-additional-cni-plugins-65xv7"
Jul 23 13:40:30.929427 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.928862    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/119f8d52-ffb3-43c7-922e-e0bc75740bd2-konnectivity-ca\") pod \"konnectivity-agent-2p6xl\" (UID: \"119f8d52-ffb3-43c7-922e-e0bc75740bd2\") " pod="kube-system/konnectivity-agent-2p6xl"
Jul 23 13:40:30.929427 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.928887    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/98e8320f-eba6-438b-aad3-1905aee071d8-host-run-ovn-kubernetes\") pod \"ovnkube-node-bpbpp\" (UID: \"98e8320f-eba6-438b-aad3-1905aee071d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpbpp"
Jul 23 13:40:30.929427 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.928912    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/98e8320f-eba6-438b-aad3-1905aee071d8-host-cni-bin\") pod \"ovnkube-node-bpbpp\" (UID: \"98e8320f-eba6-438b-aad3-1905aee071d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpbpp"
Jul 23 13:40:30.929427 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.928939    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ebc1dbc1-a42e-4498-8678-0f6a33a11f5f-dbus\") pod \"global-pull-secret-syncer-wx249\" (UID: \"ebc1dbc1-a42e-4498-8678-0f6a33a11f5f\") " pod="kube-system/global-pull-secret-syncer-wx249"
Jul 23 13:40:30.929427 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.928964    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ebc1dbc1-a42e-4498-8678-0f6a33a11f5f-original-pull-secret\") pod \"global-pull-secret-syncer-wx249\" (UID: \"ebc1dbc1-a42e-4498-8678-0f6a33a11f5f\") " pod="kube-system/global-pull-secret-syncer-wx249"
Jul 23 13:40:30.929427 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.928994    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/98e8320f-eba6-438b-aad3-1905aee071d8-host-run-netns\") pod \"ovnkube-node-bpbpp\" (UID: \"98e8320f-eba6-438b-aad3-1905aee071d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpbpp"
Jul 23 13:40:30.929427 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.929019    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/98e8320f-eba6-438b-aad3-1905aee071d8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bpbpp\" (UID: \"98e8320f-eba6-438b-aad3-1905aee071d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpbpp"
Jul 23 13:40:30.929427 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.929052    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m54ln\" (UniqueName: \"kubernetes.io/projected/98e8320f-eba6-438b-aad3-1905aee071d8-kube-api-access-m54ln\") pod \"ovnkube-node-bpbpp\" (UID: \"98e8320f-eba6-438b-aad3-1905aee071d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpbpp"
Jul 23 13:40:30.929427 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.929103    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e492bdc2-dfd1-4b82-a8fc-37f82765cdb4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-65xv7\" (UID: \"e492bdc2-dfd1-4b82-a8fc-37f82765cdb4\") " pod="openshift-multus/multus-additional-cni-plugins-65xv7"
Jul 23 13:40:30.929893 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.929530    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 23 13:40:30.931999 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.931903    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rvjth"
Jul 23 13:40:30.932139 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:30.932071    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rvjth" podUID="0f9ef7a1-2fa9-46bc-acc8-83a25209e294"
Jul 23 13:40:30.932551 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.932529    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 23 13:40:30.932770 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.932744    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-gws4w\""
Jul 23 13:40:30.935785 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.935745    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-h6fvc"
Jul 23 13:40:30.938739 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.938648    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wk2bh"
Jul 23 13:40:30.939089 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.938929    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-bkvmc\""
Jul 23 13:40:30.939089 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.938949    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 23 13:40:30.939089 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.939062    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 23 13:40:30.939768 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.939642    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 23 13:40:30.941267 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.941245    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5n45"
Jul 23 13:40:30.941885 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.941335    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 23 13:40:30.941885 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.941782    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-cns9h\""
Jul 23 13:40:30.943731 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.943712    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 23 13:40:30.943844 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.943734    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 23 13:40:30.944285 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.944255    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 23 13:40:30.944513 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.944496    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-46kdf\""
Jul 23 13:40:30.952615 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.952592    2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-fw4qt"
Jul 23 13:40:30.962039 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:30.962021    2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-fw4qt"
Jul 23 13:40:31.014383 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.014348    2573 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 23 13:40:31.030130 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.030098    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d532106c-d9f6-4e10-aa47-30c8674703a3-etc-sysconfig\") pod \"tuned-4rr68\" (UID: \"d532106c-d9f6-4e10-aa47-30c8674703a3\") " pod="openshift-cluster-node-tuning-operator/tuned-4rr68"
Jul 23 13:40:31.030297 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.030141    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d532106c-d9f6-4e10-aa47-30c8674703a3-etc-sysctl-conf\") pod \"tuned-4rr68\" (UID: \"d532106c-d9f6-4e10-aa47-30c8674703a3\") " pod="openshift-cluster-node-tuning-operator/tuned-4rr68"
Jul 23 13:40:31.030297 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.030170    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d532106c-d9f6-4e10-aa47-30c8674703a3-lib-modules\") pod \"tuned-4rr68\" (UID: \"d532106c-d9f6-4e10-aa47-30c8674703a3\") " pod="openshift-cluster-node-tuning-operator/tuned-4rr68"
Jul 23 13:40:31.030297 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.030197    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0ee38828-a288-4015-b238-f1235220578b-host-slash\") pod \"iptables-alerter-h6fvc\" (UID: \"0ee38828-a288-4015-b238-f1235220578b\") " pod="openshift-network-operator/iptables-alerter-h6fvc"
Jul 23 13:40:31.030297 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.030251    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6e3c0848-ce0b-43f7-83a0-4bce9475d1a3-host-run-netns\") pod \"multus-wk2bh\" (UID: \"6e3c0848-ce0b-43f7-83a0-4bce9475d1a3\") " pod="openshift-multus/multus-wk2bh"
Jul 23 13:40:31.030502 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.030317    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e492bdc2-dfd1-4b82-a8fc-37f82765cdb4-cni-binary-copy\") pod \"multus-additional-cni-plugins-65xv7\" (UID: \"e492bdc2-dfd1-4b82-a8fc-37f82765cdb4\") " pod="openshift-multus/multus-additional-cni-plugins-65xv7"
Jul 23 13:40:31.030502 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.030348    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/98e8320f-eba6-438b-aad3-1905aee071d8-run-systemd\") pod \"ovnkube-node-bpbpp\" (UID: \"98e8320f-eba6-438b-aad3-1905aee071d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpbpp"
Jul 23 13:40:31.030502 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.030406    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/98e8320f-eba6-438b-aad3-1905aee071d8-run-systemd\") pod \"ovnkube-node-bpbpp\" (UID: \"98e8320f-eba6-438b-aad3-1905aee071d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpbpp"
Jul 23 13:40:31.030502 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.030441    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6e3c0848-ce0b-43f7-83a0-4bce9475d1a3-multus-cni-dir\") pod \"multus-wk2bh\" (UID: \"6e3c0848-ce0b-43f7-83a0-4bce9475d1a3\") " pod="openshift-multus/multus-wk2bh"
Jul 23 13:40:31.030502 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.030467    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d532106c-d9f6-4e10-aa47-30c8674703a3-etc-tuned\") pod \"tuned-4rr68\" (UID: \"d532106c-d9f6-4e10-aa47-30c8674703a3\") " pod="openshift-cluster-node-tuning-operator/tuned-4rr68"
Jul 23 13:40:31.030502 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.030492    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ef85df48-0dd5-4e01-93ef-724734054808-socket-dir\") pod \"aws-ebs-csi-driver-node-m5n45\" (UID: \"ef85df48-0dd5-4e01-93ef-724734054808\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5n45"
Jul 23 13:40:31.030700 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.030519    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ef85df48-0dd5-4e01-93ef-724734054808-device-dir\") pod \"aws-ebs-csi-driver-node-m5n45\" (UID: \"ef85df48-0dd5-4e01-93ef-724734054808\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5n45"
Jul 23 13:40:31.030700 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.030545    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e492bdc2-dfd1-4b82-a8fc-37f82765cdb4-os-release\") pod \"multus-additional-cni-plugins-65xv7\" (UID: \"e492bdc2-dfd1-4b82-a8fc-37f82765cdb4\") " pod="openshift-multus/multus-additional-cni-plugins-65xv7"
Jul 23 13:40:31.030700 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.030571    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6e3c0848-ce0b-43f7-83a0-4bce9475d1a3-cni-binary-copy\") pod \"multus-wk2bh\" (UID: \"6e3c0848-ce0b-43f7-83a0-4bce9475d1a3\") " pod="openshift-multus/multus-wk2bh"
Jul 23 13:40:31.030700 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.030595    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76zrb\" (UniqueName: \"kubernetes.io/projected/d846e487-3440-4729-89d1-57211afe3328-kube-api-access-76zrb\") pod \"node-ca-5gxsc\" (UID: \"d846e487-3440-4729-89d1-57211afe3328\") " pod="openshift-image-registry/node-ca-5gxsc"
Jul 23 13:40:31.030700 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.030622    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ef85df48-0dd5-4e01-93ef-724734054808-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m5n45\" (UID: \"ef85df48-0dd5-4e01-93ef-724734054808\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5n45"
Jul 23 13:40:31.030700 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.030650    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e492bdc2-dfd1-4b82-a8fc-37f82765cdb4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-65xv7\" (UID: \"e492bdc2-dfd1-4b82-a8fc-37f82765cdb4\") " pod="openshift-multus/multus-additional-cni-plugins-65xv7"
Jul 23 13:40:31.030700 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.030678    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/98e8320f-eba6-438b-aad3-1905aee071d8-var-lib-openvswitch\") pod \"ovnkube-node-bpbpp\" (UID: \"98e8320f-eba6-438b-aad3-1905aee071d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpbpp"
Jul 23 13:40:31.030946 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.030703    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/98e8320f-eba6-438b-aad3-1905aee071d8-ovnkube-script-lib\") pod \"ovnkube-node-bpbpp\" (UID: \"98e8320f-eba6-438b-aad3-1905aee071d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpbpp"
Jul 23 13:40:31.030946 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.030728    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npj4b\" (UniqueName: \"kubernetes.io/projected/382c782e-058b-4863-bd13-2e88a5f465bf-kube-api-access-npj4b\") pod \"node-resolver-h5h9z\" (UID: \"382c782e-058b-4863-bd13-2e88a5f465bf\") " pod="openshift-dns/node-resolver-h5h9z"
Jul 23 13:40:31.030946 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.030753    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d532106c-d9f6-4e10-aa47-30c8674703a3-etc-modprobe-d\") pod \"tuned-4rr68\" (UID: \"d532106c-d9f6-4e10-aa47-30c8674703a3\") " pod="openshift-cluster-node-tuning-operator/tuned-4rr68"
Jul 23 13:40:31.030946 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.030777    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d532106c-d9f6-4e10-aa47-30c8674703a3-etc-kubernetes\") pod \"tuned-4rr68\" (UID: \"d532106c-d9f6-4e10-aa47-30c8674703a3\") " pod="openshift-cluster-node-tuning-operator/tuned-4rr68"
Jul 23 13:40:31.030946 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.030800    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ef85df48-0dd5-4e01-93ef-724734054808-etc-selinux\") pod \"aws-ebs-csi-driver-node-m5n45\" (UID: \"ef85df48-0dd5-4e01-93ef-724734054808\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5n45"
Jul 23 13:40:31.030946 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.030829    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwn26\" (UniqueName: \"kubernetes.io/projected/e492bdc2-dfd1-4b82-a8fc-37f82765cdb4-kube-api-access-kwn26\") pod \"multus-additional-cni-plugins-65xv7\" (UID: \"e492bdc2-dfd1-4b82-a8fc-37f82765cdb4\") " pod="openshift-multus/multus-additional-cni-plugins-65xv7"
Jul 23 13:40:31.030946 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.030857    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/119f8d52-ffb3-43c7-922e-e0bc75740bd2-konnectivity-ca\") pod \"konnectivity-agent-2p6xl\" (UID: \"119f8d52-ffb3-43c7-922e-e0bc75740bd2\") " pod="kube-system/konnectivity-agent-2p6xl"
Jul 23 13:40:31.030946 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.030882    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2fsq\" (UniqueName: \"kubernetes.io/projected/6e3c0848-ce0b-43f7-83a0-4bce9475d1a3-kube-api-access-x2fsq\") pod \"multus-wk2bh\" (UID: \"6e3c0848-ce0b-43f7-83a0-4bce9475d1a3\") " pod="openshift-multus/multus-wk2bh"
Jul 23 13:40:31.030946 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.030907    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d846e487-3440-4729-89d1-57211afe3328-serviceca\") pod \"node-ca-5gxsc\" (UID: \"d846e487-3440-4729-89d1-57211afe3328\") " pod="openshift-image-registry/node-ca-5gxsc"
Jul 23 13:40:31.030946 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.030930    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d532106c-d9f6-4e10-aa47-30c8674703a3-sys\") pod \"tuned-4rr68\" (UID: \"d532106c-d9f6-4e10-aa47-30c8674703a3\") " pod="openshift-cluster-node-tuning-operator/tuned-4rr68"
Jul 23 13:40:31.031491 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.030957    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4676\" (UniqueName: \"kubernetes.io/projected/0ee38828-a288-4015-b238-f1235220578b-kube-api-access-q4676\") pod \"iptables-alerter-h6fvc\" (UID: \"0ee38828-a288-4015-b238-f1235220578b\") " pod="openshift-network-operator/iptables-alerter-h6fvc"
Jul 23 13:40:31.031491 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.030963    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e492bdc2-dfd1-4b82-a8fc-37f82765cdb4-cni-binary-copy\") pod \"multus-additional-cni-plugins-65xv7\" (UID: \"e492bdc2-dfd1-4b82-a8fc-37f82765cdb4\") " pod="openshift-multus/multus-additional-cni-plugins-65xv7"
Jul 23 13:40:31.031491 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.030986    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/98e8320f-eba6-438b-aad3-1905aee071d8-host-run-ovn-kubernetes\") pod \"ovnkube-node-bpbpp\" (UID: \"98e8320f-eba6-438b-aad3-1905aee071d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpbpp"
Jul 23 13:40:31.031491 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.031031    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/98e8320f-eba6-438b-aad3-1905aee071d8-host-run-ovn-kubernetes\") pod \"ovnkube-node-bpbpp\" (UID: \"98e8320f-eba6-438b-aad3-1905aee071d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpbpp"
Jul 23 13:40:31.031491 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.031033    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ebc1dbc1-a42e-4498-8678-0f6a33a11f5f-dbus\") pod \"global-pull-secret-syncer-wx249\" (UID: \"ebc1dbc1-a42e-4498-8678-0f6a33a11f5f\") " pod="kube-system/global-pull-secret-syncer-wx249"
Jul 23 13:40:31.031491 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.031089    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ebc1dbc1-a42e-4498-8678-0f6a33a11f5f-original-pull-secret\") pod \"global-pull-secret-syncer-wx249\" (UID: \"ebc1dbc1-a42e-4498-8678-0f6a33a11f5f\") " pod="kube-system/global-pull-secret-syncer-wx249"
Jul 23 13:40:31.031491 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.031171    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6e3c0848-ce0b-43f7-83a0-4bce9475d1a3-host-run-k8s-cni-cncf-io\") pod \"multus-wk2bh\" (UID: \"6e3c0848-ce0b-43f7-83a0-4bce9475d1a3\") " pod="openshift-multus/multus-wk2bh"
Jul 23 13:40:31.031491 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.031207    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/98e8320f-eba6-438b-aad3-1905aee071d8-var-lib-openvswitch\") pod \"ovnkube-node-bpbpp\" (UID: \"98e8320f-eba6-438b-aad3-1905aee071d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpbpp"
Jul 23 13:40:31.031491 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.031240    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e492bdc2-dfd1-4b82-a8fc-37f82765cdb4-os-release\") pod \"multus-additional-cni-plugins-65xv7\" (UID: \"e492bdc2-dfd1-4b82-a8fc-37f82765cdb4\") " pod="openshift-multus/multus-additional-cni-plugins-65xv7"
Jul 23 13:40:31.031491 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:31.031347    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 13:40:31.031491 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.031354    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ebc1dbc1-a42e-4498-8678-0f6a33a11f5f-dbus\") pod \"global-pull-secret-syncer-wx249\" (UID: \"ebc1dbc1-a42e-4498-8678-0f6a33a11f5f\") " pod="kube-system/global-pull-secret-syncer-wx249"
Jul 23 13:40:31.031491 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.031393    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/98e8320f-eba6-438b-aad3-1905aee071d8-ovnkube-config\") pod \"ovnkube-node-bpbpp\" (UID: \"98e8320f-eba6-438b-aad3-1905aee071d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpbpp"
Jul 23 13:40:31.031491 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:31.031457    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebc1dbc1-a42e-4498-8678-0f6a33a11f5f-original-pull-secret podName:ebc1dbc1-a42e-4498-8678-0f6a33a11f5f nodeName:}" failed. No retries permitted until 2026-07-23 13:40:31.531433343 +0000 UTC m=+2.970934252 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ebc1dbc1-a42e-4498-8678-0f6a33a11f5f-original-pull-secret") pod "global-pull-secret-syncer-wx249" (UID: "ebc1dbc1-a42e-4498-8678-0f6a33a11f5f") : object "kube-system"/"original-pull-secret" not registered
Jul 23 13:40:31.032246 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.031521    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e3c0848-ce0b-43f7-83a0-4bce9475d1a3-host-var-lib-kubelet\") pod \"multus-wk2bh\" (UID: \"6e3c0848-ce0b-43f7-83a0-4bce9475d1a3\") " pod="openshift-multus/multus-wk2bh"
Jul 23 13:40:31.032246 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.031554    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/382c782e-058b-4863-bd13-2e88a5f465bf-hosts-file\") pod \"node-resolver-h5h9z\" (UID: \"382c782e-058b-4863-bd13-2e88a5f465bf\") " pod="openshift-dns/node-resolver-h5h9z"
Jul 23 13:40:31.032246 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.031582    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e492bdc2-dfd1-4b82-a8fc-37f82765cdb4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-65xv7\" (UID: \"e492bdc2-dfd1-4b82-a8fc-37f82765cdb4\") " pod="openshift-multus/multus-additional-cni-plugins-65xv7"
Jul 23 13:40:31.032246 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.031606    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jljs\" (UniqueName: \"kubernetes.io/projected/0f9ef7a1-2fa9-46bc-acc8-83a25209e294-kube-api-access-7jljs\") pod \"network-check-target-rvjth\" (UID: \"0f9ef7a1-2fa9-46bc-acc8-83a25209e294\") " pod="openshift-network-diagnostics/network-check-target-rvjth"
Jul 23 13:40:31.032246 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.031663    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e492bdc2-dfd1-4b82-a8fc-37f82765cdb4-system-cni-dir\") pod \"multus-additional-cni-plugins-65xv7\" (UID: \"e492bdc2-dfd1-4b82-a8fc-37f82765cdb4\") " pod="openshift-multus/multus-additional-cni-plugins-65xv7"
Jul 23 13:40:31.032246 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.031729    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e492bdc2-dfd1-4b82-a8fc-37f82765cdb4-system-cni-dir\") pod \"multus-additional-cni-plugins-65xv7\" (UID: \"e492bdc2-dfd1-4b82-a8fc-37f82765cdb4\") " pod="openshift-multus/multus-additional-cni-plugins-65xv7"
Jul 23 13:40:31.032246 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.031732    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/98e8320f-eba6-438b-aad3-1905aee071d8-run-openvswitch\") pod \"ovnkube-node-bpbpp\" (UID: \"98e8320f-eba6-438b-aad3-1905aee071d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpbpp"
Jul 23 13:40:31.032246 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.031770    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/98e8320f-eba6-438b-aad3-1905aee071d8-ovn-node-metrics-cert\") pod \"ovnkube-node-bpbpp\" (UID: \"98e8320f-eba6-438b-aad3-1905aee071d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpbpp"
Jul 23 13:40:31.032246 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.031779    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/98e8320f-eba6-438b-aad3-1905aee071d8-run-openvswitch\") pod \"ovnkube-node-bpbpp\" (UID: \"98e8320f-eba6-438b-aad3-1905aee071d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpbpp"
Jul 23 13:40:31.032246 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.031798    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/98e8320f-eba6-438b-aad3-1905aee071d8-ovnkube-script-lib\") pod \"ovnkube-node-bpbpp\" (UID: \"98e8320f-eba6-438b-aad3-1905aee071d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpbpp"
Jul 23 13:40:31.032246 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.031814    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d532106c-d9f6-4e10-aa47-30c8674703a3-var-lib-kubelet\") pod \"tuned-4rr68\" (UID: \"d532106c-d9f6-4e10-aa47-30c8674703a3\") " pod="openshift-cluster-node-tuning-operator/tuned-4rr68"
Jul 23 13:40:31.032246 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.031863    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhhzs\" (UniqueName: \"kubernetes.io/projected/d532106c-d9f6-4e10-aa47-30c8674703a3-kube-api-access-dhhzs\") pod \"tuned-4rr68\" (UID: \"d532106c-d9f6-4e10-aa47-30c8674703a3\") " pod="openshift-cluster-node-tuning-operator/tuned-4rr68"
Jul 23 13:40:31.032246 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.031905    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/98e8320f-eba6-438b-aad3-1905aee071d8-log-socket\") pod \"ovnkube-node-bpbpp\" (UID: \"98e8320f-eba6-438b-aad3-1905aee071d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpbpp"
Jul 23 13:40:31.032246 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.031940    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d532106c-d9f6-4e10-aa47-30c8674703a3-run\") pod \"tuned-4rr68\" (UID: \"d532106c-d9f6-4e10-aa47-30c8674703a3\") " pod="openshift-cluster-node-tuning-operator/tuned-4rr68"
Jul 23 13:40:31.033139 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.031984    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/119f8d52-ffb3-43c7-922e-e0bc75740bd2-konnectivity-ca\") pod \"konnectivity-agent-2p6xl\" (UID: \"119f8d52-ffb3-43c7-922e-e0bc75740bd2\") " pod="kube-system/konnectivity-agent-2p6xl"
Jul 23 13:40:31.033139 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.031992    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ef85df48-0dd5-4e01-93ef-724734054808-registration-dir\") pod \"aws-ebs-csi-driver-node-m5n45\" (UID: \"ef85df48-0dd5-4e01-93ef-724734054808\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5n45"
Jul 23 13:40:31.033139 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.031987    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/98e8320f-eba6-438b-aad3-1905aee071d8-log-socket\") pod \"ovnkube-node-bpbpp\" (UID: \"98e8320f-eba6-438b-aad3-1905aee071d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpbpp"
Jul 23 13:40:31.033139 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.032048    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgj2d\" (UniqueName: \"kubernetes.io/projected/f460d16d-e05e-45bb-b8cb-71fd972809f5-kube-api-access-mgj2d\") pod \"network-metrics-daemon-74ntz\" (UID: \"f460d16d-e05e-45bb-b8cb-71fd972809f5\") " pod="openshift-multus/network-metrics-daemon-74ntz"
Jul 23 13:40:31.033139 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.032058    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/98e8320f-eba6-438b-aad3-1905aee071d8-ovnkube-config\") pod \"ovnkube-node-bpbpp\" (UID: \"98e8320f-eba6-438b-aad3-1905aee071d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpbpp"
Jul 23 13:40:31.033139 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.032077    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6e3c0848-ce0b-43f7-83a0-4bce9475d1a3-host-var-lib-cni-bin\") pod \"multus-wk2bh\" (UID: \"6e3c0848-ce0b-43f7-83a0-4bce9475d1a3\") " pod="openshift-multus/multus-wk2bh"
Jul 23 13:40:31.033139 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.032123    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e3c0848-ce0b-43f7-83a0-4bce9475d1a3-etc-kubernetes\") pod \"multus-wk2bh\" (UID: \"6e3c0848-ce0b-43f7-83a0-4bce9475d1a3\") " pod="openshift-multus/multus-wk2bh"
Jul 23 13:40:31.033139 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.032125    2573 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 23 13:40:31.033139 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.032151    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/98e8320f-eba6-438b-aad3-1905aee071d8-host-cni-netd\") pod \"ovnkube-node-bpbpp\" (UID: \"98e8320f-eba6-438b-aad3-1905aee071d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpbpp"
Jul 23 13:40:31.033139 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.032168    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e492bdc2-dfd1-4b82-a8fc-37f82765cdb4-cnibin\") pod \"multus-additional-cni-plugins-65xv7\" (UID: \"e492bdc2-dfd1-4b82-a8fc-37f82765cdb4\") " pod="openshift-multus/multus-additional-cni-plugins-65xv7"
Jul 23 13:40:31.033139 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.032190    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/98e8320f-eba6-438b-aad3-1905aee071d8-host-kubelet\") pod \"ovnkube-node-bpbpp\" (UID: \"98e8320f-eba6-438b-aad3-1905aee071d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpbpp"
Jul 23 13:40:31.033139 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.032216    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6e3c0848-ce0b-43f7-83a0-4bce9475d1a3-system-cni-dir\") pod \"multus-wk2bh\" (UID: \"6e3c0848-ce0b-43f7-83a0-4bce9475d1a3\") " pod="openshift-multus/multus-wk2bh"
Jul 23 13:40:31.033139 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.032240    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6e3c0848-ce0b-43f7-83a0-4bce9475d1a3-cnibin\") pod \"multus-wk2bh\" (UID: \"6e3c0848-ce0b-43f7-83a0-4bce9475d1a3\") " pod="openshift-multus/multus-wk2bh"
Jul 23 13:40:31.033139 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.032270    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/98e8320f-eba6-438b-aad3-1905aee071d8-etc-openvswitch\") pod \"ovnkube-node-bpbpp\" (UID: \"98e8320f-eba6-438b-aad3-1905aee071d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpbpp"
Jul 23 13:40:31.033139 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.032286    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e492bdc2-dfd1-4b82-a8fc-37f82765cdb4-cnibin\") pod \"multus-additional-cni-plugins-65xv7\" (UID: \"e492bdc2-dfd1-4b82-a8fc-37f82765cdb4\") " pod="openshift-multus/multus-additional-cni-plugins-65xv7"
Jul 23 13:40:31.033651 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.032295    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/98e8320f-eba6-438b-aad3-1905aee071d8-run-ovn\") pod \"ovnkube-node-bpbpp\" (UID: \"98e8320f-eba6-438b-aad3-1905aee071d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpbpp"
Jul 23 13:40:31.033651 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.032238    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/98e8320f-eba6-438b-aad3-1905aee071d8-host-cni-netd\") pod \"ovnkube-node-bpbpp\" (UID: \"98e8320f-eba6-438b-aad3-1905aee071d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpbpp"
Jul 23 13:40:31.033651 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.032321    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/98e8320f-eba6-438b-aad3-1905aee071d8-env-overrides\") pod \"ovnkube-node-bpbpp\" (UID: \"98e8320f-eba6-438b-aad3-1905aee071d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpbpp"
Jul 23 13:40:31.033651 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.032346    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6e3c0848-ce0b-43f7-83a0-4bce9475d1a3-multus-conf-dir\") pod \"multus-wk2bh\" (UID: \"6e3c0848-ce0b-43f7-83a0-4bce9475d1a3\") " pod="openshift-multus/multus-wk2bh"
Jul 23 13:40:31.033651 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.032357    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/98e8320f-eba6-438b-aad3-1905aee071d8-etc-openvswitch\") pod \"ovnkube-node-bpbpp\" (UID: \"98e8320f-eba6-438b-aad3-1905aee071d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpbpp"
Jul 23 13:40:31.033651 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.032403    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/98e8320f-eba6-438b-aad3-1905aee071d8-host-kubelet\") pod \"ovnkube-node-bpbpp\" (UID: \"98e8320f-eba6-438b-aad3-1905aee071d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpbpp"
Jul 23 13:40:31.033651 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.032406    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d846e487-3440-4729-89d1-57211afe3328-host\") pod \"node-ca-5gxsc\" (UID: \"d846e487-3440-4729-89d1-57211afe3328\") " pod="openshift-image-registry/node-ca-5gxsc"
Jul 23 13:40:31.033651 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.032433    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d532106c-d9f6-4e10-aa47-30c8674703a3-etc-sysctl-d\") pod \"tuned-4rr68\" (UID: \"d532106c-d9f6-4e10-aa47-30c8674703a3\") " pod="openshift-cluster-node-tuning-operator/tuned-4rr68"
Jul 23 13:40:31.033651 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.032458    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d532106c-d9f6-4e10-aa47-30c8674703a3-tmp\") pod \"tuned-4rr68\" (UID: \"d532106c-d9f6-4e10-aa47-30c8674703a3\") " pod="openshift-cluster-node-tuning-operator/tuned-4rr68"
Jul 23 13:40:31.033651 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.032485    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0ee38828-a288-4015-b238-f1235220578b-iptables-alerter-script\") pod \"iptables-alerter-h6fvc\" (UID: \"0ee38828-a288-4015-b238-f1235220578b\") " pod="openshift-network-operator/iptables-alerter-h6fvc"
Jul 23 13:40:31.033651 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.032512    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/98e8320f-eba6-438b-aad3-1905aee071d8-systemd-units\") pod \"ovnkube-node-bpbpp\" (UID: \"98e8320f-eba6-438b-aad3-1905aee071d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpbpp"
Jul 23 13:40:31.033651 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.032433    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/98e8320f-eba6-438b-aad3-1905aee071d8-run-ovn\") pod \"ovnkube-node-bpbpp\" (UID: \"98e8320f-eba6-438b-aad3-1905aee071d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpbpp"
Jul 23 13:40:31.033651 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.032536    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/98e8320f-eba6-438b-aad3-1905aee071d8-node-log\") pod \"ovnkube-node-bpbpp\" (UID: \"98e8320f-eba6-438b-aad3-1905aee071d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpbpp"
Jul 23 13:40:31.033651 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.032594    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rw9h\" (UniqueName: \"kubernetes.io/projected/ef85df48-0dd5-4e01-93ef-724734054808-kube-api-access-5rw9h\") pod \"aws-ebs-csi-driver-node-m5n45\" (UID: \"ef85df48-0dd5-4e01-93ef-724734054808\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5n45"
Jul 23 13:40:31.034349 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.032600    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/98e8320f-eba6-438b-aad3-1905aee071d8-systemd-units\") pod \"ovnkube-node-bpbpp\" (UID: \"98e8320f-eba6-438b-aad3-1905aee071d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpbpp"
Jul 23 13:40:31.034349 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.032645    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/98e8320f-eba6-438b-aad3-1905aee071d8-node-log\") pod \"ovnkube-node-bpbpp\" (UID: \"98e8320f-eba6-438b-aad3-1905aee071d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpbpp"
Jul 23 13:40:31.034349 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.032679    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6e3c0848-ce0b-43f7-83a0-4bce9475d1a3-os-release\") pod \"multus-wk2bh\" (UID: \"6e3c0848-ce0b-43f7-83a0-4bce9475d1a3\") " pod="openshift-multus/multus-wk2bh"
Jul 23 13:40:31.034349 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.032707    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/382c782e-058b-4863-bd13-2e88a5f465bf-tmp-dir\") pod \"node-resolver-h5h9z\" (UID: \"382c782e-058b-4863-bd13-2e88a5f465bf\") " pod="openshift-dns/node-resolver-h5h9z"
Jul 23 13:40:31.034349 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.032746    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/98e8320f-eba6-438b-aad3-1905aee071d8-host-cni-bin\") pod \"ovnkube-node-bpbpp\" (UID: \"98e8320f-eba6-438b-aad3-1905aee071d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpbpp"
Jul 23 13:40:31.034349 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.032795    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/98e8320f-eba6-438b-aad3-1905aee071d8-host-run-netns\") pod \"ovnkube-node-bpbpp\" (UID: \"98e8320f-eba6-438b-aad3-1905aee071d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpbpp"
Jul 23 13:40:31.034349 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.032820    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/98e8320f-eba6-438b-aad3-1905aee071d8-env-overrides\") pod \"ovnkube-node-bpbpp\" (UID: \"98e8320f-eba6-438b-aad3-1905aee071d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpbpp"
Jul 23 13:40:31.034349 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.032833    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/98e8320f-eba6-438b-aad3-1905aee071d8-host-run-netns\") pod \"ovnkube-node-bpbpp\" (UID: \"98e8320f-eba6-438b-aad3-1905aee071d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpbpp"
Jul 23 13:40:31.034349 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.032883    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/98e8320f-eba6-438b-aad3-1905aee071d8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bpbpp\" (UID: \"98e8320f-eba6-438b-aad3-1905aee071d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpbpp"
Jul 23 13:40:31.034349 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.032893    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/98e8320f-eba6-438b-aad3-1905aee071d8-host-cni-bin\") pod \"ovnkube-node-bpbpp\" (UID: \"98e8320f-eba6-438b-aad3-1905aee071d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpbpp"
Jul 23 13:40:31.034349 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.033599    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m54ln\" (UniqueName: \"kubernetes.io/projected/98e8320f-eba6-438b-aad3-1905aee071d8-kube-api-access-m54ln\") pod \"ovnkube-node-bpbpp\" (UID: \"98e8320f-eba6-438b-aad3-1905aee071d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpbpp"
Jul 23 13:40:31.034349 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.033654    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6e3c0848-ce0b-43f7-83a0-4bce9475d1a3-host-run-multus-certs\") pod \"multus-wk2bh\" (UID: \"6e3c0848-ce0b-43f7-83a0-4bce9475d1a3\") " pod="openshift-multus/multus-wk2bh"
Jul 23 13:40:31.034349 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.033696    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d532106c-d9f6-4e10-aa47-30c8674703a3-host\") pod \"tuned-4rr68\" (UID: \"d532106c-d9f6-4e10-aa47-30c8674703a3\") " pod="openshift-cluster-node-tuning-operator/tuned-4rr68"
Jul 23 13:40:31.034349 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.033731    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ef85df48-0dd5-4e01-93ef-724734054808-sys-fs\") pod \"aws-ebs-csi-driver-node-m5n45\" (UID: \"ef85df48-0dd5-4e01-93ef-724734054808\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5n45"
Jul 23 13:40:31.035011 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.033762    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e492bdc2-dfd1-4b82-a8fc-37f82765cdb4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-65xv7\" (UID: \"e492bdc2-dfd1-4b82-a8fc-37f82765cdb4\") " pod="openshift-multus/multus-additional-cni-plugins-65xv7"
Jul 23 13:40:31.035011 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.033768    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/98e8320f-eba6-438b-aad3-1905aee071d8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bpbpp\" (UID: \"98e8320f-eba6-438b-aad3-1905aee071d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpbpp"
Jul 23 13:40:31.035011 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.033832    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f460d16d-e05e-45bb-b8cb-71fd972809f5-metrics-certs\") pod \"network-metrics-daemon-74ntz\" (UID: \"f460d16d-e05e-45bb-b8cb-71fd972809f5\") " pod="openshift-multus/network-metrics-daemon-74ntz"
Jul 23 13:40:31.035011 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.034013    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e492bdc2-dfd1-4b82-a8fc-37f82765cdb4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-65xv7\" (UID: \"e492bdc2-dfd1-4b82-a8fc-37f82765cdb4\") " pod="openshift-multus/multus-additional-cni-plugins-65xv7"
Jul 23 13:40:31.035011 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.034448    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/98e8320f-eba6-438b-aad3-1905aee071d8-host-slash\") pod \"ovnkube-node-bpbpp\" (UID: \"98e8320f-eba6-438b-aad3-1905aee071d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpbpp"
Jul 23 13:40:31.035011 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.034305    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/98e8320f-eba6-438b-aad3-1905aee071d8-host-slash\") pod \"ovnkube-node-bpbpp\" (UID: \"98e8320f-eba6-438b-aad3-1905aee071d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpbpp"
Jul 23 13:40:31.035011 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.034813    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/119f8d52-ffb3-43c7-922e-e0bc75740bd2-agent-certs\") pod \"konnectivity-agent-2p6xl\" (UID: \"119f8d52-ffb3-43c7-922e-e0bc75740bd2\") " pod="kube-system/konnectivity-agent-2p6xl"
Jul 23 13:40:31.035011 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.034850    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6e3c0848-ce0b-43f7-83a0-4bce9475d1a3-host-var-lib-cni-multus\") pod \"multus-wk2bh\" (UID: \"6e3c0848-ce0b-43f7-83a0-4bce9475d1a3\") " pod="openshift-multus/multus-wk2bh"
Jul 23 13:40:31.035011 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.034882    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6e3c0848-ce0b-43f7-83a0-4bce9475d1a3-hostroot\") pod \"multus-wk2bh\" (UID: \"6e3c0848-ce0b-43f7-83a0-4bce9475d1a3\") " pod="openshift-multus/multus-wk2bh"
Jul 23 13:40:31.035011 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.034906    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d532106c-d9f6-4e10-aa47-30c8674703a3-etc-systemd\") pod \"tuned-4rr68\" (UID: \"d532106c-d9f6-4e10-aa47-30c8674703a3\") " pod="openshift-cluster-node-tuning-operator/tuned-4rr68"
Jul 23 13:40:31.035011 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.034939    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e492bdc2-dfd1-4b82-a8fc-37f82765cdb4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-65xv7\" (UID: \"e492bdc2-dfd1-4b82-a8fc-37f82765cdb4\") " pod="openshift-multus/multus-additional-cni-plugins-65xv7"
Jul 23 13:40:31.035011 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.034973    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ebc1dbc1-a42e-4498-8678-0f6a33a11f5f-kubelet-config\") pod \"global-pull-secret-syncer-wx249\" (UID: \"ebc1dbc1-a42e-4498-8678-0f6a33a11f5f\") " pod="kube-system/global-pull-secret-syncer-wx249"
Jul 23 13:40:31.035011 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.035005    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6e3c0848-ce0b-43f7-83a0-4bce9475d1a3-multus-socket-dir-parent\") pod \"multus-wk2bh\" (UID: \"6e3c0848-ce0b-43f7-83a0-4bce9475d1a3\") " pod="openshift-multus/multus-wk2bh"
Jul 23 13:40:31.035617 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.035032    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6e3c0848-ce0b-43f7-83a0-4bce9475d1a3-multus-daemon-config\") pod \"multus-wk2bh\" (UID: \"6e3c0848-ce0b-43f7-83a0-4bce9475d1a3\") " pod="openshift-multus/multus-wk2bh"
Jul 23 13:40:31.036218 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.036122    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ebc1dbc1-a42e-4498-8678-0f6a33a11f5f-kubelet-config\") pod \"global-pull-secret-syncer-wx249\" (UID: \"ebc1dbc1-a42e-4498-8678-0f6a33a11f5f\") " pod="kube-system/global-pull-secret-syncer-wx249"
Jul 23 13:40:31.036655 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.036635    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e492bdc2-dfd1-4b82-a8fc-37f82765cdb4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-65xv7\" (UID: \"e492bdc2-dfd1-4b82-a8fc-37f82765cdb4\") " pod="openshift-multus/multus-additional-cni-plugins-65xv7"
Jul 23 13:40:31.037837 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.037774    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/98e8320f-eba6-438b-aad3-1905aee071d8-ovn-node-metrics-cert\") pod \"ovnkube-node-bpbpp\" (UID: \"98e8320f-eba6-438b-aad3-1905aee071d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpbpp"
Jul 23 13:40:31.039316 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.039284    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/119f8d52-ffb3-43c7-922e-e0bc75740bd2-agent-certs\") pod \"konnectivity-agent-2p6xl\" (UID: \"119f8d52-ffb3-43c7-922e-e0bc75740bd2\") " pod="kube-system/konnectivity-agent-2p6xl"
Jul 23 13:40:31.042236 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.042180    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m54ln\" (UniqueName: \"kubernetes.io/projected/98e8320f-eba6-438b-aad3-1905aee071d8-kube-api-access-m54ln\") pod \"ovnkube-node-bpbpp\" (UID: \"98e8320f-eba6-438b-aad3-1905aee071d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpbpp"
Jul 23 13:40:31.042779 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.042752    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwn26\" (UniqueName: \"kubernetes.io/projected/e492bdc2-dfd1-4b82-a8fc-37f82765cdb4-kube-api-access-kwn26\") pod \"multus-additional-cni-plugins-65xv7\" (UID: \"e492bdc2-dfd1-4b82-a8fc-37f82765cdb4\") " pod="openshift-multus/multus-additional-cni-plugins-65xv7"
Jul 23 13:40:31.049915 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.049830    2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 13:40:31.066899 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.066847    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-103.ec2.internal" event={"ID":"f8dcf2cbeaa60b98c88ce64f87e7f4a6","Type":"ContainerStarted","Data":"20f6d3192746328b5982be3dbce3e02c8b1eca0366a419b4098498490c4429bf"}
Jul 23 13:40:31.067945 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.067919    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-103.ec2.internal" event={"ID":"60c2af9a1aa3e406170805fd92ab7b78","Type":"ContainerStarted","Data":"371e9a0c447e9fe06ec58db9974aa68070f194f359622f0f9d63cfd0dfbeb5d8"}
Jul 23 13:40:31.135633 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.135597    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d846e487-3440-4729-89d1-57211afe3328-host\") pod \"node-ca-5gxsc\" (UID: \"d846e487-3440-4729-89d1-57211afe3328\") " pod="openshift-image-registry/node-ca-5gxsc"
Jul 23 13:40:31.135633 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.135636    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d532106c-d9f6-4e10-aa47-30c8674703a3-etc-sysctl-d\") pod \"tuned-4rr68\" (UID: \"d532106c-d9f6-4e10-aa47-30c8674703a3\") " pod="openshift-cluster-node-tuning-operator/tuned-4rr68"
Jul 23 13:40:31.135876 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.135660    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d532106c-d9f6-4e10-aa47-30c8674703a3-tmp\") pod \"tuned-4rr68\" (UID: \"d532106c-d9f6-4e10-aa47-30c8674703a3\") " pod="openshift-cluster-node-tuning-operator/tuned-4rr68"
Jul 23 13:40:31.135876 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.135683    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0ee38828-a288-4015-b238-f1235220578b-iptables-alerter-script\") pod \"iptables-alerter-h6fvc\" (UID: \"0ee38828-a288-4015-b238-f1235220578b\") " pod="openshift-network-operator/iptables-alerter-h6fvc"
Jul 23 13:40:31.135876 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.135708    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rw9h\" (UniqueName: \"kubernetes.io/projected/ef85df48-0dd5-4e01-93ef-724734054808-kube-api-access-5rw9h\") pod \"aws-ebs-csi-driver-node-m5n45\" (UID: \"ef85df48-0dd5-4e01-93ef-724734054808\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5n45"
Jul 23 13:40:31.135876 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.135711    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d846e487-3440-4729-89d1-57211afe3328-host\") pod \"node-ca-5gxsc\" (UID: \"d846e487-3440-4729-89d1-57211afe3328\") " pod="openshift-image-registry/node-ca-5gxsc"
Jul 23 13:40:31.135876 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.135793    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d532106c-d9f6-4e10-aa47-30c8674703a3-etc-sysctl-d\") pod \"tuned-4rr68\" (UID: \"d532106c-d9f6-4e10-aa47-30c8674703a3\") " pod="openshift-cluster-node-tuning-operator/tuned-4rr68"
Jul 23 13:40:31.135876 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.135832    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6e3c0848-ce0b-43f7-83a0-4bce9475d1a3-os-release\") pod \"multus-wk2bh\" (UID: \"6e3c0848-ce0b-43f7-83a0-4bce9475d1a3\") " pod="openshift-multus/multus-wk2bh"
Jul 23 13:40:31.135876 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.135865    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/382c782e-058b-4863-bd13-2e88a5f465bf-tmp-dir\") pod \"node-resolver-h5h9z\" (UID: \"382c782e-058b-4863-bd13-2e88a5f465bf\") " pod="openshift-dns/node-resolver-h5h9z"
Jul 23 13:40:31.136313 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.135897    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6e3c0848-ce0b-43f7-83a0-4bce9475d1a3-host-run-multus-certs\") pod \"multus-wk2bh\" (UID: \"6e3c0848-ce0b-43f7-83a0-4bce9475d1a3\") " pod="openshift-multus/multus-wk2bh"
Jul 23 13:40:31.136313 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.135924    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d532106c-d9f6-4e10-aa47-30c8674703a3-host\") pod \"tuned-4rr68\" (UID: \"d532106c-d9f6-4e10-aa47-30c8674703a3\") " pod="openshift-cluster-node-tuning-operator/tuned-4rr68"
Jul 23 13:40:31.136313 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.135943    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6e3c0848-ce0b-43f7-83a0-4bce9475d1a3-os-release\") pod \"multus-wk2bh\" (UID: \"6e3c0848-ce0b-43f7-83a0-4bce9475d1a3\") " pod="openshift-multus/multus-wk2bh"
Jul 23 13:40:31.136313 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.135949    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ef85df48-0dd5-4e01-93ef-724734054808-sys-fs\") pod \"aws-ebs-csi-driver-node-m5n45\" (UID: \"ef85df48-0dd5-4e01-93ef-724734054808\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5n45"
Jul 23 13:40:31.136313 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.135989    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f460d16d-e05e-45bb-b8cb-71fd972809f5-metrics-certs\") pod \"network-metrics-daemon-74ntz\" (UID: \"f460d16d-e05e-45bb-b8cb-71fd972809f5\") " pod="openshift-multus/network-metrics-daemon-74ntz"
Jul 23 13:40:31.136313 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.136003    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ef85df48-0dd5-4e01-93ef-724734054808-sys-fs\") pod \"aws-ebs-csi-driver-node-m5n45\" (UID: \"ef85df48-0dd5-4e01-93ef-724734054808\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5n45"
Jul 23 13:40:31.136313 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.136035    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6e3c0848-ce0b-43f7-83a0-4bce9475d1a3-host-var-lib-cni-multus\") pod \"multus-wk2bh\" (UID: \"6e3c0848-ce0b-43f7-83a0-4bce9475d1a3\") " pod="openshift-multus/multus-wk2bh"
Jul 23 13:40:31.136313 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.136072    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d532106c-d9f6-4e10-aa47-30c8674703a3-host\") pod \"tuned-4rr68\" (UID: \"d532106c-d9f6-4e10-aa47-30c8674703a3\") " pod="openshift-cluster-node-tuning-operator/tuned-4rr68"
Jul 23 13:40:31.136313 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.136069    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6e3c0848-ce0b-43f7-83a0-4bce9475d1a3-hostroot\") pod \"multus-wk2bh\" (UID: \"6e3c0848-ce0b-43f7-83a0-4bce9475d1a3\") " pod="openshift-multus/multus-wk2bh"
Jul 23 13:40:31.136313 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.136082    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6e3c0848-ce0b-43f7-83a0-4bce9475d1a3-host-run-multus-certs\") pod \"multus-wk2bh\" (UID: \"6e3c0848-ce0b-43f7-83a0-4bce9475d1a3\") " pod="openshift-multus/multus-wk2bh"
Jul 23 13:40:31.136313 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.136107    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d532106c-d9f6-4e10-aa47-30c8674703a3-etc-systemd\") pod \"tuned-4rr68\" (UID: \"d532106c-d9f6-4e10-aa47-30c8674703a3\") " pod="openshift-cluster-node-tuning-operator/tuned-4rr68"
Jul 23 13:40:31.136313 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.136113    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6e3c0848-ce0b-43f7-83a0-4bce9475d1a3-hostroot\") pod \"multus-wk2bh\" (UID: \"6e3c0848-ce0b-43f7-83a0-4bce9475d1a3\") " pod="openshift-multus/multus-wk2bh"
Jul 23 13:40:31.136313 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.136136    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6e3c0848-ce0b-43f7-83a0-4bce9475d1a3-multus-socket-dir-parent\") pod \"multus-wk2bh\" (UID: \"6e3c0848-ce0b-43f7-83a0-4bce9475d1a3\") " pod="openshift-multus/multus-wk2bh"
Jul 23 13:40:31.136313 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.136153    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6e3c0848-ce0b-43f7-83a0-4bce9475d1a3-host-var-lib-cni-multus\") pod \"multus-wk2bh\" (UID: \"6e3c0848-ce0b-43f7-83a0-4bce9475d1a3\") " pod="openshift-multus/multus-wk2bh"
Jul 23 13:40:31.136313 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.136163    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6e3c0848-ce0b-43f7-83a0-4bce9475d1a3-multus-daemon-config\") pod \"multus-wk2bh\" (UID: \"6e3c0848-ce0b-43f7-83a0-4bce9475d1a3\") " pod="openshift-multus/multus-wk2bh"
Jul 23 13:40:31.137044 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:31.136190    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 13:40:31.137044 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.136199    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d532106c-d9f6-4e10-aa47-30c8674703a3-etc-systemd\") pod \"tuned-4rr68\" (UID: \"d532106c-d9f6-4e10-aa47-30c8674703a3\") " pod="openshift-cluster-node-tuning-operator/tuned-4rr68"
Jul 23 13:40:31.137044 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.136233    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d532106c-d9f6-4e10-aa47-30c8674703a3-etc-sysconfig\") pod \"tuned-4rr68\" (UID: \"d532106c-d9f6-4e10-aa47-30c8674703a3\") " pod="openshift-cluster-node-tuning-operator/tuned-4rr68"
Jul 23 13:40:31.137044 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.136242    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/382c782e-058b-4863-bd13-2e88a5f465bf-tmp-dir\") pod \"node-resolver-h5h9z\" (UID: \"382c782e-058b-4863-bd13-2e88a5f465bf\") " pod="openshift-dns/node-resolver-h5h9z"
Jul 23 13:40:31.137044 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.136191    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d532106c-d9f6-4e10-aa47-30c8674703a3-etc-sysconfig\") pod \"tuned-4rr68\" (UID: \"d532106c-d9f6-4e10-aa47-30c8674703a3\") " pod="openshift-cluster-node-tuning-operator/tuned-4rr68"
Jul 23 13:40:31.137044 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:31.136258    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f460d16d-e05e-45bb-b8cb-71fd972809f5-metrics-certs podName:f460d16d-e05e-45bb-b8cb-71fd972809f5 nodeName:}" failed. No retries permitted until 2026-07-23 13:40:31.63623947 +0000 UTC m=+3.075740372 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f460d16d-e05e-45bb-b8cb-71fd972809f5-metrics-certs") pod "network-metrics-daemon-74ntz" (UID: "f460d16d-e05e-45bb-b8cb-71fd972809f5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 13:40:31.137044 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.136249    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6e3c0848-ce0b-43f7-83a0-4bce9475d1a3-multus-socket-dir-parent\") pod \"multus-wk2bh\" (UID: \"6e3c0848-ce0b-43f7-83a0-4bce9475d1a3\") " pod="openshift-multus/multus-wk2bh"
Jul 23 13:40:31.137044 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.136289    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d532106c-d9f6-4e10-aa47-30c8674703a3-etc-sysctl-conf\") pod \"tuned-4rr68\" (UID: \"d532106c-d9f6-4e10-aa47-30c8674703a3\") " pod="openshift-cluster-node-tuning-operator/tuned-4rr68"
Jul 23 13:40:31.137044 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.136296    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0ee38828-a288-4015-b238-f1235220578b-iptables-alerter-script\") pod \"iptables-alerter-h6fvc\" (UID: \"0ee38828-a288-4015-b238-f1235220578b\") " pod="openshift-network-operator/iptables-alerter-h6fvc"
Jul 23 13:40:31.137044 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.136316    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d532106c-d9f6-4e10-aa47-30c8674703a3-lib-modules\") pod \"tuned-4rr68\" (UID: \"d532106c-d9f6-4e10-aa47-30c8674703a3\") " pod="openshift-cluster-node-tuning-operator/tuned-4rr68"
Jul 23 13:40:31.137044 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.136339    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0ee38828-a288-4015-b238-f1235220578b-host-slash\") pod \"iptables-alerter-h6fvc\" (UID: \"0ee38828-a288-4015-b238-f1235220578b\") " pod="openshift-network-operator/iptables-alerter-h6fvc"
Jul 23 13:40:31.137044 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.136361    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6e3c0848-ce0b-43f7-83a0-4bce9475d1a3-host-run-netns\") pod \"multus-wk2bh\" (UID: \"6e3c0848-ce0b-43f7-83a0-4bce9475d1a3\") " pod="openshift-multus/multus-wk2bh"
Jul 23 13:40:31.137044 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.136387    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6e3c0848-ce0b-43f7-83a0-4bce9475d1a3-multus-cni-dir\") pod \"multus-wk2bh\" (UID: \"6e3c0848-ce0b-43f7-83a0-4bce9475d1a3\") " pod="openshift-multus/multus-wk2bh"
Jul 23 13:40:31.137044 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.136403    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0ee38828-a288-4015-b238-f1235220578b-host-slash\") pod \"iptables-alerter-h6fvc\" (UID: \"0ee38828-a288-4015-b238-f1235220578b\") " pod="openshift-network-operator/iptables-alerter-h6fvc"
Jul 23 13:40:31.137856 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.136410    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d532106c-d9f6-4e10-aa47-30c8674703a3-etc-tuned\") pod \"tuned-4rr68\" (UID: \"d532106c-d9f6-4e10-aa47-30c8674703a3\") " pod="openshift-cluster-node-tuning-operator/tuned-4rr68"
Jul 23 13:40:31.137856 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.136426    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d532106c-d9f6-4e10-aa47-30c8674703a3-etc-sysctl-conf\") pod \"tuned-4rr68\" (UID: \"d532106c-d9f6-4e10-aa47-30c8674703a3\") " pod="openshift-cluster-node-tuning-operator/tuned-4rr68"
Jul 23 13:40:31.137856 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.136440    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ef85df48-0dd5-4e01-93ef-724734054808-socket-dir\") pod \"aws-ebs-csi-driver-node-m5n45\" (UID: \"ef85df48-0dd5-4e01-93ef-724734054808\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5n45"
Jul 23 13:40:31.137856 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.136443    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6e3c0848-ce0b-43f7-83a0-4bce9475d1a3-host-run-netns\") pod \"multus-wk2bh\" (UID: \"6e3c0848-ce0b-43f7-83a0-4bce9475d1a3\") " pod="openshift-multus/multus-wk2bh"
Jul 23 13:40:31.137856 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.136428    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d532106c-d9f6-4e10-aa47-30c8674703a3-lib-modules\") pod \"tuned-4rr68\" (UID: \"d532106c-d9f6-4e10-aa47-30c8674703a3\") " pod="openshift-cluster-node-tuning-operator/tuned-4rr68"
Jul 23 13:40:31.137856 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.136479    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ef85df48-0dd5-4e01-93ef-724734054808-device-dir\") pod \"aws-ebs-csi-driver-node-m5n45\" (UID: \"ef85df48-0dd5-4e01-93ef-724734054808\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5n45"
Jul 23 13:40:31.137856 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.136498    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6e3c0848-ce0b-43f7-83a0-4bce9475d1a3-multus-cni-dir\") pod \"multus-wk2bh\" (UID: \"6e3c0848-ce0b-43f7-83a0-4bce9475d1a3\") " pod="openshift-multus/multus-wk2bh"
Jul 23 13:40:31.137856 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.136507    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6e3c0848-ce0b-43f7-83a0-4bce9475d1a3-cni-binary-copy\") pod \"multus-wk2bh\" (UID: \"6e3c0848-ce0b-43f7-83a0-4bce9475d1a3\") " pod="openshift-multus/multus-wk2bh"
Jul 23 13:40:31.137856 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.136534    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76zrb\" (UniqueName: \"kubernetes.io/projected/d846e487-3440-4729-89d1-57211afe3328-kube-api-access-76zrb\") pod \"node-ca-5gxsc\" (UID: \"d846e487-3440-4729-89d1-57211afe3328\") " pod="openshift-image-registry/node-ca-5gxsc"
Jul 23 13:40:31.137856 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.136545    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ef85df48-0dd5-4e01-93ef-724734054808-device-dir\") pod \"aws-ebs-csi-driver-node-m5n45\" (UID: \"ef85df48-0dd5-4e01-93ef-724734054808\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5n45"
Jul 23 13:40:31.137856 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.136553    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ef85df48-0dd5-4e01-93ef-724734054808-socket-dir\") pod \"aws-ebs-csi-driver-node-m5n45\" (UID: \"ef85df48-0dd5-4e01-93ef-724734054808\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5n45"
Jul 23 13:40:31.137856 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.136559    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ef85df48-0dd5-4e01-93ef-724734054808-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m5n45\" (UID: \"ef85df48-0dd5-4e01-93ef-724734054808\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5n45"
Jul 23 13:40:31.137856 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.136596    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npj4b\" (UniqueName: \"kubernetes.io/projected/382c782e-058b-4863-bd13-2e88a5f465bf-kube-api-access-npj4b\") pod \"node-resolver-h5h9z\" (UID: \"382c782e-058b-4863-bd13-2e88a5f465bf\") " pod="openshift-dns/node-resolver-h5h9z"
Jul 23 13:40:31.137856 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.136604    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ef85df48-0dd5-4e01-93ef-724734054808-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m5n45\" (UID: \"ef85df48-0dd5-4e01-93ef-724734054808\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5n45"
Jul 23 13:40:31.138540 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.136625    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d532106c-d9f6-4e10-aa47-30c8674703a3-etc-modprobe-d\") pod \"tuned-4rr68\" (UID: \"d532106c-d9f6-4e10-aa47-30c8674703a3\") " pod="openshift-cluster-node-tuning-operator/tuned-4rr68"
Jul 23 13:40:31.138540 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.136656    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d532106c-d9f6-4e10-aa47-30c8674703a3-etc-kubernetes\") pod \"tuned-4rr68\" (UID: \"d532106c-d9f6-4e10-aa47-30c8674703a3\") " pod="openshift-cluster-node-tuning-operator/tuned-4rr68"
Jul 23 13:40:31.138540 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.136683    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ef85df48-0dd5-4e01-93ef-724734054808-etc-selinux\") pod \"aws-ebs-csi-driver-node-m5n45\" (UID: \"ef85df48-0dd5-4e01-93ef-724734054808\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5n45"
Jul 23 13:40:31.138540 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.136713    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2fsq\" (UniqueName: \"kubernetes.io/projected/6e3c0848-ce0b-43f7-83a0-4bce9475d1a3-kube-api-access-x2fsq\") pod \"multus-wk2bh\" (UID: \"6e3c0848-ce0b-43f7-83a0-4bce9475d1a3\") " pod="openshift-multus/multus-wk2bh"
Jul 23 13:40:31.138540 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.136734    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6e3c0848-ce0b-43f7-83a0-4bce9475d1a3-multus-daemon-config\") pod \"multus-wk2bh\" (UID: \"6e3c0848-ce0b-43f7-83a0-4bce9475d1a3\") " pod="openshift-multus/multus-wk2bh"
Jul 23 13:40:31.138540 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.136739    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d846e487-3440-4729-89d1-57211afe3328-serviceca\") pod \"node-ca-5gxsc\" (UID: \"d846e487-3440-4729-89d1-57211afe3328\") " pod="openshift-image-registry/node-ca-5gxsc"
Jul 23 13:40:31.138540 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.136783    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d532106c-d9f6-4e10-aa47-30c8674703a3-sys\") pod \"tuned-4rr68\" (UID: \"d532106c-d9f6-4e10-aa47-30c8674703a3\") " pod="openshift-cluster-node-tuning-operator/tuned-4rr68"
Jul 23 13:40:31.138540 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.136811    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4676\" (UniqueName: \"kubernetes.io/projected/0ee38828-a288-4015-b238-f1235220578b-kube-api-access-q4676\") pod \"iptables-alerter-h6fvc\" (UID: \"0ee38828-a288-4015-b238-f1235220578b\") " pod="openshift-network-operator/iptables-alerter-h6fvc"
Jul 23 13:40:31.138540 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.136856    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6e3c0848-ce0b-43f7-83a0-4bce9475d1a3-host-run-k8s-cni-cncf-io\") pod \"multus-wk2bh\" (UID: \"6e3c0848-ce0b-43f7-83a0-4bce9475d1a3\") " pod="openshift-multus/multus-wk2bh"
Jul 23 13:40:31.138540 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.136886    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e3c0848-ce0b-43f7-83a0-4bce9475d1a3-host-var-lib-kubelet\") pod \"multus-wk2bh\" (UID: \"6e3c0848-ce0b-43f7-83a0-4bce9475d1a3\") " pod="openshift-multus/multus-wk2bh"
Jul 23 13:40:31.138540 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.136919    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/382c782e-058b-4863-bd13-2e88a5f465bf-hosts-file\") pod \"node-resolver-h5h9z\" (UID: \"382c782e-058b-4863-bd13-2e88a5f465bf\") " pod="openshift-dns/node-resolver-h5h9z"
Jul 23 13:40:31.138540 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.136946    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jljs\" (UniqueName: \"kubernetes.io/projected/0f9ef7a1-2fa9-46bc-acc8-83a25209e294-kube-api-access-7jljs\") pod \"network-check-target-rvjth\" (UID: \"0f9ef7a1-2fa9-46bc-acc8-83a25209e294\") " pod="openshift-network-diagnostics/network-check-target-rvjth"
Jul 23 13:40:31.138540 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.136975    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d532106c-d9f6-4e10-aa47-30c8674703a3-var-lib-kubelet\") pod \"tuned-4rr68\" (UID: \"d532106c-d9f6-4e10-aa47-30c8674703a3\") " pod="openshift-cluster-node-tuning-operator/tuned-4rr68"
Jul 23 13:40:31.138540 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.136994    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6e3c0848-ce0b-43f7-83a0-4bce9475d1a3-cni-binary-copy\") pod \"multus-wk2bh\" (UID: \"6e3c0848-ce0b-43f7-83a0-4bce9475d1a3\") " pod="openshift-multus/multus-wk2bh"
Jul 23 13:40:31.138540 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.137001    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhhzs\" (UniqueName: \"kubernetes.io/projected/d532106c-d9f6-4e10-aa47-30c8674703a3-kube-api-access-dhhzs\") pod \"tuned-4rr68\" (UID: \"d532106c-d9f6-4e10-aa47-30c8674703a3\") " pod="openshift-cluster-node-tuning-operator/tuned-4rr68"
Jul 23 13:40:31.139285 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.137034    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d532106c-d9f6-4e10-aa47-30c8674703a3-run\") pod \"tuned-4rr68\" (UID: \"d532106c-d9f6-4e10-aa47-30c8674703a3\") " pod="openshift-cluster-node-tuning-operator/tuned-4rr68"
Jul 23 13:40:31.139285 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.137085    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ef85df48-0dd5-4e01-93ef-724734054808-registration-dir\") pod \"aws-ebs-csi-driver-node-m5n45\" (UID: \"ef85df48-0dd5-4e01-93ef-724734054808\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5n45"
Jul 23 13:40:31.139285 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.137112    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgj2d\" (UniqueName: \"kubernetes.io/projected/f460d16d-e05e-45bb-b8cb-71fd972809f5-kube-api-access-mgj2d\") pod \"network-metrics-daemon-74ntz\" (UID: \"f460d16d-e05e-45bb-b8cb-71fd972809f5\") " pod="openshift-multus/network-metrics-daemon-74ntz"
Jul 23 13:40:31.139285 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.137129    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d532106c-d9f6-4e10-aa47-30c8674703a3-run\") pod \"tuned-4rr68\" (UID: \"d532106c-d9f6-4e10-aa47-30c8674703a3\") " pod="openshift-cluster-node-tuning-operator/tuned-4rr68"
Jul 23 13:40:31.139285 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.137145    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6e3c0848-ce0b-43f7-83a0-4bce9475d1a3-host-var-lib-cni-bin\") pod \"multus-wk2bh\" (UID: \"6e3c0848-ce0b-43f7-83a0-4bce9475d1a3\") " pod="openshift-multus/multus-wk2bh"
Jul 23 13:40:31.139285 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.137173    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d846e487-3440-4729-89d1-57211afe3328-serviceca\") pod \"node-ca-5gxsc\" (UID: \"d846e487-3440-4729-89d1-57211afe3328\") " pod="openshift-image-registry/node-ca-5gxsc"
Jul 23 13:40:31.139285 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.137187    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e3c0848-ce0b-43f7-83a0-4bce9475d1a3-etc-kubernetes\") pod \"multus-wk2bh\" (UID: \"6e3c0848-ce0b-43f7-83a0-4bce9475d1a3\") " pod="openshift-multus/multus-wk2bh"
Jul 23 13:40:31.139285 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.137227    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ef85df48-0dd5-4e01-93ef-724734054808-etc-selinux\") pod \"aws-ebs-csi-driver-node-m5n45\" (UID: \"ef85df48-0dd5-4e01-93ef-724734054808\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5n45"
Jul 23 13:40:31.139285 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.137242    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6e3c0848-ce0b-43f7-83a0-4bce9475d1a3-system-cni-dir\") pod \"multus-wk2bh\" (UID: \"6e3c0848-ce0b-43f7-83a0-4bce9475d1a3\") " pod="openshift-multus/multus-wk2bh"
Jul 23 13:40:31.139285 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.137258    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6e3c0848-ce0b-43f7-83a0-4bce9475d1a3-host-var-lib-cni-bin\") pod \"multus-wk2bh\" (UID: \"6e3c0848-ce0b-43f7-83a0-4bce9475d1a3\") " pod="openshift-multus/multus-wk2bh"
Jul 23 13:40:31.139285 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.137272    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6e3c0848-ce0b-43f7-83a0-4bce9475d1a3-cnibin\") pod \"multus-wk2bh\" (UID: \"6e3c0848-ce0b-43f7-83a0-4bce9475d1a3\") " pod="openshift-multus/multus-wk2bh"
Jul 23 13:40:31.139285 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.137285    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d532106c-d9f6-4e10-aa47-30c8674703a3-etc-kubernetes\") pod \"tuned-4rr68\" (UID: \"d532106c-d9f6-4e10-aa47-30c8674703a3\") " pod="openshift-cluster-node-tuning-operator/tuned-4rr68"
Jul 23 13:40:31.139285 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.137301    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6e3c0848-ce0b-43f7-83a0-4bce9475d1a3-multus-conf-dir\") pod \"multus-wk2bh\" (UID: \"6e3c0848-ce0b-43f7-83a0-4bce9475d1a3\") " pod="openshift-multus/multus-wk2bh"
Jul 23 13:40:31.139285 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.137308    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e3c0848-ce0b-43f7-83a0-4bce9475d1a3-etc-kubernetes\") pod \"multus-wk2bh\" (UID: \"6e3c0848-ce0b-43f7-83a0-4bce9475d1a3\") " pod="openshift-multus/multus-wk2bh"
Jul 23 13:40:31.139285 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.137332    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/382c782e-058b-4863-bd13-2e88a5f465bf-hosts-file\") pod \"node-resolver-h5h9z\" (UID: \"382c782e-058b-4863-bd13-2e88a5f465bf\") " pod="openshift-dns/node-resolver-h5h9z"
Jul 23 13:40:31.140067 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.137352    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d532106c-d9f6-4e10-aa47-30c8674703a3-sys\") pod \"tuned-4rr68\" (UID: \"d532106c-d9f6-4e10-aa47-30c8674703a3\") " pod="openshift-cluster-node-tuning-operator/tuned-4rr68"
Jul 23 13:40:31.140067 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.136885    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d532106c-d9f6-4e10-aa47-30c8674703a3-etc-modprobe-d\") pod \"tuned-4rr68\" (UID: \"d532106c-d9f6-4e10-aa47-30c8674703a3\") " pod="openshift-cluster-node-tuning-operator/tuned-4rr68"
Jul 23 13:40:31.140067 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.137399    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e3c0848-ce0b-43f7-83a0-4bce9475d1a3-host-var-lib-kubelet\") pod \"multus-wk2bh\" (UID: \"6e3c0848-ce0b-43f7-83a0-4bce9475d1a3\") " pod="openshift-multus/multus-wk2bh"
Jul 23 13:40:31.140067 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.137424    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d532106c-d9f6-4e10-aa47-30c8674703a3-var-lib-kubelet\") pod \"tuned-4rr68\" (UID: \"d532106c-d9f6-4e10-aa47-30c8674703a3\") " pod="openshift-cluster-node-tuning-operator/tuned-4rr68"
Jul 23 13:40:31.140067 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.137463    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6e3c0848-ce0b-43f7-83a0-4bce9475d1a3-multus-conf-dir\") pod \"multus-wk2bh\" (UID: \"6e3c0848-ce0b-43f7-83a0-4bce9475d1a3\") " pod="openshift-multus/multus-wk2bh"
Jul 23 13:40:31.140067 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.137508    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6e3c0848-ce0b-43f7-83a0-4bce9475d1a3-host-run-k8s-cni-cncf-io\") pod \"multus-wk2bh\" (UID: \"6e3c0848-ce0b-43f7-83a0-4bce9475d1a3\") " pod="openshift-multus/multus-wk2bh"
Jul 23 13:40:31.140067 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.137514    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6e3c0848-ce0b-43f7-83a0-4bce9475d1a3-cnibin\") pod \"multus-wk2bh\" (UID: \"6e3c0848-ce0b-43f7-83a0-4bce9475d1a3\") " pod="openshift-multus/multus-wk2bh"
Jul 23 13:40:31.140067 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.137468    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ef85df48-0dd5-4e01-93ef-724734054808-registration-dir\") pod \"aws-ebs-csi-driver-node-m5n45\" (UID: \"ef85df48-0dd5-4e01-93ef-724734054808\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5n45"
Jul 23 13:40:31.140067 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.137554    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6e3c0848-ce0b-43f7-83a0-4bce9475d1a3-system-cni-dir\") pod \"multus-wk2bh\" (UID: \"6e3c0848-ce0b-43f7-83a0-4bce9475d1a3\") " pod="openshift-multus/multus-wk2bh"
Jul 23 13:40:31.140067 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.138353    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d532106c-d9f6-4e10-aa47-30c8674703a3-tmp\") pod \"tuned-4rr68\" (UID: \"d532106c-d9f6-4e10-aa47-30c8674703a3\") " pod="openshift-cluster-node-tuning-operator/tuned-4rr68"
Jul 23 13:40:31.140067 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.138618    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d532106c-d9f6-4e10-aa47-30c8674703a3-etc-tuned\") pod \"tuned-4rr68\" (UID: \"d532106c-d9f6-4e10-aa47-30c8674703a3\") " pod="openshift-cluster-node-tuning-operator/tuned-4rr68"
Jul 23 13:40:31.147843 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.147785    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rw9h\" (UniqueName: \"kubernetes.io/projected/ef85df48-0dd5-4e01-93ef-724734054808-kube-api-access-5rw9h\") pod \"aws-ebs-csi-driver-node-m5n45\" (UID: \"ef85df48-0dd5-4e01-93ef-724734054808\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5n45"
Jul 23 13:40:31.149271 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:31.149240    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 13:40:31.149271 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:31.149266    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 13:40:31.149451 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:31.149278    2573 projected.go:196] Error preparing data for projected volume kube-api-access-7jljs for pod openshift-network-diagnostics/network-check-target-rvjth: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 13:40:31.149451 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:31.149344    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0f9ef7a1-2fa9-46bc-acc8-83a25209e294-kube-api-access-7jljs podName:0f9ef7a1-2fa9-46bc-acc8-83a25209e294 nodeName:}" failed. No retries permitted until 2026-07-23 13:40:31.649326317 +0000 UTC m=+3.088827228 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-7jljs" (UniqueName: "kubernetes.io/projected/0f9ef7a1-2fa9-46bc-acc8-83a25209e294-kube-api-access-7jljs") pod "network-check-target-rvjth" (UID: "0f9ef7a1-2fa9-46bc-acc8-83a25209e294") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 13:40:31.151809 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.151781    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4676\" (UniqueName: \"kubernetes.io/projected/0ee38828-a288-4015-b238-f1235220578b-kube-api-access-q4676\") pod \"iptables-alerter-h6fvc\" (UID: \"0ee38828-a288-4015-b238-f1235220578b\") " pod="openshift-network-operator/iptables-alerter-h6fvc"
Jul 23 13:40:31.152094 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.152072    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2fsq\" (UniqueName: \"kubernetes.io/projected/6e3c0848-ce0b-43f7-83a0-4bce9475d1a3-kube-api-access-x2fsq\") pod \"multus-wk2bh\" (UID: \"6e3c0848-ce0b-43f7-83a0-4bce9475d1a3\") " pod="openshift-multus/multus-wk2bh"
Jul 23 13:40:31.152585 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.152563    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhhzs\" (UniqueName: \"kubernetes.io/projected/d532106c-d9f6-4e10-aa47-30c8674703a3-kube-api-access-dhhzs\") pod \"tuned-4rr68\" (UID: \"d532106c-d9f6-4e10-aa47-30c8674703a3\") " pod="openshift-cluster-node-tuning-operator/tuned-4rr68"
Jul 23 13:40:31.153372 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.153319    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-76zrb\" (UniqueName: \"kubernetes.io/projected/d846e487-3440-4729-89d1-57211afe3328-kube-api-access-76zrb\") pod \"node-ca-5gxsc\" (UID: \"d846e487-3440-4729-89d1-57211afe3328\") " pod="openshift-image-registry/node-ca-5gxsc"
Jul 23 13:40:31.153726 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.153702    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-npj4b\" (UniqueName: \"kubernetes.io/projected/382c782e-058b-4863-bd13-2e88a5f465bf-kube-api-access-npj4b\") pod \"node-resolver-h5h9z\" (UID: \"382c782e-058b-4863-bd13-2e88a5f465bf\") " pod="openshift-dns/node-resolver-h5h9z"
Jul 23 13:40:31.153824 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.153728    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgj2d\" (UniqueName: \"kubernetes.io/projected/f460d16d-e05e-45bb-b8cb-71fd972809f5-kube-api-access-mgj2d\") pod \"network-metrics-daemon-74ntz\" (UID: \"f460d16d-e05e-45bb-b8cb-71fd972809f5\") " pod="openshift-multus/network-metrics-daemon-74ntz"
Jul 23 13:40:31.223278 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.223244    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-65xv7"
Jul 23 13:40:31.230843 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.230816    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bpbpp"
Jul 23 13:40:31.235474 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:31.235446    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode492bdc2_dfd1_4b82_a8fc_37f82765cdb4.slice/crio-bcddec6278e4386f74a88581a3c69ec2b88bd39fc3f9bfae9e3c322963d3ffb7 WatchSource:0}: Error finding container bcddec6278e4386f74a88581a3c69ec2b88bd39fc3f9bfae9e3c322963d3ffb7: Status 404 returned error can't find the container with id bcddec6278e4386f74a88581a3c69ec2b88bd39fc3f9bfae9e3c322963d3ffb7
Jul 23 13:40:31.241464 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:31.241392    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98e8320f_eba6_438b_aad3_1905aee071d8.slice/crio-0dfa952168a30c7d7669fb56659d79c8ae53621a59c9208cf52a3f29df7ded89 WatchSource:0}: Error finding container 0dfa952168a30c7d7669fb56659d79c8ae53621a59c9208cf52a3f29df7ded89: Status 404 returned error can't find the container with id 0dfa952168a30c7d7669fb56659d79c8ae53621a59c9208cf52a3f29df7ded89
Jul 23 13:40:31.243249 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.243233    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2p6xl"
Jul 23 13:40:31.251520 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.251501    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-h5h9z"
Jul 23 13:40:31.253270 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:31.253226    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod119f8d52_ffb3_43c7_922e_e0bc75740bd2.slice/crio-ef90a3edba01b3b6c54727e184697bbf0efd294a56ae2c3e9a702e32cfc5a5f1 WatchSource:0}: Error finding container ef90a3edba01b3b6c54727e184697bbf0efd294a56ae2c3e9a702e32cfc5a5f1: Status 404 returned error can't find the container with id ef90a3edba01b3b6c54727e184697bbf0efd294a56ae2c3e9a702e32cfc5a5f1
Jul 23 13:40:31.258827 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.258802    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5gxsc"
Jul 23 13:40:31.262508 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:31.262482    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod382c782e_058b_4863_bd13_2e88a5f465bf.slice/crio-266c5e245c89577c2897b37f90375f4ae2591458e61b9871037872ba9b7cccee WatchSource:0}: Error finding container 266c5e245c89577c2897b37f90375f4ae2591458e61b9871037872ba9b7cccee: Status 404 returned error can't find the container with id 266c5e245c89577c2897b37f90375f4ae2591458e61b9871037872ba9b7cccee
Jul 23 13:40:31.267158 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.267138    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4rr68"
Jul 23 13:40:31.268760 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:31.268733    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd846e487_3440_4729_89d1_57211afe3328.slice/crio-9cab06902911bbda2bfd193df26a2da1297322259aac21d7c522a115168ab083 WatchSource:0}: Error finding container 9cab06902911bbda2bfd193df26a2da1297322259aac21d7c522a115168ab083: Status 404 returned error can't find the container with id 9cab06902911bbda2bfd193df26a2da1297322259aac21d7c522a115168ab083
Jul 23 13:40:31.275544 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:31.275522    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd532106c_d9f6_4e10_aa47_30c8674703a3.slice/crio-03d2c4aa814194b157ae3703253bcaa9e4eb60f7884c412cd4f46838ebb9f14f WatchSource:0}: Error finding container 03d2c4aa814194b157ae3703253bcaa9e4eb60f7884c412cd4f46838ebb9f14f: Status 404 returned error can't find the container with id 03d2c4aa814194b157ae3703253bcaa9e4eb60f7884c412cd4f46838ebb9f14f
Jul 23 13:40:31.276824 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.276788    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-h6fvc"
Jul 23 13:40:31.286257 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.286237    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wk2bh"
Jul 23 13:40:31.287830 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:31.287808    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ee38828_a288_4015_b238_f1235220578b.slice/crio-6712f75e69b71157f31cb9e40da3a82c3ad55fa04f9dcfa95bcf31d2ba9d35b1 WatchSource:0}: Error finding container 6712f75e69b71157f31cb9e40da3a82c3ad55fa04f9dcfa95bcf31d2ba9d35b1: Status 404 returned error can't find the container with id 6712f75e69b71157f31cb9e40da3a82c3ad55fa04f9dcfa95bcf31d2ba9d35b1
Jul 23 13:40:31.293602 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.293580    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5n45"
Jul 23 13:40:31.296921 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:31.296894    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e3c0848_ce0b_43f7_83a0_4bce9475d1a3.slice/crio-9e904488df87d2a8b6deb6ba6bb05de6cdbf049bce8376623a809d23bf976dac WatchSource:0}: Error finding container 9e904488df87d2a8b6deb6ba6bb05de6cdbf049bce8376623a809d23bf976dac: Status 404 returned error can't find the container with id 9e904488df87d2a8b6deb6ba6bb05de6cdbf049bce8376623a809d23bf976dac
Jul 23 13:40:31.303305 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:40:31.303283    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef85df48_0dd5_4e01_93ef_724734054808.slice/crio-cf893a24b9f89090d7b9c92eef4eab16da8e06378ad6ebc15ac63f9b8057b807 WatchSource:0}: Error finding container cf893a24b9f89090d7b9c92eef4eab16da8e06378ad6ebc15ac63f9b8057b807: Status 404 returned error can't find the container with id cf893a24b9f89090d7b9c92eef4eab16da8e06378ad6ebc15ac63f9b8057b807
Jul 23 13:40:31.540871 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.540778    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ebc1dbc1-a42e-4498-8678-0f6a33a11f5f-original-pull-secret\") pod \"global-pull-secret-syncer-wx249\" (UID: \"ebc1dbc1-a42e-4498-8678-0f6a33a11f5f\") " pod="kube-system/global-pull-secret-syncer-wx249"
Jul 23 13:40:31.541043 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:31.540919    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 13:40:31.541043 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:31.540984    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebc1dbc1-a42e-4498-8678-0f6a33a11f5f-original-pull-secret podName:ebc1dbc1-a42e-4498-8678-0f6a33a11f5f nodeName:}" failed. No retries permitted until 2026-07-23 13:40:32.540965516 +0000 UTC m=+3.980466441 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ebc1dbc1-a42e-4498-8678-0f6a33a11f5f-original-pull-secret") pod "global-pull-secret-syncer-wx249" (UID: "ebc1dbc1-a42e-4498-8678-0f6a33a11f5f") : object "kube-system"/"original-pull-secret" not registered
Jul 23 13:40:31.641425 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.641389    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f460d16d-e05e-45bb-b8cb-71fd972809f5-metrics-certs\") pod \"network-metrics-daemon-74ntz\" (UID: \"f460d16d-e05e-45bb-b8cb-71fd972809f5\") " pod="openshift-multus/network-metrics-daemon-74ntz"
Jul 23 13:40:31.641592 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:31.641534    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 13:40:31.641711 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:31.641600    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f460d16d-e05e-45bb-b8cb-71fd972809f5-metrics-certs podName:f460d16d-e05e-45bb-b8cb-71fd972809f5 nodeName:}" failed. No retries permitted until 2026-07-23 13:40:32.641580329 +0000 UTC m=+4.081081227 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f460d16d-e05e-45bb-b8cb-71fd972809f5-metrics-certs") pod "network-metrics-daemon-74ntz" (UID: "f460d16d-e05e-45bb-b8cb-71fd972809f5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 13:40:31.742076 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.742017    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jljs\" (UniqueName: \"kubernetes.io/projected/0f9ef7a1-2fa9-46bc-acc8-83a25209e294-kube-api-access-7jljs\") pod \"network-check-target-rvjth\" (UID: \"0f9ef7a1-2fa9-46bc-acc8-83a25209e294\") " pod="openshift-network-diagnostics/network-check-target-rvjth"
Jul 23 13:40:31.742243 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:31.742204    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 13:40:31.742243 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:31.742227    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 13:40:31.742243 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:31.742245    2573 projected.go:196] Error preparing data for projected volume kube-api-access-7jljs for pod openshift-network-diagnostics/network-check-target-rvjth: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 13:40:31.742404 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:31.742314    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0f9ef7a1-2fa9-46bc-acc8-83a25209e294-kube-api-access-7jljs podName:0f9ef7a1-2fa9-46bc-acc8-83a25209e294 nodeName:}" failed. No retries permitted until 2026-07-23 13:40:32.742294322 +0000 UTC m=+4.181795221 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-7jljs" (UniqueName: "kubernetes.io/projected/0f9ef7a1-2fa9-46bc-acc8-83a25209e294-kube-api-access-7jljs") pod "network-check-target-rvjth" (UID: "0f9ef7a1-2fa9-46bc-acc8-83a25209e294") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 13:40:31.966206 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.966092    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 13:35:31 +0000 UTC" deadline="2028-03-09 18:24:29.22812571 +0000 UTC"
Jul 23 13:40:31.966206 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:31.966159    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14284h43m57.261970266s"
Jul 23 13:40:32.062405 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:32.062347    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rvjth"
Jul 23 13:40:32.062594 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:32.062485    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rvjth" podUID="0f9ef7a1-2fa9-46bc-acc8-83a25209e294"
Jul 23 13:40:32.071483 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:32.071399    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5gxsc" event={"ID":"d846e487-3440-4729-89d1-57211afe3328","Type":"ContainerStarted","Data":"9cab06902911bbda2bfd193df26a2da1297322259aac21d7c522a115168ab083"}
Jul 23 13:40:32.073647 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:32.073595    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-h5h9z" event={"ID":"382c782e-058b-4863-bd13-2e88a5f465bf","Type":"ContainerStarted","Data":"266c5e245c89577c2897b37f90375f4ae2591458e61b9871037872ba9b7cccee"}
Jul 23 13:40:32.078436 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:32.078359    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5n45" event={"ID":"ef85df48-0dd5-4e01-93ef-724734054808","Type":"ContainerStarted","Data":"cf893a24b9f89090d7b9c92eef4eab16da8e06378ad6ebc15ac63f9b8057b807"}
Jul 23 13:40:32.082003 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:32.081957    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-h6fvc" event={"ID":"0ee38828-a288-4015-b238-f1235220578b","Type":"ContainerStarted","Data":"6712f75e69b71157f31cb9e40da3a82c3ad55fa04f9dcfa95bcf31d2ba9d35b1"}
Jul 23 13:40:32.085364 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:32.085338    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4rr68" event={"ID":"d532106c-d9f6-4e10-aa47-30c8674703a3","Type":"ContainerStarted","Data":"03d2c4aa814194b157ae3703253bcaa9e4eb60f7884c412cd4f46838ebb9f14f"}
Jul 23 13:40:32.088035 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:32.087977    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2p6xl" event={"ID":"119f8d52-ffb3-43c7-922e-e0bc75740bd2","Type":"ContainerStarted","Data":"ef90a3edba01b3b6c54727e184697bbf0efd294a56ae2c3e9a702e32cfc5a5f1"}
Jul 23 13:40:32.090046 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:32.090018    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bpbpp" event={"ID":"98e8320f-eba6-438b-aad3-1905aee071d8","Type":"ContainerStarted","Data":"0dfa952168a30c7d7669fb56659d79c8ae53621a59c9208cf52a3f29df7ded89"}
Jul 23 13:40:32.091484 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:32.091425    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-65xv7" event={"ID":"e492bdc2-dfd1-4b82-a8fc-37f82765cdb4","Type":"ContainerStarted","Data":"bcddec6278e4386f74a88581a3c69ec2b88bd39fc3f9bfae9e3c322963d3ffb7"}
Jul 23 13:40:32.092540 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:32.092490    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wk2bh" event={"ID":"6e3c0848-ce0b-43f7-83a0-4bce9475d1a3","Type":"ContainerStarted","Data":"9e904488df87d2a8b6deb6ba6bb05de6cdbf049bce8376623a809d23bf976dac"}
Jul 23 13:40:32.549471 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:32.548821    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ebc1dbc1-a42e-4498-8678-0f6a33a11f5f-original-pull-secret\") pod \"global-pull-secret-syncer-wx249\" (UID: \"ebc1dbc1-a42e-4498-8678-0f6a33a11f5f\") " pod="kube-system/global-pull-secret-syncer-wx249"
Jul 23 13:40:32.549471 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:32.549059    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 13:40:32.549471 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:32.549126    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebc1dbc1-a42e-4498-8678-0f6a33a11f5f-original-pull-secret podName:ebc1dbc1-a42e-4498-8678-0f6a33a11f5f nodeName:}" failed. No retries permitted until 2026-07-23 13:40:34.549107352 +0000 UTC m=+5.988608270 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ebc1dbc1-a42e-4498-8678-0f6a33a11f5f-original-pull-secret") pod "global-pull-secret-syncer-wx249" (UID: "ebc1dbc1-a42e-4498-8678-0f6a33a11f5f") : object "kube-system"/"original-pull-secret" not registered
Jul 23 13:40:32.649884 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:32.649231    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f460d16d-e05e-45bb-b8cb-71fd972809f5-metrics-certs\") pod \"network-metrics-daemon-74ntz\" (UID: \"f460d16d-e05e-45bb-b8cb-71fd972809f5\") " pod="openshift-multus/network-metrics-daemon-74ntz"
Jul 23 13:40:32.649884 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:32.649424    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 13:40:32.649884 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:32.649489    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f460d16d-e05e-45bb-b8cb-71fd972809f5-metrics-certs podName:f460d16d-e05e-45bb-b8cb-71fd972809f5 nodeName:}" failed. No retries permitted until 2026-07-23 13:40:34.649469843 +0000 UTC m=+6.088970759 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f460d16d-e05e-45bb-b8cb-71fd972809f5-metrics-certs") pod "network-metrics-daemon-74ntz" (UID: "f460d16d-e05e-45bb-b8cb-71fd972809f5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 13:40:32.751037 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:32.750301    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jljs\" (UniqueName: \"kubernetes.io/projected/0f9ef7a1-2fa9-46bc-acc8-83a25209e294-kube-api-access-7jljs\") pod \"network-check-target-rvjth\" (UID: \"0f9ef7a1-2fa9-46bc-acc8-83a25209e294\") " pod="openshift-network-diagnostics/network-check-target-rvjth"
Jul 23 13:40:32.751037 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:32.750478    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 13:40:32.751037 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:32.750501    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 13:40:32.751037 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:32.750514    2573 projected.go:196] Error preparing data for projected volume kube-api-access-7jljs for pod openshift-network-diagnostics/network-check-target-rvjth: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 13:40:32.751037 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:32.750574    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0f9ef7a1-2fa9-46bc-acc8-83a25209e294-kube-api-access-7jljs podName:0f9ef7a1-2fa9-46bc-acc8-83a25209e294 nodeName:}" failed. No retries permitted until 2026-07-23 13:40:34.750554706 +0000 UTC m=+6.190055628 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-7jljs" (UniqueName: "kubernetes.io/projected/0f9ef7a1-2fa9-46bc-acc8-83a25209e294-kube-api-access-7jljs") pod "network-check-target-rvjth" (UID: "0f9ef7a1-2fa9-46bc-acc8-83a25209e294") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 13:40:32.966735 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:32.966671    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 13:35:31 +0000 UTC" deadline="2028-04-27 00:43:31.880850952 +0000 UTC"
Jul 23 13:40:32.966735 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:32.966710    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15443h2m58.914145665s"
Jul 23 13:40:33.064978 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:33.064336    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-74ntz"
Jul 23 13:40:33.064978 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:33.064473    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-74ntz" podUID="f460d16d-e05e-45bb-b8cb-71fd972809f5"
Jul 23 13:40:33.064978 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:33.064832    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wx249"
Jul 23 13:40:33.064978 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:33.064925    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wx249" podUID="ebc1dbc1-a42e-4498-8678-0f6a33a11f5f"
Jul 23 13:40:33.103604 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:33.103502    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-103.ec2.internal" event={"ID":"60c2af9a1aa3e406170805fd92ab7b78","Type":"ContainerStarted","Data":"ddb09d843943b3a3dcba7708a3334f6c3e1318e0bcc11f1ce3a8710a203776aa"}
Jul 23 13:40:34.062594 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:34.061859    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rvjth"
Jul 23 13:40:34.062594 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:34.062235    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rvjth" podUID="0f9ef7a1-2fa9-46bc-acc8-83a25209e294"
Jul 23 13:40:34.573845 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:34.573277    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ebc1dbc1-a42e-4498-8678-0f6a33a11f5f-original-pull-secret\") pod \"global-pull-secret-syncer-wx249\" (UID: \"ebc1dbc1-a42e-4498-8678-0f6a33a11f5f\") " pod="kube-system/global-pull-secret-syncer-wx249"
Jul 23 13:40:34.573845 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:34.573438    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 13:40:34.573845 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:34.573503    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebc1dbc1-a42e-4498-8678-0f6a33a11f5f-original-pull-secret podName:ebc1dbc1-a42e-4498-8678-0f6a33a11f5f nodeName:}" failed. No retries permitted until 2026-07-23 13:40:38.573482016 +0000 UTC m=+10.012982914 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ebc1dbc1-a42e-4498-8678-0f6a33a11f5f-original-pull-secret") pod "global-pull-secret-syncer-wx249" (UID: "ebc1dbc1-a42e-4498-8678-0f6a33a11f5f") : object "kube-system"/"original-pull-secret" not registered
Jul 23 13:40:34.673635 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:34.673599    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f460d16d-e05e-45bb-b8cb-71fd972809f5-metrics-certs\") pod \"network-metrics-daemon-74ntz\" (UID: \"f460d16d-e05e-45bb-b8cb-71fd972809f5\") " pod="openshift-multus/network-metrics-daemon-74ntz"
Jul 23 13:40:34.673777 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:34.673748    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 13:40:34.674247 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:34.673863    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f460d16d-e05e-45bb-b8cb-71fd972809f5-metrics-certs podName:f460d16d-e05e-45bb-b8cb-71fd972809f5 nodeName:}" failed. No retries permitted until 2026-07-23 13:40:38.673816339 +0000 UTC m=+10.113317250 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f460d16d-e05e-45bb-b8cb-71fd972809f5-metrics-certs") pod "network-metrics-daemon-74ntz" (UID: "f460d16d-e05e-45bb-b8cb-71fd972809f5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 13:40:34.775189 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:34.775151    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jljs\" (UniqueName: \"kubernetes.io/projected/0f9ef7a1-2fa9-46bc-acc8-83a25209e294-kube-api-access-7jljs\") pod \"network-check-target-rvjth\" (UID: \"0f9ef7a1-2fa9-46bc-acc8-83a25209e294\") " pod="openshift-network-diagnostics/network-check-target-rvjth"
Jul 23 13:40:34.775383 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:34.775356    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 13:40:34.775383 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:34.775381    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 13:40:34.775490 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:34.775394    2573 projected.go:196] Error preparing data for projected volume kube-api-access-7jljs for pod openshift-network-diagnostics/network-check-target-rvjth: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 13:40:34.775490 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:34.775457    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0f9ef7a1-2fa9-46bc-acc8-83a25209e294-kube-api-access-7jljs podName:0f9ef7a1-2fa9-46bc-acc8-83a25209e294 nodeName:}" failed. No retries permitted until 2026-07-23 13:40:38.775437973 +0000 UTC m=+10.214938871 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-7jljs" (UniqueName: "kubernetes.io/projected/0f9ef7a1-2fa9-46bc-acc8-83a25209e294-kube-api-access-7jljs") pod "network-check-target-rvjth" (UID: "0f9ef7a1-2fa9-46bc-acc8-83a25209e294") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 13:40:35.065939 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:35.065872    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wx249"
Jul 23 13:40:35.066402 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:35.065992    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wx249" podUID="ebc1dbc1-a42e-4498-8678-0f6a33a11f5f"
Jul 23 13:40:35.066402 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:35.066388    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-74ntz"
Jul 23 13:40:35.066519 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:35.066495    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-74ntz" podUID="f460d16d-e05e-45bb-b8cb-71fd972809f5"
Jul 23 13:40:36.063036 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:36.062094    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rvjth"
Jul 23 13:40:36.063036 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:36.062223    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rvjth" podUID="0f9ef7a1-2fa9-46bc-acc8-83a25209e294"
Jul 23 13:40:37.062106 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:37.061556    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-74ntz"
Jul 23 13:40:37.062106 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:37.061704    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-74ntz" podUID="f460d16d-e05e-45bb-b8cb-71fd972809f5"
Jul 23 13:40:37.062106 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:37.061565    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wx249"
Jul 23 13:40:37.062630 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:37.062168    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wx249" podUID="ebc1dbc1-a42e-4498-8678-0f6a33a11f5f"
Jul 23 13:40:38.061903 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:38.061867    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rvjth"
Jul 23 13:40:38.062111 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:38.061994    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rvjth" podUID="0f9ef7a1-2fa9-46bc-acc8-83a25209e294"
Jul 23 13:40:38.612164 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:38.612128    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ebc1dbc1-a42e-4498-8678-0f6a33a11f5f-original-pull-secret\") pod \"global-pull-secret-syncer-wx249\" (UID: \"ebc1dbc1-a42e-4498-8678-0f6a33a11f5f\") " pod="kube-system/global-pull-secret-syncer-wx249"
Jul 23 13:40:38.612608 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:38.612346    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 13:40:38.612608 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:38.612427    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebc1dbc1-a42e-4498-8678-0f6a33a11f5f-original-pull-secret podName:ebc1dbc1-a42e-4498-8678-0f6a33a11f5f nodeName:}" failed. No retries permitted until 2026-07-23 13:40:46.612405205 +0000 UTC m=+18.051906120 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ebc1dbc1-a42e-4498-8678-0f6a33a11f5f-original-pull-secret") pod "global-pull-secret-syncer-wx249" (UID: "ebc1dbc1-a42e-4498-8678-0f6a33a11f5f") : object "kube-system"/"original-pull-secret" not registered
Jul 23 13:40:38.713326 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:38.713292    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f460d16d-e05e-45bb-b8cb-71fd972809f5-metrics-certs\") pod \"network-metrics-daemon-74ntz\" (UID: \"f460d16d-e05e-45bb-b8cb-71fd972809f5\") " pod="openshift-multus/network-metrics-daemon-74ntz"
Jul 23 13:40:38.713502 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:38.713454    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 13:40:38.713569 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:38.713539    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f460d16d-e05e-45bb-b8cb-71fd972809f5-metrics-certs podName:f460d16d-e05e-45bb-b8cb-71fd972809f5 nodeName:}" failed. No retries permitted until 2026-07-23 13:40:46.713518501 +0000 UTC m=+18.153019404 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f460d16d-e05e-45bb-b8cb-71fd972809f5-metrics-certs") pod "network-metrics-daemon-74ntz" (UID: "f460d16d-e05e-45bb-b8cb-71fd972809f5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 13:40:38.814448 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:38.814405    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jljs\" (UniqueName: \"kubernetes.io/projected/0f9ef7a1-2fa9-46bc-acc8-83a25209e294-kube-api-access-7jljs\") pod \"network-check-target-rvjth\" (UID: \"0f9ef7a1-2fa9-46bc-acc8-83a25209e294\") " pod="openshift-network-diagnostics/network-check-target-rvjth"
Jul 23 13:40:38.814639 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:38.814602    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 13:40:38.814639 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:38.814632    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 13:40:38.814752 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:38.814646    2573 projected.go:196] Error preparing data for projected volume kube-api-access-7jljs for pod openshift-network-diagnostics/network-check-target-rvjth: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 13:40:38.814752 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:38.814719    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0f9ef7a1-2fa9-46bc-acc8-83a25209e294-kube-api-access-7jljs podName:0f9ef7a1-2fa9-46bc-acc8-83a25209e294 nodeName:}" failed. No retries permitted until 2026-07-23 13:40:46.814695709 +0000 UTC m=+18.254196682 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-7jljs" (UniqueName: "kubernetes.io/projected/0f9ef7a1-2fa9-46bc-acc8-83a25209e294-kube-api-access-7jljs") pod "network-check-target-rvjth" (UID: "0f9ef7a1-2fa9-46bc-acc8-83a25209e294") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 13:40:39.062882 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:39.062550    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-74ntz"
Jul 23 13:40:39.062882 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:39.062657    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wx249"
Jul 23 13:40:39.062882 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:39.062771    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-74ntz" podUID="f460d16d-e05e-45bb-b8cb-71fd972809f5"
Jul 23 13:40:39.063310 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:39.063212    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wx249" podUID="ebc1dbc1-a42e-4498-8678-0f6a33a11f5f"
Jul 23 13:40:40.061341 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:40.061299    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rvjth"
Jul 23 13:40:40.061811 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:40.061427    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rvjth" podUID="0f9ef7a1-2fa9-46bc-acc8-83a25209e294"
Jul 23 13:40:41.064958 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:41.064929    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wx249"
Jul 23 13:40:41.065421 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:41.065061    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wx249" podUID="ebc1dbc1-a42e-4498-8678-0f6a33a11f5f"
Jul 23 13:40:41.065421 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:41.065139    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-74ntz"
Jul 23 13:40:41.065421 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:41.065291    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-74ntz" podUID="f460d16d-e05e-45bb-b8cb-71fd972809f5"
Jul 23 13:40:42.062091 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:42.061999    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rvjth"
Jul 23 13:40:42.062220 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:42.062136    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rvjth" podUID="0f9ef7a1-2fa9-46bc-acc8-83a25209e294"
Jul 23 13:40:43.064714 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:43.064684    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-74ntz"
Jul 23 13:40:43.065174 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:43.064693    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wx249"
Jul 23 13:40:43.065174 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:43.064818    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-74ntz" podUID="f460d16d-e05e-45bb-b8cb-71fd972809f5"
Jul 23 13:40:43.065174 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:43.064871    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wx249" podUID="ebc1dbc1-a42e-4498-8678-0f6a33a11f5f"
Jul 23 13:40:44.061977 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:44.061947    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rvjth"
Jul 23 13:40:44.062209 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:44.062060    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rvjth" podUID="0f9ef7a1-2fa9-46bc-acc8-83a25209e294"
Jul 23 13:40:45.064902 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:45.064871    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wx249"
Jul 23 13:40:45.065364 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:45.064980    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wx249" podUID="ebc1dbc1-a42e-4498-8678-0f6a33a11f5f"
Jul 23 13:40:45.065364 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:45.065042    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-74ntz"
Jul 23 13:40:45.065364 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:45.065143    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-74ntz" podUID="f460d16d-e05e-45bb-b8cb-71fd972809f5"
Jul 23 13:40:46.061900 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:46.061866    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rvjth"
Jul 23 13:40:46.062190 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:46.061991    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rvjth" podUID="0f9ef7a1-2fa9-46bc-acc8-83a25209e294"
Jul 23 13:40:46.678812 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:46.678773    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ebc1dbc1-a42e-4498-8678-0f6a33a11f5f-original-pull-secret\") pod \"global-pull-secret-syncer-wx249\" (UID: \"ebc1dbc1-a42e-4498-8678-0f6a33a11f5f\") " pod="kube-system/global-pull-secret-syncer-wx249"
Jul 23 13:40:46.679232 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:46.678952    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 13:40:46.679232 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:46.679047    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebc1dbc1-a42e-4498-8678-0f6a33a11f5f-original-pull-secret podName:ebc1dbc1-a42e-4498-8678-0f6a33a11f5f nodeName:}" failed. No retries permitted until 2026-07-23 13:41:02.679024153 +0000 UTC m=+34.118525067 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ebc1dbc1-a42e-4498-8678-0f6a33a11f5f-original-pull-secret") pod "global-pull-secret-syncer-wx249" (UID: "ebc1dbc1-a42e-4498-8678-0f6a33a11f5f") : object "kube-system"/"original-pull-secret" not registered
Jul 23 13:40:46.780185 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:46.780149    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f460d16d-e05e-45bb-b8cb-71fd972809f5-metrics-certs\") pod \"network-metrics-daemon-74ntz\" (UID: \"f460d16d-e05e-45bb-b8cb-71fd972809f5\") " pod="openshift-multus/network-metrics-daemon-74ntz"
Jul 23 13:40:46.780366 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:46.780263    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 13:40:46.780366 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:46.780321    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f460d16d-e05e-45bb-b8cb-71fd972809f5-metrics-certs podName:f460d16d-e05e-45bb-b8cb-71fd972809f5 nodeName:}" failed. No retries permitted until 2026-07-23 13:41:02.780303126 +0000 UTC m=+34.219804027 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f460d16d-e05e-45bb-b8cb-71fd972809f5-metrics-certs") pod "network-metrics-daemon-74ntz" (UID: "f460d16d-e05e-45bb-b8cb-71fd972809f5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 13:40:46.880606 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:46.880569    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jljs\" (UniqueName: \"kubernetes.io/projected/0f9ef7a1-2fa9-46bc-acc8-83a25209e294-kube-api-access-7jljs\") pod \"network-check-target-rvjth\" (UID: \"0f9ef7a1-2fa9-46bc-acc8-83a25209e294\") " pod="openshift-network-diagnostics/network-check-target-rvjth"
Jul 23 13:40:46.880762 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:46.880701    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 13:40:46.880762 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:46.880723    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 13:40:46.880762 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:46.880734    2573 projected.go:196] Error preparing data for projected volume kube-api-access-7jljs for pod openshift-network-diagnostics/network-check-target-rvjth: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 13:40:46.880888 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:46.880792    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0f9ef7a1-2fa9-46bc-acc8-83a25209e294-kube-api-access-7jljs podName:0f9ef7a1-2fa9-46bc-acc8-83a25209e294 nodeName:}" failed. No retries permitted until 2026-07-23 13:41:02.880777609 +0000 UTC m=+34.320278509 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-7jljs" (UniqueName: "kubernetes.io/projected/0f9ef7a1-2fa9-46bc-acc8-83a25209e294-kube-api-access-7jljs") pod "network-check-target-rvjth" (UID: "0f9ef7a1-2fa9-46bc-acc8-83a25209e294") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 13:40:47.061559 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:47.061464    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wx249"
Jul 23 13:40:47.061713 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:47.061595    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wx249" podUID="ebc1dbc1-a42e-4498-8678-0f6a33a11f5f"
Jul 23 13:40:47.061713 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:47.061642    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-74ntz"
Jul 23 13:40:47.061835 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:47.061776    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-74ntz" podUID="f460d16d-e05e-45bb-b8cb-71fd972809f5"
Jul 23 13:40:48.061572 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:48.061531    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rvjth"
Jul 23 13:40:48.061975 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:48.061646    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rvjth" podUID="0f9ef7a1-2fa9-46bc-acc8-83a25209e294"
Jul 23 13:40:49.062610 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:49.062565    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-74ntz"
Jul 23 13:40:49.063069 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:49.062698    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-74ntz" podUID="f460d16d-e05e-45bb-b8cb-71fd972809f5"
Jul 23 13:40:49.063069 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:49.062759    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wx249"
Jul 23 13:40:49.063069 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:49.062878    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wx249" podUID="ebc1dbc1-a42e-4498-8678-0f6a33a11f5f"
Jul 23 13:40:50.061764 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:50.061731    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rvjth"
Jul 23 13:40:50.061947 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:50.061840    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rvjth" podUID="0f9ef7a1-2fa9-46bc-acc8-83a25209e294"
Jul 23 13:40:51.062165 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:51.062139    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-74ntz"
Jul 23 13:40:51.062502 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:51.062253    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-74ntz" podUID="f460d16d-e05e-45bb-b8cb-71fd972809f5"
Jul 23 13:40:51.062502 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:51.062302    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wx249"
Jul 23 13:40:51.062502 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:51.062390    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wx249" podUID="ebc1dbc1-a42e-4498-8678-0f6a33a11f5f"
Jul 23 13:40:52.062337 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:52.061985    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rvjth"
Jul 23 13:40:52.062726 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:52.062373    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rvjth" podUID="0f9ef7a1-2fa9-46bc-acc8-83a25209e294"
Jul 23 13:40:52.154126 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:52.154095    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5n45" event={"ID":"ef85df48-0dd5-4e01-93ef-724734054808","Type":"ContainerStarted","Data":"1615dd80c0f139072b71311a8d3aef56522dbc964500b8f850dfdd0a3a560744"}
Jul 23 13:40:52.157130 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:52.157103    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4rr68" event={"ID":"d532106c-d9f6-4e10-aa47-30c8674703a3","Type":"ContainerStarted","Data":"cfee4b3071559ff4cc71f0dbfd86a90183d11b80e38e692e98c361e14f839b19"}
Jul 23 13:40:52.158594 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:52.158569    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2p6xl" event={"ID":"119f8d52-ffb3-43c7-922e-e0bc75740bd2","Type":"ContainerStarted","Data":"d86591715bf4536d751f3ea11e819b8c045ba3cb307324e12d2a367db9fcf0a1"}
Jul 23 13:40:52.161892 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:52.161862    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bpbpp" event={"ID":"98e8320f-eba6-438b-aad3-1905aee071d8","Type":"ContainerStarted","Data":"7405c5e1a1943a6f775970d771965976fe6056d39adfdc24cb16291f15938553"}
Jul 23 13:40:52.161980 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:52.161930    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bpbpp" event={"ID":"98e8320f-eba6-438b-aad3-1905aee071d8","Type":"ContainerStarted","Data":"9a143ab2b4363279b86bfda1978b6351fc3e4eeb63b98267ac072aabe244d915"}
Jul 23 13:40:52.161980 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:52.161963    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bpbpp" event={"ID":"98e8320f-eba6-438b-aad3-1905aee071d8","Type":"ContainerStarted","Data":"328290b16bd99606edefe7d0e34f3b5162dbab0b9290fdea88685b187234076d"}
Jul 23 13:40:52.162098 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:52.161991    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bpbpp" event={"ID":"98e8320f-eba6-438b-aad3-1905aee071d8","Type":"ContainerStarted","Data":"ca3300379d9911bf1a5083d7b0bad4c4931662f2e9a59c7689151793c2e235fb"}
Jul 23 13:40:52.162098 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:52.162045    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bpbpp" event={"ID":"98e8320f-eba6-438b-aad3-1905aee071d8","Type":"ContainerStarted","Data":"507932e58fafc85a1b0f3617096d0179db8764077431a5d4d6599138a30337e6"}
Jul 23 13:40:52.162098 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:52.162079    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bpbpp" event={"ID":"98e8320f-eba6-438b-aad3-1905aee071d8","Type":"ContainerStarted","Data":"20f39f76b7789a3648b84953b04f93b40dc30700946087c9c45d7847909efded"}
Jul 23 13:40:52.163389 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:52.163367    2573 generic.go:356] "Generic (PLEG): container finished" podID="e492bdc2-dfd1-4b82-a8fc-37f82765cdb4" containerID="f4995317169b62ce44110ea37600262f64406563780bf7c73cee4390a7cbd991" exitCode=0
Jul 23 13:40:52.163469 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:52.163436    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-65xv7" event={"ID":"e492bdc2-dfd1-4b82-a8fc-37f82765cdb4","Type":"ContainerDied","Data":"f4995317169b62ce44110ea37600262f64406563780bf7c73cee4390a7cbd991"}
Jul 23 13:40:52.165104 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:52.165079    2573 generic.go:356] "Generic (PLEG): container finished" podID="f8dcf2cbeaa60b98c88ce64f87e7f4a6" containerID="4aab934ec1dcfaa1a2ca27cf6f4bff0fc1ae4ab91bbef0745a86def1517ffc32" exitCode=0
Jul 23 13:40:52.165201 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:52.165172    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-103.ec2.internal" event={"ID":"f8dcf2cbeaa60b98c88ce64f87e7f4a6","Type":"ContainerDied","Data":"4aab934ec1dcfaa1a2ca27cf6f4bff0fc1ae4ab91bbef0745a86def1517ffc32"}
Jul 23 13:40:52.166800 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:52.166777    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wk2bh" event={"ID":"6e3c0848-ce0b-43f7-83a0-4bce9475d1a3","Type":"ContainerStarted","Data":"b560bff00a81c8a99376b53de4277ca423e49879a9e2d97f04fc395c28e7591e"}
Jul 23 13:40:52.168183 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:52.168161    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5gxsc" event={"ID":"d846e487-3440-4729-89d1-57211afe3328","Type":"ContainerStarted","Data":"c8fb7269e13364655b98f5da026bc8b6c11fd97d034a40af41463c11454d3569"}
Jul 23 13:40:52.169667 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:52.169644    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-h5h9z" event={"ID":"382c782e-058b-4863-bd13-2e88a5f465bf","Type":"ContainerStarted","Data":"14a0becbfd6bbb12e1c89f111e60541fbe5c03eca6fe0ed5384b5143fcbb616c"}
Jul 23 13:40:52.181217 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:52.181152    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-4rr68" podStartSLOduration=3.55481073 podStartE2EDuration="23.181140554s" totalImagesPullingTime="19.626329824s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 13:40:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:40:52.180653715 +0000 UTC m=+23.620154637" watchObservedRunningTime="2026-07-23 13:40:52.181140554 +0000 UTC m=+23.620641472"
Jul 23 13:40:52.181597 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:52.181561    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-103.ec2.internal" podStartSLOduration=22.181552062 podStartE2EDuration="22.181552062s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 13:40:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:40:33.121893868 +0000 UTC m=+4.561394791" watchObservedRunningTime="2026-07-23 13:40:52.181552062 +0000 UTC m=+23.621052975"
Jul 23 13:40:52.234619 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:52.234561    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-2p6xl" podStartSLOduration=3.634916799 podStartE2EDuration="23.234541368s" totalImagesPullingTime="19.599624569s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:40:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:40:52.233939208 +0000 UTC m=+23.673440128" watchObservedRunningTime="2026-07-23 13:40:52.234541368 +0000 UTC m=+23.674042289"
Jul 23 13:40:52.256892 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:52.256849    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-h5h9z" podStartSLOduration=3.619343919 podStartE2EDuration="23.256834722s" totalImagesPullingTime="19.637490803s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 13:40:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:40:52.256726449 +0000 UTC m=+23.696227369" watchObservedRunningTime="2026-07-23 13:40:52.256834722 +0000 UTC m=+23.696335642"
Jul 23 13:40:52.296265 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:52.296216    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-5gxsc" podStartSLOduration=3.687392871 podStartE2EDuration="23.296203184s" totalImagesPullingTime="19.608810313s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 13:40:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:40:52.29570827 +0000 UTC m=+23.735209194" watchObservedRunningTime="2026-07-23 13:40:52.296203184 +0000 UTC m=+23.735704102"
Jul 23 13:40:52.321171 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:52.320961    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-wk2bh" podStartSLOduration=3.512098716 podStartE2EDuration="23.320941811s" totalImagesPullingTime="19.808843095s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 13:40:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:40:52.320422795 +0000 UTC m=+23.759923711" watchObservedRunningTime="2026-07-23 13:40:52.320941811 +0000 UTC m=+23.760442732"
Jul 23 13:40:52.624403 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:52.624376    2573 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 23 13:40:53.006503 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:53.006335    2573 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-23T13:40:52.624398126Z","UUID":"5fe3c0d3-6299-477f-a0a2-66e22ffee167","Handler":null,"Name":"","Endpoint":""}
Jul 23 13:40:53.008116 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:53.008093    2573 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 23 13:40:53.008249 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:53.008135    2573 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 23 13:40:53.061852 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:53.061826    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-74ntz"
Jul 23 13:40:53.062028 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:53.061962    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-74ntz" podUID="f460d16d-e05e-45bb-b8cb-71fd972809f5"
Jul 23 13:40:53.062304 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:53.062281    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wx249"
Jul 23 13:40:53.062440 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:53.062381    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wx249" podUID="ebc1dbc1-a42e-4498-8678-0f6a33a11f5f"
Jul 23 13:40:53.174635 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:53.174596    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-103.ec2.internal" event={"ID":"f8dcf2cbeaa60b98c88ce64f87e7f4a6","Type":"ContainerStarted","Data":"02094217c8f8bf61595cdadf6a75d39a355f7bbd0382c655c4a1965aa730d8e5"}
Jul 23 13:40:53.177224 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:53.177194    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5n45" event={"ID":"ef85df48-0dd5-4e01-93ef-724734054808","Type":"ContainerStarted","Data":"5f384033ea60dd9c86a06b888cd6cbee27381fcf69ab9f6b8d7f860ca3a55ca9"}
Jul 23 13:40:53.179555 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:53.179213    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-h6fvc" event={"ID":"0ee38828-a288-4015-b238-f1235220578b","Type":"ContainerStarted","Data":"08d95659b1659aff7ab3bedb8a97c04904d523d8b27bba8333ea0746574eb758"}
Jul 23 13:40:53.202703 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:53.202655    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-103.ec2.internal" podStartSLOduration=23.202641557 podStartE2EDuration="23.202641557s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 13:40:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:40:53.197768011 +0000 UTC m=+24.637268930" watchObservedRunningTime="2026-07-23 13:40:53.202641557 +0000 UTC m=+24.642142475"
Jul 23 13:40:53.507683 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:53.507656    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-2p6xl"
Jul 23 13:40:53.508219 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:53.508197    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-2p6xl"
Jul 23 13:40:53.528223 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:53.528177    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-h6fvc" podStartSLOduration=4.963003037 podStartE2EDuration="24.528162917s" totalImagesPullingTime="19.56515988s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 13:40:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:40:53.219659495 +0000 UTC m=+24.659160415" watchObservedRunningTime="2026-07-23 13:40:53.528162917 +0000 UTC m=+24.967663838"
Jul 23 13:40:54.061909 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:54.061842    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rvjth"
Jul 23 13:40:54.062064 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:54.061955    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rvjth" podUID="0f9ef7a1-2fa9-46bc-acc8-83a25209e294"
Jul 23 13:40:54.183899 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:54.183857    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5n45" event={"ID":"ef85df48-0dd5-4e01-93ef-724734054808","Type":"ContainerStarted","Data":"b707761e714279506ea3224938e00a11765ff2179c766976ec1bc47ce25264d3"}
Jul 23 13:40:54.187755 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:54.187728    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bpbpp" event={"ID":"98e8320f-eba6-438b-aad3-1905aee071d8","Type":"ContainerStarted","Data":"47bef106e737d4ec5ad5366b016e7db1a09b04c5c4f7d42ea0800dd5e7356346"}
Jul 23 13:40:54.187889 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:54.187808    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-2p6xl"
Jul 23 13:40:54.188519 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:54.188500    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-2p6xl"
Jul 23 13:40:54.203059 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:54.202988    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5n45" podStartSLOduration=3.455221263 podStartE2EDuration="25.202968521s" totalImagesPullingTime="21.747747258s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 13:40:29 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:40:54.202602764 +0000 UTC m=+25.642103685" watchObservedRunningTime="2026-07-23 13:40:54.202968521 +0000 UTC m=+25.642469442"
Jul 23 13:40:55.065242 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:55.065209    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wx249"
Jul 23 13:40:55.065415 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:55.065344    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wx249" podUID="ebc1dbc1-a42e-4498-8678-0f6a33a11f5f"
Jul 23 13:40:55.065415 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:55.065388    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-74ntz"
Jul 23 13:40:55.065505 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:55.065477    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-74ntz" podUID="f460d16d-e05e-45bb-b8cb-71fd972809f5"
Jul 23 13:40:56.061681 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:56.061652    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rvjth"
Jul 23 13:40:56.062170 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:56.061750    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rvjth" podUID="0f9ef7a1-2fa9-46bc-acc8-83a25209e294"
Jul 23 13:40:57.062144 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:57.061923    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-74ntz"
Jul 23 13:40:57.062816 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:57.061923    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wx249"
Jul 23 13:40:57.062816 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:57.062190    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-74ntz" podUID="f460d16d-e05e-45bb-b8cb-71fd972809f5"
Jul 23 13:40:57.062816 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:57.062248    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wx249" podUID="ebc1dbc1-a42e-4498-8678-0f6a33a11f5f"
Jul 23 13:40:57.196987 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:57.196952    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bpbpp" event={"ID":"98e8320f-eba6-438b-aad3-1905aee071d8","Type":"ContainerStarted","Data":"13bb029a79b80a3e3c518a706e3917c5d3972a45e980f9509c6213f6f27f725d"}
Jul 23 13:40:57.197304 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:57.197270    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bpbpp"
Jul 23 13:40:57.198896 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:57.198869    2573 generic.go:356] "Generic (PLEG): container finished" podID="e492bdc2-dfd1-4b82-a8fc-37f82765cdb4" containerID="a33f0f318b3e6e5e44f8d945a392d0165832a4713b7fb0429940f9aa3634876e" exitCode=0
Jul 23 13:40:57.199061 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:57.198895    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-65xv7" event={"ID":"e492bdc2-dfd1-4b82-a8fc-37f82765cdb4","Type":"ContainerDied","Data":"a33f0f318b3e6e5e44f8d945a392d0165832a4713b7fb0429940f9aa3634876e"}
Jul 23 13:40:57.213221 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:57.213197    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bpbpp"
Jul 23 13:40:57.228333 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:57.228153    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-bpbpp" podStartSLOduration=8.567324411 podStartE2EDuration="28.228139322s" totalImagesPullingTime="19.660814911s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 13:40:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:40:57.227771787 +0000 UTC m=+28.667272720" watchObservedRunningTime="2026-07-23 13:40:57.228139322 +0000 UTC m=+28.667640240"
Jul 23 13:40:58.061652 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:58.061616    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rvjth"
Jul 23 13:40:58.061884 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:58.061744    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rvjth" podUID="0f9ef7a1-2fa9-46bc-acc8-83a25209e294"
Jul 23 13:40:58.149138 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:58.149107    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wx249"]
Jul 23 13:40:58.149474 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:58.149209    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wx249"
Jul 23 13:40:58.149474 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:58.149296    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wx249" podUID="ebc1dbc1-a42e-4498-8678-0f6a33a11f5f"
Jul 23 13:40:58.152266 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:58.152240    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-74ntz"]
Jul 23 13:40:58.152384 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:58.152326    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-74ntz"
Jul 23 13:40:58.152419 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:58.152403    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-74ntz" podUID="f460d16d-e05e-45bb-b8cb-71fd972809f5"
Jul 23 13:40:58.155283 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:58.155257    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rvjth"]
Jul 23 13:40:58.201239 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:58.201214    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rvjth"
Jul 23 13:40:58.201349 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:40:58.201317    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rvjth" podUID="0f9ef7a1-2fa9-46bc-acc8-83a25209e294"
Jul 23 13:40:58.201731 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:58.201711    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bpbpp"
Jul 23 13:40:58.201821 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:58.201805    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bpbpp"
Jul 23 13:40:58.220885 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:58.220850    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bpbpp"
Jul 23 13:40:59.205730 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:59.205690    2573 generic.go:356] "Generic (PLEG): container finished" podID="e492bdc2-dfd1-4b82-a8fc-37f82765cdb4" containerID="a14a5182d3169a8aeeb2eb784fc02034d1c43aec60dc0ac69e23aed54b65a018" exitCode=0
Jul 23 13:40:59.206241 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:40:59.205783    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-65xv7" event={"ID":"e492bdc2-dfd1-4b82-a8fc-37f82765cdb4","Type":"ContainerDied","Data":"a14a5182d3169a8aeeb2eb784fc02034d1c43aec60dc0ac69e23aed54b65a018"}
Jul 23 13:41:00.061879 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:00.061850    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wx249"
Jul 23 13:41:00.061879 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:00.061875    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-74ntz"
Jul 23 13:41:00.062055 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:00.061991    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rvjth"
Jul 23 13:41:00.062055 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:00.062001    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-74ntz" podUID="f460d16d-e05e-45bb-b8cb-71fd972809f5"
Jul 23 13:41:00.062136 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:00.062101    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rvjth" podUID="0f9ef7a1-2fa9-46bc-acc8-83a25209e294"
Jul 23 13:41:00.062189 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:00.062174    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wx249" podUID="ebc1dbc1-a42e-4498-8678-0f6a33a11f5f"
Jul 23 13:41:01.214882 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:01.214841    2573 generic.go:356] "Generic (PLEG): container finished" podID="e492bdc2-dfd1-4b82-a8fc-37f82765cdb4" containerID="fb0c027b836fb638820df11851b7c9368462376f7c0cac664c7b02dbd68602fc" exitCode=0
Jul 23 13:41:01.215356 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:01.214896    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-65xv7" event={"ID":"e492bdc2-dfd1-4b82-a8fc-37f82765cdb4","Type":"ContainerDied","Data":"fb0c027b836fb638820df11851b7c9368462376f7c0cac664c7b02dbd68602fc"}
Jul 23 13:41:02.061891 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:02.061851    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-74ntz"
Jul 23 13:41:02.062094 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:02.061865    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wx249"
Jul 23 13:41:02.062094 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:02.061983    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-74ntz" podUID="f460d16d-e05e-45bb-b8cb-71fd972809f5"
Jul 23 13:41:02.062094 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:02.062025    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rvjth"
Jul 23 13:41:02.062267 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:02.062168    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wx249" podUID="ebc1dbc1-a42e-4498-8678-0f6a33a11f5f"
Jul 23 13:41:02.062267 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:02.062251    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rvjth" podUID="0f9ef7a1-2fa9-46bc-acc8-83a25209e294"
Jul 23 13:41:02.704733 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:02.704511    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ebc1dbc1-a42e-4498-8678-0f6a33a11f5f-original-pull-secret\") pod \"global-pull-secret-syncer-wx249\" (UID: \"ebc1dbc1-a42e-4498-8678-0f6a33a11f5f\") " pod="kube-system/global-pull-secret-syncer-wx249"
Jul 23 13:41:02.705213 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:02.704669    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 13:41:02.705213 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:02.704807    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebc1dbc1-a42e-4498-8678-0f6a33a11f5f-original-pull-secret podName:ebc1dbc1-a42e-4498-8678-0f6a33a11f5f nodeName:}" failed. No retries permitted until 2026-07-23 13:41:34.704791807 +0000 UTC m=+66.144292705 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ebc1dbc1-a42e-4498-8678-0f6a33a11f5f-original-pull-secret") pod "global-pull-secret-syncer-wx249" (UID: "ebc1dbc1-a42e-4498-8678-0f6a33a11f5f") : object "kube-system"/"original-pull-secret" not registered
Jul 23 13:41:02.805708 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:02.805671    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f460d16d-e05e-45bb-b8cb-71fd972809f5-metrics-certs\") pod \"network-metrics-daemon-74ntz\" (UID: \"f460d16d-e05e-45bb-b8cb-71fd972809f5\") " pod="openshift-multus/network-metrics-daemon-74ntz"
Jul 23 13:41:02.805861 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:02.805802    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 13:41:02.805861 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:02.805859    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f460d16d-e05e-45bb-b8cb-71fd972809f5-metrics-certs podName:f460d16d-e05e-45bb-b8cb-71fd972809f5 nodeName:}" failed. No retries permitted until 2026-07-23 13:41:34.805844137 +0000 UTC m=+66.245345057 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f460d16d-e05e-45bb-b8cb-71fd972809f5-metrics-certs") pod "network-metrics-daemon-74ntz" (UID: "f460d16d-e05e-45bb-b8cb-71fd972809f5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 13:41:02.906606 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:02.906568    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jljs\" (UniqueName: \"kubernetes.io/projected/0f9ef7a1-2fa9-46bc-acc8-83a25209e294-kube-api-access-7jljs\") pod \"network-check-target-rvjth\" (UID: \"0f9ef7a1-2fa9-46bc-acc8-83a25209e294\") " pod="openshift-network-diagnostics/network-check-target-rvjth"
Jul 23 13:41:02.906768 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:02.906705    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 13:41:02.906768 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:02.906722    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 13:41:02.906768 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:02.906731    2573 projected.go:196] Error preparing data for projected volume kube-api-access-7jljs for pod openshift-network-diagnostics/network-check-target-rvjth: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 13:41:02.906910 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:02.906779    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0f9ef7a1-2fa9-46bc-acc8-83a25209e294-kube-api-access-7jljs podName:0f9ef7a1-2fa9-46bc-acc8-83a25209e294 nodeName:}" failed. No retries permitted until 2026-07-23 13:41:34.906767466 +0000 UTC m=+66.346268364 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-7jljs" (UniqueName: "kubernetes.io/projected/0f9ef7a1-2fa9-46bc-acc8-83a25209e294-kube-api-access-7jljs") pod "network-check-target-rvjth" (UID: "0f9ef7a1-2fa9-46bc-acc8-83a25209e294") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 13:41:03.862199 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.862119    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-103.ec2.internal" event="NodeReady"
Jul 23 13:41:03.862634 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.862249    2573 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 23 13:41:03.899608 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.899567    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-prghh"]
Jul 23 13:41:03.904723 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.904694    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6db7654c99-dnmqb"]
Jul 23 13:41:03.904892 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.904796    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-prghh"
Jul 23 13:41:03.907603 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.907580    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-fxdgs\""
Jul 23 13:41:03.907940 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.907917    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 23 13:41:03.907940 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.907921    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 23 13:41:03.908141 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.907961    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 23 13:41:03.908579 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.908560    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-vh5dp"]
Jul 23 13:41:03.908687 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.908667    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6db7654c99-dnmqb"
Jul 23 13:41:03.911377 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.911357    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 23 13:41:03.911470 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.911382    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 23 13:41:03.911516 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.911507    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-9kx5c\""
Jul 23 13:41:03.911623 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.911609    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 23 13:41:03.913440 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.913146    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-jxgw7"]
Jul 23 13:41:03.914261 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.913709    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/85626da9-b35f-48f6-b12e-02554ac1b7e1-bound-sa-token\") pod \"image-registry-6db7654c99-dnmqb\" (UID: \"85626da9-b35f-48f6-b12e-02554ac1b7e1\") " pod="openshift-image-registry/image-registry-6db7654c99-dnmqb"
Jul 23 13:41:03.914261 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.913743    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47grr\" (UniqueName: \"kubernetes.io/projected/85626da9-b35f-48f6-b12e-02554ac1b7e1-kube-api-access-47grr\") pod \"image-registry-6db7654c99-dnmqb\" (UID: \"85626da9-b35f-48f6-b12e-02554ac1b7e1\") " pod="openshift-image-registry/image-registry-6db7654c99-dnmqb"
Jul 23 13:41:03.914261 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.913786    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e20c5716-9825-474c-86cc-f4d8251ab64c-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-prghh\" (UID: \"e20c5716-9825-474c-86cc-f4d8251ab64c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-prghh"
Jul 23 13:41:03.914261 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.913828    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/85626da9-b35f-48f6-b12e-02554ac1b7e1-trusted-ca\") pod \"image-registry-6db7654c99-dnmqb\" (UID: \"85626da9-b35f-48f6-b12e-02554ac1b7e1\") " pod="openshift-image-registry/image-registry-6db7654c99-dnmqb"
Jul 23 13:41:03.914261 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.913862    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxv9d\" (UniqueName: \"kubernetes.io/projected/e20c5716-9825-474c-86cc-f4d8251ab64c-kube-api-access-dxv9d\") pod \"cluster-samples-operator-79b7c55f87-prghh\" (UID: \"e20c5716-9825-474c-86cc-f4d8251ab64c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-prghh"
Jul 23 13:41:03.914261 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.913894    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/85626da9-b35f-48f6-b12e-02554ac1b7e1-registry-tls\") pod \"image-registry-6db7654c99-dnmqb\" (UID: \"85626da9-b35f-48f6-b12e-02554ac1b7e1\") " pod="openshift-image-registry/image-registry-6db7654c99-dnmqb"
Jul 23 13:41:03.914261 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.913923    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/85626da9-b35f-48f6-b12e-02554ac1b7e1-image-registry-private-configuration\") pod \"image-registry-6db7654c99-dnmqb\" (UID: \"85626da9-b35f-48f6-b12e-02554ac1b7e1\") " pod="openshift-image-registry/image-registry-6db7654c99-dnmqb"
Jul 23 13:41:03.914261 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.913956    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/85626da9-b35f-48f6-b12e-02554ac1b7e1-ca-trust-extracted\") pod \"image-registry-6db7654c99-dnmqb\" (UID: \"85626da9-b35f-48f6-b12e-02554ac1b7e1\") " pod="openshift-image-registry/image-registry-6db7654c99-dnmqb"
Jul 23 13:41:03.914261 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.913992    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/85626da9-b35f-48f6-b12e-02554ac1b7e1-registry-certificates\") pod \"image-registry-6db7654c99-dnmqb\" (UID: \"85626da9-b35f-48f6-b12e-02554ac1b7e1\") " pod="openshift-image-registry/image-registry-6db7654c99-dnmqb"
Jul 23 13:41:03.914261 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.914044    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/85626da9-b35f-48f6-b12e-02554ac1b7e1-installation-pull-secrets\") pod \"image-registry-6db7654c99-dnmqb\" (UID: \"85626da9-b35f-48f6-b12e-02554ac1b7e1\") " pod="openshift-image-registry/image-registry-6db7654c99-dnmqb"
Jul 23 13:41:03.914762 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.914297    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-vh5dp"
Jul 23 13:41:03.916523 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.916503    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 23 13:41:03.917033 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.916990    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-7rvsv"]
Jul 23 13:41:03.917033 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.917001    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-vsdjk\""
Jul 23 13:41:03.917181 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.917062    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 23 13:41:03.917243 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.917230    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-jxgw7"
Jul 23 13:41:03.917397 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.917378    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 23 13:41:03.917562 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.917536    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 23 13:41:03.921176 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.920258    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 23 13:41:03.922213 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.921991    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-prghh"]
Jul 23 13:41:03.922213 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.922075    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-7rvsv"]
Jul 23 13:41:03.922774 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.922706    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-7rvsv"
Jul 23 13:41:03.927139 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.924477    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 23 13:41:03.927139 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.924750    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 23 13:41:03.927139 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.926316    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-vh5dp"]
Jul 23 13:41:03.927139 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.926380    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 23 13:41:03.927139 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.926528    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-hl7k9\""
Jul 23 13:41:03.928694 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.928186    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 23 13:41:03.928694 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.928664    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 23 13:41:03.929212 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.929192    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 23 13:41:03.929968 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.929947    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-c4wr8\""
Jul 23 13:41:03.933634 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.933618    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-7zf2f"]
Jul 23 13:41:03.934003 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.933981    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 23 13:41:03.937338 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.937316    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-66578b4c86-6vhrf"]
Jul 23 13:41:03.937447 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.937409    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-7zf2f"
Jul 23 13:41:03.939971 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.939950    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 23 13:41:03.939971 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.939963    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 23 13:41:03.940274 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.940253    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 23 13:41:03.940363 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.940264    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 23 13:41:03.940363 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.940319    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-9sl8v\""
Jul 23 13:41:03.941498 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.941481    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-25jdb"]
Jul 23 13:41:03.941672 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.941656    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-66578b4c86-6vhrf"
Jul 23 13:41:03.944107 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.943828    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-pjdvn\""
Jul 23 13:41:03.944223 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.944203    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 23 13:41:03.944370 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.944354    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 23 13:41:03.944421 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.944404    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 23 13:41:03.944463 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.944441    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 23 13:41:03.944616 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.944597    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 23 13:41:03.944707 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.944665    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 23 13:41:03.945511 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.945495    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-jmlv7"]
Jul 23 13:41:03.945794 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.945617    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-25jdb"
Jul 23 13:41:03.949416 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.949393    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-v878n"]
Jul 23 13:41:03.949506 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.949418    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 23 13:41:03.949604 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.949407    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 23 13:41:03.949846 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.949632    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 23 13:41:03.950697 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.950678    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-q9stg\""
Jul 23 13:41:03.950942 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.950914    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 23 13:41:03.951420 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.951400    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-jmlv7"
Jul 23 13:41:03.956279 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.956259    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-zf6lz"]
Jul 23 13:41:03.957307 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.957289    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 23 13:41:03.957526 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.957389    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-v878n"
Jul 23 13:41:03.957891 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.957873    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 23 13:41:03.958093 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.958053    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 23 13:41:03.958093 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.958073    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-vprsw\""
Jul 23 13:41:03.958614 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.958593    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 23 13:41:03.960592 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.959850    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 23 13:41:03.960592 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.960430    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-l4fll\""
Jul 23 13:41:03.960592 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.960548    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-98w4s"]
Jul 23 13:41:03.961554 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.960851    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 23 13:41:03.961554 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.960908    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-zf6lz"
Jul 23 13:41:03.961554 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.961356    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 23 13:41:03.963377 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.963355    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 23 13:41:03.963889 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.963870    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-8lltd\""
Jul 23 13:41:03.965231 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.965213    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 23 13:41:03.965437 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.965414    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-98w4s"
Jul 23 13:41:03.965676 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.965286    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6db7654c99-dnmqb"]
Jul 23 13:41:03.965811 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.965797    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-25jdb"]
Jul 23 13:41:03.965978 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.965957    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-7zf2f"]
Jul 23 13:41:03.966110 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.966099    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-98w4s"]
Jul 23 13:41:03.966199 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.966190    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-66578b4c86-6vhrf"]
Jul 23 13:41:03.966288 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.966275    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-jxgw7"]
Jul 23 13:41:03.966375 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.966363    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-jmlv7"]
Jul 23 13:41:03.966620 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.966596    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-v878n"]
Jul 23 13:41:03.967821 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.967802    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 23 13:41:03.968184 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.968109    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 23 13:41:03.968458 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.968440    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 23 13:41:03.968958 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.968472    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-dmxg7\""
Jul 23 13:41:03.969893 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:03.969847    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-zf6lz"]
Jul 23 13:41:04.014317 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.014294    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/85626da9-b35f-48f6-b12e-02554ac1b7e1-registry-certificates\") pod \"image-registry-6db7654c99-dnmqb\" (UID: \"85626da9-b35f-48f6-b12e-02554ac1b7e1\") " pod="openshift-image-registry/image-registry-6db7654c99-dnmqb"
Jul 23 13:41:04.014444 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.014332    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0e22af39-dd90-473a-9802-abfb83870e38-stats-auth\") pod \"router-default-66578b4c86-6vhrf\" (UID: \"0e22af39-dd90-473a-9802-abfb83870e38\") " pod="openshift-ingress/router-default-66578b4c86-6vhrf"
Jul 23 13:41:04.014444 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.014356    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5sr6\" (UniqueName: \"kubernetes.io/projected/b13a7207-47ba-4e8e-a62b-97546e957cdd-kube-api-access-b5sr6\") pod \"insights-operator-555d9d7885-25jdb\" (UID: \"b13a7207-47ba-4e8e-a62b-97546e957cdd\") " pod="openshift-insights/insights-operator-555d9d7885-25jdb"
Jul 23 13:41:04.014444 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.014385    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/85626da9-b35f-48f6-b12e-02554ac1b7e1-installation-pull-secrets\") pod \"image-registry-6db7654c99-dnmqb\" (UID: \"85626da9-b35f-48f6-b12e-02554ac1b7e1\") " pod="openshift-image-registry/image-registry-6db7654c99-dnmqb"
Jul 23 13:41:04.014444 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.014412    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/96de4e50-4208-4f42-ab50-0a702232ff33-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-jxgw7\" (UID: \"96de4e50-4208-4f42-ab50-0a702232ff33\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-jxgw7"
Jul 23 13:41:04.014444 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.014440    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlwcr\" (UniqueName: \"kubernetes.io/projected/05483fd5-7d32-4631-b508-951081e51e6f-kube-api-access-jlwcr\") pod \"network-check-source-7bc5b6bf85-zf6lz\" (UID: \"05483fd5-7d32-4631-b508-951081e51e6f\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-zf6lz"
Jul 23 13:41:04.014621 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.014500    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2d624703-978f-48c2-b02d-9af8fd337236-trusted-ca\") pod \"console-operator-565b7b569d-vh5dp\" (UID: \"2d624703-978f-48c2-b02d-9af8fd337236\") " pod="openshift-console-operator/console-operator-565b7b569d-vh5dp"
Jul 23 13:41:04.014621 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.014540    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/96de4e50-4208-4f42-ab50-0a702232ff33-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-jxgw7\" (UID: \"96de4e50-4208-4f42-ab50-0a702232ff33\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-jxgw7"
Jul 23 13:41:04.014621 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.014590    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0825a9ee-4ce9-460c-90a2-6e285f9adc51-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-7zf2f\" (UID: \"0825a9ee-4ce9-460c-90a2-6e285f9adc51\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-7zf2f"
Jul 23 13:41:04.014727 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.014618    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0825a9ee-4ce9-460c-90a2-6e285f9adc51-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-7zf2f\" (UID: \"0825a9ee-4ce9-460c-90a2-6e285f9adc51\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-7zf2f"
Jul 23 13:41:04.014727 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.014645    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bcc90ce2-5ae1-44ce-8842-aa5e7f477776-config\") pod \"service-ca-operator-5bcbc94c78-jmlv7\" (UID: \"bcc90ce2-5ae1-44ce-8842-aa5e7f477776\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-jmlv7"
Jul 23 13:41:04.014727 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.014686    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b13a7207-47ba-4e8e-a62b-97546e957cdd-serving-cert\") pod \"insights-operator-555d9d7885-25jdb\" (UID: \"b13a7207-47ba-4e8e-a62b-97546e957cdd\") " pod="openshift-insights/insights-operator-555d9d7885-25jdb"
Jul 23 13:41:04.014857 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.014722    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkppd\" (UniqueName: \"kubernetes.io/projected/96de4e50-4208-4f42-ab50-0a702232ff33-kube-api-access-zkppd\") pod \"cluster-monitoring-operator-76cf8966f8-jxgw7\" (UID: \"96de4e50-4208-4f42-ab50-0a702232ff33\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-jxgw7"
Jul 23 13:41:04.014857 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.014750    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5d49627b-4f13-46b6-a3a2-da958eb12319-cert\") pod \"ingress-canary-98w4s\" (UID: \"5d49627b-4f13-46b6-a3a2-da958eb12319\") " pod="openshift-ingress-canary/ingress-canary-98w4s"
Jul 23 13:41:04.014857 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.014779    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hfjj\" (UniqueName: \"kubernetes.io/projected/0e22af39-dd90-473a-9802-abfb83870e38-kube-api-access-4hfjj\") pod \"router-default-66578b4c86-6vhrf\" (UID: \"0e22af39-dd90-473a-9802-abfb83870e38\") " pod="openshift-ingress/router-default-66578b4c86-6vhrf"
Jul 23 13:41:04.014857 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.014810    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/85626da9-b35f-48f6-b12e-02554ac1b7e1-image-registry-private-configuration\") pod \"image-registry-6db7654c99-dnmqb\" (UID: \"85626da9-b35f-48f6-b12e-02554ac1b7e1\") " pod="openshift-image-registry/image-registry-6db7654c99-dnmqb"
Jul 23 13:41:04.014857 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.014837    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5grb\" (UniqueName: \"kubernetes.io/projected/001764b2-a882-42f4-9ef6-2ea7066febd7-kube-api-access-h5grb\") pod \"volume-data-source-validator-78cf4c6f6-7rvsv\" (UID: \"001764b2-a882-42f4-9ef6-2ea7066febd7\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-7rvsv"
Jul 23 13:41:04.015118 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.014865    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/85626da9-b35f-48f6-b12e-02554ac1b7e1-ca-trust-extracted\") pod \"image-registry-6db7654c99-dnmqb\" (UID: \"85626da9-b35f-48f6-b12e-02554ac1b7e1\") " pod="openshift-image-registry/image-registry-6db7654c99-dnmqb"
Jul 23 13:41:04.015118 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.014889    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6cqw\" (UniqueName: \"kubernetes.io/projected/bcc90ce2-5ae1-44ce-8842-aa5e7f477776-kube-api-access-d6cqw\") pod \"service-ca-operator-5bcbc94c78-jmlv7\" (UID: \"bcc90ce2-5ae1-44ce-8842-aa5e7f477776\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-jmlv7"
Jul 23 13:41:04.015118 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.014913    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwrmp\" (UniqueName: \"kubernetes.io/projected/62b09fb2-689e-433b-8621-d6ee876b59a6-kube-api-access-qwrmp\") pod \"dns-default-v878n\" (UID: \"62b09fb2-689e-433b-8621-d6ee876b59a6\") " pod="openshift-dns/dns-default-v878n"
Jul 23 13:41:04.015118 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.014936    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/62b09fb2-689e-433b-8621-d6ee876b59a6-metrics-tls\") pod \"dns-default-v878n\" (UID: \"62b09fb2-689e-433b-8621-d6ee876b59a6\") " pod="openshift-dns/dns-default-v878n"
Jul 23 13:41:04.015118 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.014963    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b13a7207-47ba-4e8e-a62b-97546e957cdd-snapshots\") pod \"insights-operator-555d9d7885-25jdb\" (UID: \"b13a7207-47ba-4e8e-a62b-97546e957cdd\") " pod="openshift-insights/insights-operator-555d9d7885-25jdb"
Jul 23 13:41:04.015118 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.014991    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vw8j6\" (UniqueName: \"kubernetes.io/projected/2d624703-978f-48c2-b02d-9af8fd337236-kube-api-access-vw8j6\") pod \"console-operator-565b7b569d-vh5dp\" (UID: \"2d624703-978f-48c2-b02d-9af8fd337236\") " pod="openshift-console-operator/console-operator-565b7b569d-vh5dp"
Jul 23 13:41:04.015118 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.015033    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b13a7207-47ba-4e8e-a62b-97546e957cdd-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-25jdb\" (UID: \"b13a7207-47ba-4e8e-a62b-97546e957cdd\") " pod="openshift-insights/insights-operator-555d9d7885-25jdb"
Jul 23 13:41:04.015118 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.015062    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0e22af39-dd90-473a-9802-abfb83870e38-default-certificate\") pod \"router-default-66578b4c86-6vhrf\" (UID: \"0e22af39-dd90-473a-9802-abfb83870e38\") " pod="openshift-ingress/router-default-66578b4c86-6vhrf"
Jul 23 13:41:04.015118 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.015091    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/85626da9-b35f-48f6-b12e-02554ac1b7e1-bound-sa-token\") pod \"image-registry-6db7654c99-dnmqb\" (UID: \"85626da9-b35f-48f6-b12e-02554ac1b7e1\") " pod="openshift-image-registry/image-registry-6db7654c99-dnmqb"
Jul 23 13:41:04.015118 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.015114    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47grr\" (UniqueName: \"kubernetes.io/projected/85626da9-b35f-48f6-b12e-02554ac1b7e1-kube-api-access-47grr\") pod \"image-registry-6db7654c99-dnmqb\" (UID: \"85626da9-b35f-48f6-b12e-02554ac1b7e1\") " pod="openshift-image-registry/image-registry-6db7654c99-dnmqb"
Jul 23 13:41:04.015570 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.015140    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e20c5716-9825-474c-86cc-f4d8251ab64c-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-prghh\" (UID: \"e20c5716-9825-474c-86cc-f4d8251ab64c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-prghh"
Jul 23 13:41:04.015570 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.015164    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/62b09fb2-689e-433b-8621-d6ee876b59a6-tmp-dir\") pod \"dns-default-v878n\" (UID: \"62b09fb2-689e-433b-8621-d6ee876b59a6\") " pod="openshift-dns/dns-default-v878n"
Jul 23 13:41:04.015570 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.015210    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/85626da9-b35f-48f6-b12e-02554ac1b7e1-trusted-ca\") pod \"image-registry-6db7654c99-dnmqb\" (UID: \"85626da9-b35f-48f6-b12e-02554ac1b7e1\") " pod="openshift-image-registry/image-registry-6db7654c99-dnmqb"
Jul 23 13:41:04.015570 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.015215    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/85626da9-b35f-48f6-b12e-02554ac1b7e1-ca-trust-extracted\") pod \"image-registry-6db7654c99-dnmqb\" (UID: \"85626da9-b35f-48f6-b12e-02554ac1b7e1\") " pod="openshift-image-registry/image-registry-6db7654c99-dnmqb"
Jul 23 13:41:04.015570 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.015233    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2d624703-978f-48c2-b02d-9af8fd337236-serving-cert\") pod \"console-operator-565b7b569d-vh5dp\" (UID: \"2d624703-978f-48c2-b02d-9af8fd337236\") " pod="openshift-console-operator/console-operator-565b7b569d-vh5dp"
Jul 23 13:41:04.015570 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.015256    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/62b09fb2-689e-433b-8621-d6ee876b59a6-config-volume\") pod \"dns-default-v878n\" (UID: \"62b09fb2-689e-433b-8621-d6ee876b59a6\") " pod="openshift-dns/dns-default-v878n"
Jul 23 13:41:04.015570 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.015283    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e22af39-dd90-473a-9802-abfb83870e38-metrics-certs\") pod \"router-default-66578b4c86-6vhrf\" (UID: \"0e22af39-dd90-473a-9802-abfb83870e38\") " pod="openshift-ingress/router-default-66578b4c86-6vhrf"
Jul 23 13:41:04.015570 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.015386    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b13a7207-47ba-4e8e-a62b-97546e957cdd-tmp\") pod \"insights-operator-555d9d7885-25jdb\" (UID: \"b13a7207-47ba-4e8e-a62b-97546e957cdd\") " pod="openshift-insights/insights-operator-555d9d7885-25jdb"
Jul 23 13:41:04.015570 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:04.015403    2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 23 13:41:04.015570 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.015422    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2d624703-978f-48c2-b02d-9af8fd337236-config\") pod \"console-operator-565b7b569d-vh5dp\" (UID: \"2d624703-978f-48c2-b02d-9af8fd337236\") " pod="openshift-console-operator/console-operator-565b7b569d-vh5dp"
Jul 23 13:41:04.015570 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:04.015459    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e20c5716-9825-474c-86cc-f4d8251ab64c-samples-operator-tls podName:e20c5716-9825-474c-86cc-f4d8251ab64c nodeName:}" failed. No retries permitted until 2026-07-23 13:41:04.515441435 +0000 UTC m=+35.954942335 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e20c5716-9825-474c-86cc-f4d8251ab64c-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-prghh" (UID: "e20c5716-9825-474c-86cc-f4d8251ab64c") : secret "samples-operator-tls" not found
Jul 23 13:41:04.015570 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.015463    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/85626da9-b35f-48f6-b12e-02554ac1b7e1-registry-certificates\") pod \"image-registry-6db7654c99-dnmqb\" (UID: \"85626da9-b35f-48f6-b12e-02554ac1b7e1\") " pod="openshift-image-registry/image-registry-6db7654c99-dnmqb"
Jul 23 13:41:04.015570 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.015477    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bcc90ce2-5ae1-44ce-8842-aa5e7f477776-serving-cert\") pod \"service-ca-operator-5bcbc94c78-jmlv7\" (UID: \"bcc90ce2-5ae1-44ce-8842-aa5e7f477776\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-jmlv7"
Jul 23 13:41:04.016184 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.015657    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxv9d\" (UniqueName: \"kubernetes.io/projected/e20c5716-9825-474c-86cc-f4d8251ab64c-kube-api-access-dxv9d\") pod \"cluster-samples-operator-79b7c55f87-prghh\" (UID: \"e20c5716-9825-474c-86cc-f4d8251ab64c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-prghh"
Jul 23 13:41:04.016184 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.016038    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e22af39-dd90-473a-9802-abfb83870e38-service-ca-bundle\") pod \"router-default-66578b4c86-6vhrf\" (UID: \"0e22af39-dd90-473a-9802-abfb83870e38\") " pod="openshift-ingress/router-default-66578b4c86-6vhrf"
Jul 23 13:41:04.016184 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.016087    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6sld\" (UniqueName: \"kubernetes.io/projected/0825a9ee-4ce9-460c-90a2-6e285f9adc51-kube-api-access-x6sld\") pod \"kube-storage-version-migrator-operator-7658d9b749-7zf2f\" (UID: \"0825a9ee-4ce9-460c-90a2-6e285f9adc51\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-7zf2f"
Jul 23 13:41:04.016184 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.016125    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/85626da9-b35f-48f6-b12e-02554ac1b7e1-registry-tls\") pod \"image-registry-6db7654c99-dnmqb\" (UID: \"85626da9-b35f-48f6-b12e-02554ac1b7e1\") " pod="openshift-image-registry/image-registry-6db7654c99-dnmqb"
Jul 23 13:41:04.016184 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.016169    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b13a7207-47ba-4e8e-a62b-97546e957cdd-service-ca-bundle\") pod \"insights-operator-555d9d7885-25jdb\" (UID: \"b13a7207-47ba-4e8e-a62b-97546e957cdd\") " pod="openshift-insights/insights-operator-555d9d7885-25jdb"
Jul 23 13:41:04.016430 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:04.016243    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 13:41:04.016430 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:04.016255    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6db7654c99-dnmqb: secret "image-registry-tls" not found
Jul 23 13:41:04.016430 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.016278    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/85626da9-b35f-48f6-b12e-02554ac1b7e1-trusted-ca\") pod \"image-registry-6db7654c99-dnmqb\" (UID: \"85626da9-b35f-48f6-b12e-02554ac1b7e1\") " pod="openshift-image-registry/image-registry-6db7654c99-dnmqb"
Jul 23 13:41:04.016430 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:04.016300    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/85626da9-b35f-48f6-b12e-02554ac1b7e1-registry-tls podName:85626da9-b35f-48f6-b12e-02554ac1b7e1 nodeName:}" failed. No retries permitted until 2026-07-23 13:41:04.516283433 +0000 UTC m=+35.955784335 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/85626da9-b35f-48f6-b12e-02554ac1b7e1-registry-tls") pod "image-registry-6db7654c99-dnmqb" (UID: "85626da9-b35f-48f6-b12e-02554ac1b7e1") : secret "image-registry-tls" not found
Jul 23 13:41:04.016430 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.016361    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8m6t6\" (UniqueName: \"kubernetes.io/projected/5d49627b-4f13-46b6-a3a2-da958eb12319-kube-api-access-8m6t6\") pod \"ingress-canary-98w4s\" (UID: \"5d49627b-4f13-46b6-a3a2-da958eb12319\") " pod="openshift-ingress-canary/ingress-canary-98w4s"
Jul 23 13:41:04.019477 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.019454    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/85626da9-b35f-48f6-b12e-02554ac1b7e1-image-registry-private-configuration\") pod \"image-registry-6db7654c99-dnmqb\" (UID: \"85626da9-b35f-48f6-b12e-02554ac1b7e1\") " pod="openshift-image-registry/image-registry-6db7654c99-dnmqb"
Jul 23 13:41:04.019593 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.019477    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/85626da9-b35f-48f6-b12e-02554ac1b7e1-installation-pull-secrets\") pod \"image-registry-6db7654c99-dnmqb\" (UID: \"85626da9-b35f-48f6-b12e-02554ac1b7e1\") " pod="openshift-image-registry/image-registry-6db7654c99-dnmqb"
Jul 23 13:41:04.028909 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.028889    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/85626da9-b35f-48f6-b12e-02554ac1b7e1-bound-sa-token\") pod \"image-registry-6db7654c99-dnmqb\" (UID: \"85626da9-b35f-48f6-b12e-02554ac1b7e1\") " pod="openshift-image-registry/image-registry-6db7654c99-dnmqb"
Jul 23 13:41:04.029682 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.029653    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxv9d\" (UniqueName: \"kubernetes.io/projected/e20c5716-9825-474c-86cc-f4d8251ab64c-kube-api-access-dxv9d\") pod \"cluster-samples-operator-79b7c55f87-prghh\" (UID: \"e20c5716-9825-474c-86cc-f4d8251ab64c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-prghh"
Jul 23 13:41:04.029775 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.029690    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-47grr\" (UniqueName: \"kubernetes.io/projected/85626da9-b35f-48f6-b12e-02554ac1b7e1-kube-api-access-47grr\") pod \"image-registry-6db7654c99-dnmqb\" (UID: \"85626da9-b35f-48f6-b12e-02554ac1b7e1\") " pod="openshift-image-registry/image-registry-6db7654c99-dnmqb"
Jul 23 13:41:04.062199 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.062166    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rvjth"
Jul 23 13:41:04.062358 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.062274    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-74ntz"
Jul 23 13:41:04.062358 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.062311    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wx249"
Jul 23 13:41:04.064671 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.064644    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 23 13:41:04.064777 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.064702    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pwdgr\""
Jul 23 13:41:04.064777 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.064751    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 23 13:41:04.064915 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.064836    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5nz2m\""
Jul 23 13:41:04.113244 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.113154    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:04.117127 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.117097    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0e22af39-dd90-473a-9802-abfb83870e38-default-certificate\") pod \"router-default-66578b4c86-6vhrf\" (UID: \"0e22af39-dd90-473a-9802-abfb83870e38\") " pod="openshift-ingress/router-default-66578b4c86-6vhrf"
Jul 23 13:41:04.117358 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.117338    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/62b09fb2-689e-433b-8621-d6ee876b59a6-tmp-dir\") pod \"dns-default-v878n\" (UID: \"62b09fb2-689e-433b-8621-d6ee876b59a6\") " pod="openshift-dns/dns-default-v878n"
Jul 23 13:41:04.118036 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.117518    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2d624703-978f-48c2-b02d-9af8fd337236-serving-cert\") pod \"console-operator-565b7b569d-vh5dp\" (UID: \"2d624703-978f-48c2-b02d-9af8fd337236\") " pod="openshift-console-operator/console-operator-565b7b569d-vh5dp"
Jul 23 13:41:04.118036 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.117550    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/62b09fb2-689e-433b-8621-d6ee876b59a6-config-volume\") pod \"dns-default-v878n\" (UID: \"62b09fb2-689e-433b-8621-d6ee876b59a6\") " pod="openshift-dns/dns-default-v878n"
Jul 23 13:41:04.118036 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.117576    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e22af39-dd90-473a-9802-abfb83870e38-metrics-certs\") pod \"router-default-66578b4c86-6vhrf\" (UID: \"0e22af39-dd90-473a-9802-abfb83870e38\") " pod="openshift-ingress/router-default-66578b4c86-6vhrf"
Jul 23 13:41:04.118036 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.117613    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b13a7207-47ba-4e8e-a62b-97546e957cdd-tmp\") pod \"insights-operator-555d9d7885-25jdb\" (UID: \"b13a7207-47ba-4e8e-a62b-97546e957cdd\") " pod="openshift-insights/insights-operator-555d9d7885-25jdb"
Jul 23 13:41:04.118036 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.117637    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2d624703-978f-48c2-b02d-9af8fd337236-config\") pod \"console-operator-565b7b569d-vh5dp\" (UID: \"2d624703-978f-48c2-b02d-9af8fd337236\") " pod="openshift-console-operator/console-operator-565b7b569d-vh5dp"
Jul 23 13:41:04.118036 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.117659    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bcc90ce2-5ae1-44ce-8842-aa5e7f477776-serving-cert\") pod \"service-ca-operator-5bcbc94c78-jmlv7\" (UID: \"bcc90ce2-5ae1-44ce-8842-aa5e7f477776\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-jmlv7"
Jul 23 13:41:04.118036 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.117691    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e22af39-dd90-473a-9802-abfb83870e38-service-ca-bundle\") pod \"router-default-66578b4c86-6vhrf\" (UID: \"0e22af39-dd90-473a-9802-abfb83870e38\") " pod="openshift-ingress/router-default-66578b4c86-6vhrf"
Jul 23 13:41:04.118036 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.117717    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6sld\" (UniqueName: \"kubernetes.io/projected/0825a9ee-4ce9-460c-90a2-6e285f9adc51-kube-api-access-x6sld\") pod \"kube-storage-version-migrator-operator-7658d9b749-7zf2f\" (UID: \"0825a9ee-4ce9-460c-90a2-6e285f9adc51\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-7zf2f"
Jul 23 13:41:04.118036 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.117755    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b13a7207-47ba-4e8e-a62b-97546e957cdd-service-ca-bundle\") pod \"insights-operator-555d9d7885-25jdb\" (UID: \"b13a7207-47ba-4e8e-a62b-97546e957cdd\") " pod="openshift-insights/insights-operator-555d9d7885-25jdb"
Jul 23 13:41:04.118036 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.117785    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8m6t6\" (UniqueName: \"kubernetes.io/projected/5d49627b-4f13-46b6-a3a2-da958eb12319-kube-api-access-8m6t6\") pod \"ingress-canary-98w4s\" (UID: \"5d49627b-4f13-46b6-a3a2-da958eb12319\") " pod="openshift-ingress-canary/ingress-canary-98w4s"
Jul 23 13:41:04.118036 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.117826    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0e22af39-dd90-473a-9802-abfb83870e38-stats-auth\") pod \"router-default-66578b4c86-6vhrf\" (UID: \"0e22af39-dd90-473a-9802-abfb83870e38\") " pod="openshift-ingress/router-default-66578b4c86-6vhrf"
Jul 23 13:41:04.118036 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.117851    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5sr6\" (UniqueName: \"kubernetes.io/projected/b13a7207-47ba-4e8e-a62b-97546e957cdd-kube-api-access-b5sr6\") pod \"insights-operator-555d9d7885-25jdb\" (UID: \"b13a7207-47ba-4e8e-a62b-97546e957cdd\") " pod="openshift-insights/insights-operator-555d9d7885-25jdb"
Jul 23 13:41:04.118036 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.117881    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/96de4e50-4208-4f42-ab50-0a702232ff33-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-jxgw7\" (UID: \"96de4e50-4208-4f42-ab50-0a702232ff33\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-jxgw7"
Jul 23 13:41:04.118671 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.117915    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlwcr\" (UniqueName: \"kubernetes.io/projected/05483fd5-7d32-4631-b508-951081e51e6f-kube-api-access-jlwcr\") pod \"network-check-source-7bc5b6bf85-zf6lz\" (UID: \"05483fd5-7d32-4631-b508-951081e51e6f\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-zf6lz"
Jul 23 13:41:04.118671 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.117946    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2d624703-978f-48c2-b02d-9af8fd337236-trusted-ca\") pod \"console-operator-565b7b569d-vh5dp\" (UID: \"2d624703-978f-48c2-b02d-9af8fd337236\") " pod="openshift-console-operator/console-operator-565b7b569d-vh5dp"
Jul 23 13:41:04.118671 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.117968    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/96de4e50-4208-4f42-ab50-0a702232ff33-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-jxgw7\" (UID: \"96de4e50-4208-4f42-ab50-0a702232ff33\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-jxgw7"
Jul 23 13:41:04.118671 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.118003    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0825a9ee-4ce9-460c-90a2-6e285f9adc51-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-7zf2f\" (UID: \"0825a9ee-4ce9-460c-90a2-6e285f9adc51\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-7zf2f"
Jul 23 13:41:04.118671 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.118055    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0825a9ee-4ce9-460c-90a2-6e285f9adc51-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-7zf2f\" (UID: \"0825a9ee-4ce9-460c-90a2-6e285f9adc51\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-7zf2f"
Jul 23 13:41:04.118671 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.118083    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bcc90ce2-5ae1-44ce-8842-aa5e7f477776-config\") pod \"service-ca-operator-5bcbc94c78-jmlv7\" (UID: \"bcc90ce2-5ae1-44ce-8842-aa5e7f477776\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-jmlv7"
Jul 23 13:41:04.118671 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.118106    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b13a7207-47ba-4e8e-a62b-97546e957cdd-serving-cert\") pod \"insights-operator-555d9d7885-25jdb\" (UID: \"b13a7207-47ba-4e8e-a62b-97546e957cdd\") " pod="openshift-insights/insights-operator-555d9d7885-25jdb"
Jul 23 13:41:04.118671 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.118141    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkppd\" (UniqueName: \"kubernetes.io/projected/96de4e50-4208-4f42-ab50-0a702232ff33-kube-api-access-zkppd\") pod \"cluster-monitoring-operator-76cf8966f8-jxgw7\" (UID: \"96de4e50-4208-4f42-ab50-0a702232ff33\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-jxgw7"
Jul 23 13:41:04.118671 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.118164    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5d49627b-4f13-46b6-a3a2-da958eb12319-cert\") pod \"ingress-canary-98w4s\" (UID: \"5d49627b-4f13-46b6-a3a2-da958eb12319\") " pod="openshift-ingress-canary/ingress-canary-98w4s"
Jul 23 13:41:04.118671 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.118198    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hfjj\" (UniqueName: \"kubernetes.io/projected/0e22af39-dd90-473a-9802-abfb83870e38-kube-api-access-4hfjj\") pod \"router-default-66578b4c86-6vhrf\" (UID: \"0e22af39-dd90-473a-9802-abfb83870e38\") " pod="openshift-ingress/router-default-66578b4c86-6vhrf"
Jul 23 13:41:04.118671 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.118229    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5grb\" (UniqueName: \"kubernetes.io/projected/001764b2-a882-42f4-9ef6-2ea7066febd7-kube-api-access-h5grb\") pod \"volume-data-source-validator-78cf4c6f6-7rvsv\" (UID: \"001764b2-a882-42f4-9ef6-2ea7066febd7\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-7rvsv"
Jul 23 13:41:04.118671 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.118255    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/62b09fb2-689e-433b-8621-d6ee876b59a6-tmp-dir\") pod \"dns-default-v878n\" (UID: \"62b09fb2-689e-433b-8621-d6ee876b59a6\") " pod="openshift-dns/dns-default-v878n"
Jul 23 13:41:04.118671 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.118258    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6cqw\" (UniqueName: \"kubernetes.io/projected/bcc90ce2-5ae1-44ce-8842-aa5e7f477776-kube-api-access-d6cqw\") pod \"service-ca-operator-5bcbc94c78-jmlv7\" (UID: \"bcc90ce2-5ae1-44ce-8842-aa5e7f477776\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-jmlv7"
Jul 23 13:41:04.119293 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.118332    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwrmp\" (UniqueName: \"kubernetes.io/projected/62b09fb2-689e-433b-8621-d6ee876b59a6-kube-api-access-qwrmp\") pod \"dns-default-v878n\" (UID: \"62b09fb2-689e-433b-8621-d6ee876b59a6\") " pod="openshift-dns/dns-default-v878n"
Jul 23 13:41:04.119293 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.118364    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/62b09fb2-689e-433b-8621-d6ee876b59a6-metrics-tls\") pod \"dns-default-v878n\" (UID: \"62b09fb2-689e-433b-8621-d6ee876b59a6\") " pod="openshift-dns/dns-default-v878n"
Jul 23 13:41:04.119293 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.118399    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b13a7207-47ba-4e8e-a62b-97546e957cdd-snapshots\") pod \"insights-operator-555d9d7885-25jdb\" (UID: \"b13a7207-47ba-4e8e-a62b-97546e957cdd\") " pod="openshift-insights/insights-operator-555d9d7885-25jdb"
Jul 23 13:41:04.119293 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.118429    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vw8j6\" (UniqueName: \"kubernetes.io/projected/2d624703-978f-48c2-b02d-9af8fd337236-kube-api-access-vw8j6\") pod \"console-operator-565b7b569d-vh5dp\" (UID: \"2d624703-978f-48c2-b02d-9af8fd337236\") " pod="openshift-console-operator/console-operator-565b7b569d-vh5dp"
Jul 23 13:41:04.119293 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.118454    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b13a7207-47ba-4e8e-a62b-97546e957cdd-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-25jdb\" (UID: \"b13a7207-47ba-4e8e-a62b-97546e957cdd\") " pod="openshift-insights/insights-operator-555d9d7885-25jdb"
Jul 23 13:41:04.119293 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.119036    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/62b09fb2-689e-433b-8621-d6ee876b59a6-config-volume\") pod \"dns-default-v878n\" (UID: \"62b09fb2-689e-433b-8621-d6ee876b59a6\") " pod="openshift-dns/dns-default-v878n"
Jul 23 13:41:04.119293 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:04.119137    2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 23 13:41:04.119661 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.119430    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b13a7207-47ba-4e8e-a62b-97546e957cdd-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-25jdb\" (UID: \"b13a7207-47ba-4e8e-a62b-97546e957cdd\") " pod="openshift-insights/insights-operator-555d9d7885-25jdb"
Jul 23 13:41:04.119661 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:04.119471    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 13:41:04.120702 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:04.119778    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e22af39-dd90-473a-9802-abfb83870e38-metrics-certs podName:0e22af39-dd90-473a-9802-abfb83870e38 nodeName:}" failed. No retries permitted until 2026-07-23 13:41:04.619183565 +0000 UTC m=+36.058684477 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0e22af39-dd90-473a-9802-abfb83870e38-metrics-certs") pod "router-default-66578b4c86-6vhrf" (UID: "0e22af39-dd90-473a-9802-abfb83870e38") : secret "router-metrics-certs-default" not found
Jul 23 13:41:04.120702 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:04.119885    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62b09fb2-689e-433b-8621-d6ee876b59a6-metrics-tls podName:62b09fb2-689e-433b-8621-d6ee876b59a6 nodeName:}" failed. No retries permitted until 2026-07-23 13:41:04.619868789 +0000 UTC m=+36.059369691 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/62b09fb2-689e-433b-8621-d6ee876b59a6-metrics-tls") pod "dns-default-v878n" (UID: "62b09fb2-689e-433b-8621-d6ee876b59a6") : secret "dns-default-metrics-tls" not found
Jul 23 13:41:04.120702 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:04.120070    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0e22af39-dd90-473a-9802-abfb83870e38-service-ca-bundle podName:0e22af39-dd90-473a-9802-abfb83870e38 nodeName:}" failed. No retries permitted until 2026-07-23 13:41:04.620052822 +0000 UTC m=+36.059553732 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0e22af39-dd90-473a-9802-abfb83870e38-service-ca-bundle") pod "router-default-66578b4c86-6vhrf" (UID: "0e22af39-dd90-473a-9802-abfb83870e38") : configmap references non-existent config key: service-ca.crt
Jul 23 13:41:04.120702 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.120098    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b13a7207-47ba-4e8e-a62b-97546e957cdd-snapshots\") pod \"insights-operator-555d9d7885-25jdb\" (UID: \"b13a7207-47ba-4e8e-a62b-97546e957cdd\") " pod="openshift-insights/insights-operator-555d9d7885-25jdb"
Jul 23 13:41:04.120702 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.120153    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/96de4e50-4208-4f42-ab50-0a702232ff33-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-jxgw7\" (UID: \"96de4e50-4208-4f42-ab50-0a702232ff33\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-jxgw7"
Jul 23 13:41:04.120702 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:04.120206    2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 23 13:41:04.120702 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:04.120252    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96de4e50-4208-4f42-ab50-0a702232ff33-cluster-monitoring-operator-tls podName:96de4e50-4208-4f42-ab50-0a702232ff33 nodeName:}" failed. No retries permitted until 2026-07-23 13:41:04.620237781 +0000 UTC m=+36.059738694 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/96de4e50-4208-4f42-ab50-0a702232ff33-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-jxgw7" (UID: "96de4e50-4208-4f42-ab50-0a702232ff33") : secret "cluster-monitoring-operator-tls" not found
Jul 23 13:41:04.120702 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.120630    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b13a7207-47ba-4e8e-a62b-97546e957cdd-tmp\") pod \"insights-operator-555d9d7885-25jdb\" (UID: \"b13a7207-47ba-4e8e-a62b-97546e957cdd\") " pod="openshift-insights/insights-operator-555d9d7885-25jdb"
Jul 23 13:41:04.121174 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.120938    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b13a7207-47ba-4e8e-a62b-97546e957cdd-service-ca-bundle\") pod \"insights-operator-555d9d7885-25jdb\" (UID: \"b13a7207-47ba-4e8e-a62b-97546e957cdd\") " pod="openshift-insights/insights-operator-555d9d7885-25jdb"
Jul 23 13:41:04.121174 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.121089    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0e22af39-dd90-473a-9802-abfb83870e38-default-certificate\") pod \"router-default-66578b4c86-6vhrf\" (UID: \"0e22af39-dd90-473a-9802-abfb83870e38\") " pod="openshift-ingress/router-default-66578b4c86-6vhrf"
Jul 23 13:41:04.121174 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.121157    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0825a9ee-4ce9-460c-90a2-6e285f9adc51-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-7zf2f\" (UID: \"0825a9ee-4ce9-460c-90a2-6e285f9adc51\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-7zf2f"
Jul 23 13:41:04.121398 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.121377    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2d624703-978f-48c2-b02d-9af8fd337236-trusted-ca\") pod \"console-operator-565b7b569d-vh5dp\" (UID: \"2d624703-978f-48c2-b02d-9af8fd337236\") " pod="openshift-console-operator/console-operator-565b7b569d-vh5dp"
Jul 23 13:41:04.122054 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.121958    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2d624703-978f-48c2-b02d-9af8fd337236-config\") pod \"console-operator-565b7b569d-vh5dp\" (UID: \"2d624703-978f-48c2-b02d-9af8fd337236\") " pod="openshift-console-operator/console-operator-565b7b569d-vh5dp"
Jul 23 13:41:04.122157 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.122113    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bcc90ce2-5ae1-44ce-8842-aa5e7f477776-config\") pod \"service-ca-operator-5bcbc94c78-jmlv7\" (UID: \"bcc90ce2-5ae1-44ce-8842-aa5e7f477776\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-jmlv7"
Jul 23 13:41:04.122224 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.122167    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2d624703-978f-48c2-b02d-9af8fd337236-serving-cert\") pod \"console-operator-565b7b569d-vh5dp\" (UID: \"2d624703-978f-48c2-b02d-9af8fd337236\") " pod="openshift-console-operator/console-operator-565b7b569d-vh5dp"
Jul 23 13:41:04.123509 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.123485    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0825a9ee-4ce9-460c-90a2-6e285f9adc51-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-7zf2f\" (UID: \"0825a9ee-4ce9-460c-90a2-6e285f9adc51\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-7zf2f"
Jul 23 13:41:04.123821 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.123797    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bcc90ce2-5ae1-44ce-8842-aa5e7f477776-serving-cert\") pod \"service-ca-operator-5bcbc94c78-jmlv7\" (UID: \"bcc90ce2-5ae1-44ce-8842-aa5e7f477776\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-jmlv7"
Jul 23 13:41:04.124303 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.124277    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0e22af39-dd90-473a-9802-abfb83870e38-stats-auth\") pod \"router-default-66578b4c86-6vhrf\" (UID: \"0e22af39-dd90-473a-9802-abfb83870e38\") " pod="openshift-ingress/router-default-66578b4c86-6vhrf"
Jul 23 13:41:04.124489 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.124463    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5d49627b-4f13-46b6-a3a2-da958eb12319-cert\") pod \"ingress-canary-98w4s\" (UID: \"5d49627b-4f13-46b6-a3a2-da958eb12319\") " pod="openshift-ingress-canary/ingress-canary-98w4s"
Jul 23 13:41:04.124967 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.124928    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b13a7207-47ba-4e8e-a62b-97546e957cdd-serving-cert\") pod \"insights-operator-555d9d7885-25jdb\" (UID: \"b13a7207-47ba-4e8e-a62b-97546e957cdd\") " pod="openshift-insights/insights-operator-555d9d7885-25jdb"
Jul 23 13:41:04.129072 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.129049    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vw8j6\" (UniqueName: \"kubernetes.io/projected/2d624703-978f-48c2-b02d-9af8fd337236-kube-api-access-vw8j6\") pod \"console-operator-565b7b569d-vh5dp\" (UID: \"2d624703-978f-48c2-b02d-9af8fd337236\") " pod="openshift-console-operator/console-operator-565b7b569d-vh5dp"
Jul 23 13:41:04.129194 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.129166    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6cqw\" (UniqueName: \"kubernetes.io/projected/bcc90ce2-5ae1-44ce-8842-aa5e7f477776-kube-api-access-d6cqw\") pod \"service-ca-operator-5bcbc94c78-jmlv7\" (UID: \"bcc90ce2-5ae1-44ce-8842-aa5e7f477776\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-jmlv7"
Jul 23 13:41:04.129263 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.129205    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwrmp\" (UniqueName: \"kubernetes.io/projected/62b09fb2-689e-433b-8621-d6ee876b59a6-kube-api-access-qwrmp\") pod \"dns-default-v878n\" (UID: \"62b09fb2-689e-433b-8621-d6ee876b59a6\") " pod="openshift-dns/dns-default-v878n"
Jul 23 13:41:04.129439 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.129422    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlwcr\" (UniqueName: \"kubernetes.io/projected/05483fd5-7d32-4631-b508-951081e51e6f-kube-api-access-jlwcr\") pod \"network-check-source-7bc5b6bf85-zf6lz\" (UID: \"05483fd5-7d32-4631-b508-951081e51e6f\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-zf6lz"
Jul 23 13:41:04.131041 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.131007    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6sld\" (UniqueName: \"kubernetes.io/projected/0825a9ee-4ce9-460c-90a2-6e285f9adc51-kube-api-access-x6sld\") pod \"kube-storage-version-migrator-operator-7658d9b749-7zf2f\" (UID: \"0825a9ee-4ce9-460c-90a2-6e285f9adc51\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-7zf2f"
Jul 23 13:41:04.131269 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.131212    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8m6t6\" (UniqueName: \"kubernetes.io/projected/5d49627b-4f13-46b6-a3a2-da958eb12319-kube-api-access-8m6t6\") pod \"ingress-canary-98w4s\" (UID: \"5d49627b-4f13-46b6-a3a2-da958eb12319\") " pod="openshift-ingress-canary/ingress-canary-98w4s"
Jul 23 13:41:04.132933 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.132908    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5grb\" (UniqueName: \"kubernetes.io/projected/001764b2-a882-42f4-9ef6-2ea7066febd7-kube-api-access-h5grb\") pod \"volume-data-source-validator-78cf4c6f6-7rvsv\" (UID: \"001764b2-a882-42f4-9ef6-2ea7066febd7\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-7rvsv"
Jul 23 13:41:04.133406 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.133363    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hfjj\" (UniqueName: \"kubernetes.io/projected/0e22af39-dd90-473a-9802-abfb83870e38-kube-api-access-4hfjj\") pod \"router-default-66578b4c86-6vhrf\" (UID: \"0e22af39-dd90-473a-9802-abfb83870e38\") " pod="openshift-ingress/router-default-66578b4c86-6vhrf"
Jul 23 13:41:04.133482 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.133421    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5sr6\" (UniqueName: \"kubernetes.io/projected/b13a7207-47ba-4e8e-a62b-97546e957cdd-kube-api-access-b5sr6\") pod \"insights-operator-555d9d7885-25jdb\" (UID: \"b13a7207-47ba-4e8e-a62b-97546e957cdd\") " pod="openshift-insights/insights-operator-555d9d7885-25jdb"
Jul 23 13:41:04.134233 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.134210    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkppd\" (UniqueName: \"kubernetes.io/projected/96de4e50-4208-4f42-ab50-0a702232ff33-kube-api-access-zkppd\") pod \"cluster-monitoring-operator-76cf8966f8-jxgw7\" (UID: \"96de4e50-4208-4f42-ab50-0a702232ff33\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-jxgw7"
Jul 23 13:41:04.199975 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.199924    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:04.241101 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.241056    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-vh5dp"
Jul 23 13:41:04.262405 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.262372    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-7rvsv"
Jul 23 13:41:04.272446 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.272420    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-7zf2f"
Jul 23 13:41:04.286608 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.286583    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-25jdb"
Jul 23 13:41:04.293935 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.293910    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-jmlv7"
Jul 23 13:41:04.310124 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.310086    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-zf6lz"
Jul 23 13:41:04.317122 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.317099    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-98w4s"
Jul 23 13:41:04.522607 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.522509    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/85626da9-b35f-48f6-b12e-02554ac1b7e1-registry-tls\") pod \"image-registry-6db7654c99-dnmqb\" (UID: \"85626da9-b35f-48f6-b12e-02554ac1b7e1\") " pod="openshift-image-registry/image-registry-6db7654c99-dnmqb"
Jul 23 13:41:04.522762 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.522646    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e20c5716-9825-474c-86cc-f4d8251ab64c-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-prghh\" (UID: \"e20c5716-9825-474c-86cc-f4d8251ab64c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-prghh"
Jul 23 13:41:04.522762 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:04.522662    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 13:41:04.522762 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:04.522685    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6db7654c99-dnmqb: secret "image-registry-tls" not found
Jul 23 13:41:04.522762 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:04.522757    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/85626da9-b35f-48f6-b12e-02554ac1b7e1-registry-tls podName:85626da9-b35f-48f6-b12e-02554ac1b7e1 nodeName:}" failed. No retries permitted until 2026-07-23 13:41:05.522735889 +0000 UTC m=+36.962236790 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/85626da9-b35f-48f6-b12e-02554ac1b7e1-registry-tls") pod "image-registry-6db7654c99-dnmqb" (UID: "85626da9-b35f-48f6-b12e-02554ac1b7e1") : secret "image-registry-tls" not found
Jul 23 13:41:04.522985 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:04.522773    2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 23 13:41:04.522985 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:04.522819    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e20c5716-9825-474c-86cc-f4d8251ab64c-samples-operator-tls podName:e20c5716-9825-474c-86cc-f4d8251ab64c nodeName:}" failed. No retries permitted until 2026-07-23 13:41:05.522807202 +0000 UTC m=+36.962308100 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e20c5716-9825-474c-86cc-f4d8251ab64c-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-prghh" (UID: "e20c5716-9825-474c-86cc-f4d8251ab64c") : secret "samples-operator-tls" not found
Jul 23 13:41:04.624047 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.623990    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/62b09fb2-689e-433b-8621-d6ee876b59a6-metrics-tls\") pod \"dns-default-v878n\" (UID: \"62b09fb2-689e-433b-8621-d6ee876b59a6\") " pod="openshift-dns/dns-default-v878n"
Jul 23 13:41:04.624247 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.624125    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e22af39-dd90-473a-9802-abfb83870e38-metrics-certs\") pod \"router-default-66578b4c86-6vhrf\" (UID: \"0e22af39-dd90-473a-9802-abfb83870e38\") " pod="openshift-ingress/router-default-66578b4c86-6vhrf"
Jul 23 13:41:04.624247 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.624169    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e22af39-dd90-473a-9802-abfb83870e38-service-ca-bundle\") pod \"router-default-66578b4c86-6vhrf\" (UID: \"0e22af39-dd90-473a-9802-abfb83870e38\") " pod="openshift-ingress/router-default-66578b4c86-6vhrf"
Jul 23 13:41:04.624247 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:04.624181    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 13:41:04.624387 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:04.624254    2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 23 13:41:04.624387 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:04.624258    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62b09fb2-689e-433b-8621-d6ee876b59a6-metrics-tls podName:62b09fb2-689e-433b-8621-d6ee876b59a6 nodeName:}" failed. No retries permitted until 2026-07-23 13:41:05.624236501 +0000 UTC m=+37.063737400 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/62b09fb2-689e-433b-8621-d6ee876b59a6-metrics-tls") pod "dns-default-v878n" (UID: "62b09fb2-689e-433b-8621-d6ee876b59a6") : secret "dns-default-metrics-tls" not found
Jul 23 13:41:04.624387 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:04.624314    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/96de4e50-4208-4f42-ab50-0a702232ff33-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-jxgw7\" (UID: \"96de4e50-4208-4f42-ab50-0a702232ff33\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-jxgw7"
Jul 23 13:41:04.624387 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:04.624354    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0e22af39-dd90-473a-9802-abfb83870e38-service-ca-bundle podName:0e22af39-dd90-473a-9802-abfb83870e38 nodeName:}" failed. No retries permitted until 2026-07-23 13:41:05.624339186 +0000 UTC m=+37.063840088 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0e22af39-dd90-473a-9802-abfb83870e38-service-ca-bundle") pod "router-default-66578b4c86-6vhrf" (UID: "0e22af39-dd90-473a-9802-abfb83870e38") : configmap references non-existent config key: service-ca.crt
Jul 23 13:41:04.624583 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:04.624411    2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 23 13:41:04.624583 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:04.624428    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e22af39-dd90-473a-9802-abfb83870e38-metrics-certs podName:0e22af39-dd90-473a-9802-abfb83870e38 nodeName:}" failed. No retries permitted until 2026-07-23 13:41:05.624416873 +0000 UTC m=+37.063917774 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0e22af39-dd90-473a-9802-abfb83870e38-metrics-certs") pod "router-default-66578b4c86-6vhrf" (UID: "0e22af39-dd90-473a-9802-abfb83870e38") : secret "router-metrics-certs-default" not found
Jul 23 13:41:04.624583 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:04.624455    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96de4e50-4208-4f42-ab50-0a702232ff33-cluster-monitoring-operator-tls podName:96de4e50-4208-4f42-ab50-0a702232ff33 nodeName:}" failed. No retries permitted until 2026-07-23 13:41:05.624442819 +0000 UTC m=+37.063943724 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/96de4e50-4208-4f42-ab50-0a702232ff33-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-jxgw7" (UID: "96de4e50-4208-4f42-ab50-0a702232ff33") : secret "cluster-monitoring-operator-tls" not found
Jul 23 13:41:05.385684 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:05.384052    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-25jdb"]
Jul 23 13:41:05.389060 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:05.388737    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-7rvsv"]
Jul 23 13:41:05.417187 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:05.417155    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-vh5dp"]
Jul 23 13:41:05.420345 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:41:05.420318    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d624703_978f_48c2_b02d_9af8fd337236.slice/crio-2974471f507bedc18a67b26efaef7e79ab87ba6ba0cfc2274803a2305dd73846 WatchSource:0}: Error finding container 2974471f507bedc18a67b26efaef7e79ab87ba6ba0cfc2274803a2305dd73846: Status 404 returned error can't find the container with id 2974471f507bedc18a67b26efaef7e79ab87ba6ba0cfc2274803a2305dd73846
Jul 23 13:41:05.427774 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:05.427742    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-zf6lz"]
Jul 23 13:41:05.431333 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:05.431310    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-7zf2f"]
Jul 23 13:41:05.440096 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:05.440069    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-jmlv7"]
Jul 23 13:41:05.443813 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:05.443789    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-98w4s"]
Jul 23 13:41:05.448121 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:41:05.448090    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05483fd5_7d32_4631_b508_951081e51e6f.slice/crio-d2a28875000778c7e81033b177e26b7df2f6a57952cfd7f1765dfd95506d5b14 WatchSource:0}: Error finding container d2a28875000778c7e81033b177e26b7df2f6a57952cfd7f1765dfd95506d5b14: Status 404 returned error can't find the container with id d2a28875000778c7e81033b177e26b7df2f6a57952cfd7f1765dfd95506d5b14
Jul 23 13:41:05.449072 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:41:05.449004    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcc90ce2_5ae1_44ce_8842_aa5e7f477776.slice/crio-e7176020d1c9f2108af59436e43d8b1375a4310b14dbf5c8e8259769ac307f7b WatchSource:0}: Error finding container e7176020d1c9f2108af59436e43d8b1375a4310b14dbf5c8e8259769ac307f7b: Status 404 returned error can't find the container with id e7176020d1c9f2108af59436e43d8b1375a4310b14dbf5c8e8259769ac307f7b
Jul 23 13:41:05.449634 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:41:05.449612    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d49627b_4f13_46b6_a3a2_da958eb12319.slice/crio-edda6eb42eca80647b8d1b1d0612a30e11b2c0e59e6f838e813a8b32c3e73578 WatchSource:0}: Error finding container edda6eb42eca80647b8d1b1d0612a30e11b2c0e59e6f838e813a8b32c3e73578: Status 404 returned error can't find the container with id edda6eb42eca80647b8d1b1d0612a30e11b2c0e59e6f838e813a8b32c3e73578
Jul 23 13:41:05.451165 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:41:05.450984    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0825a9ee_4ce9_460c_90a2_6e285f9adc51.slice/crio-0dc02279b45951b9310183faa716ff76c6ac12ac7d478fa3da62e4c15f8b8bcd WatchSource:0}: Error finding container 0dc02279b45951b9310183faa716ff76c6ac12ac7d478fa3da62e4c15f8b8bcd: Status 404 returned error can't find the container with id 0dc02279b45951b9310183faa716ff76c6ac12ac7d478fa3da62e4c15f8b8bcd
Jul 23 13:41:05.536490 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:05.536459    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e20c5716-9825-474c-86cc-f4d8251ab64c-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-prghh\" (UID: \"e20c5716-9825-474c-86cc-f4d8251ab64c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-prghh"
Jul 23 13:41:05.536632 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:05.536544    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/85626da9-b35f-48f6-b12e-02554ac1b7e1-registry-tls\") pod \"image-registry-6db7654c99-dnmqb\" (UID: \"85626da9-b35f-48f6-b12e-02554ac1b7e1\") " pod="openshift-image-registry/image-registry-6db7654c99-dnmqb"
Jul 23 13:41:05.536632 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:05.536614    2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 23 13:41:05.536706 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:05.536694    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e20c5716-9825-474c-86cc-f4d8251ab64c-samples-operator-tls podName:e20c5716-9825-474c-86cc-f4d8251ab64c nodeName:}" failed. No retries permitted until 2026-07-23 13:41:07.536675673 +0000 UTC m=+38.976176640 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e20c5716-9825-474c-86cc-f4d8251ab64c-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-prghh" (UID: "e20c5716-9825-474c-86cc-f4d8251ab64c") : secret "samples-operator-tls" not found
Jul 23 13:41:05.536706 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:05.536696    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 13:41:05.536776 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:05.536715    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6db7654c99-dnmqb: secret "image-registry-tls" not found
Jul 23 13:41:05.536776 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:05.536762    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/85626da9-b35f-48f6-b12e-02554ac1b7e1-registry-tls podName:85626da9-b35f-48f6-b12e-02554ac1b7e1 nodeName:}" failed. No retries permitted until 2026-07-23 13:41:07.536746573 +0000 UTC m=+38.976247497 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/85626da9-b35f-48f6-b12e-02554ac1b7e1-registry-tls") pod "image-registry-6db7654c99-dnmqb" (UID: "85626da9-b35f-48f6-b12e-02554ac1b7e1") : secret "image-registry-tls" not found
Jul 23 13:41:05.637383 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:05.637293    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/62b09fb2-689e-433b-8621-d6ee876b59a6-metrics-tls\") pod \"dns-default-v878n\" (UID: \"62b09fb2-689e-433b-8621-d6ee876b59a6\") " pod="openshift-dns/dns-default-v878n"
Jul 23 13:41:05.637383 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:05.637354    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e22af39-dd90-473a-9802-abfb83870e38-metrics-certs\") pod \"router-default-66578b4c86-6vhrf\" (UID: \"0e22af39-dd90-473a-9802-abfb83870e38\") " pod="openshift-ingress/router-default-66578b4c86-6vhrf"
Jul 23 13:41:05.637603 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:05.637390    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e22af39-dd90-473a-9802-abfb83870e38-service-ca-bundle\") pod \"router-default-66578b4c86-6vhrf\" (UID: \"0e22af39-dd90-473a-9802-abfb83870e38\") " pod="openshift-ingress/router-default-66578b4c86-6vhrf"
Jul 23 13:41:05.637603 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:05.637439    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/96de4e50-4208-4f42-ab50-0a702232ff33-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-jxgw7\" (UID: \"96de4e50-4208-4f42-ab50-0a702232ff33\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-jxgw7"
Jul 23 13:41:05.637603 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:05.637469    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 13:41:05.637603 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:05.637510    2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 23 13:41:05.637603 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:05.637544    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62b09fb2-689e-433b-8621-d6ee876b59a6-metrics-tls podName:62b09fb2-689e-433b-8621-d6ee876b59a6 nodeName:}" failed. No retries permitted until 2026-07-23 13:41:07.637520867 +0000 UTC m=+39.077021763 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/62b09fb2-689e-433b-8621-d6ee876b59a6-metrics-tls") pod "dns-default-v878n" (UID: "62b09fb2-689e-433b-8621-d6ee876b59a6") : secret "dns-default-metrics-tls" not found
Jul 23 13:41:05.637603 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:05.637564    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0e22af39-dd90-473a-9802-abfb83870e38-service-ca-bundle podName:0e22af39-dd90-473a-9802-abfb83870e38 nodeName:}" failed. No retries permitted until 2026-07-23 13:41:07.637553869 +0000 UTC m=+39.077054768 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0e22af39-dd90-473a-9802-abfb83870e38-service-ca-bundle") pod "router-default-66578b4c86-6vhrf" (UID: "0e22af39-dd90-473a-9802-abfb83870e38") : configmap references non-existent config key: service-ca.crt
Jul 23 13:41:05.637603 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:05.637567    2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 23 13:41:05.637603 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:05.637579    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e22af39-dd90-473a-9802-abfb83870e38-metrics-certs podName:0e22af39-dd90-473a-9802-abfb83870e38 nodeName:}" failed. No retries permitted until 2026-07-23 13:41:07.637571343 +0000 UTC m=+39.077072243 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0e22af39-dd90-473a-9802-abfb83870e38-metrics-certs") pod "router-default-66578b4c86-6vhrf" (UID: "0e22af39-dd90-473a-9802-abfb83870e38") : secret "router-metrics-certs-default" not found
Jul 23 13:41:05.637603 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:05.637603    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96de4e50-4208-4f42-ab50-0a702232ff33-cluster-monitoring-operator-tls podName:96de4e50-4208-4f42-ab50-0a702232ff33 nodeName:}" failed. No retries permitted until 2026-07-23 13:41:07.637591721 +0000 UTC m=+39.077092619 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/96de4e50-4208-4f42-ab50-0a702232ff33-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-jxgw7" (UID: "96de4e50-4208-4f42-ab50-0a702232ff33") : secret "cluster-monitoring-operator-tls" not found
Jul 23 13:41:06.236892 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:06.236792    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-7rvsv" event={"ID":"001764b2-a882-42f4-9ef6-2ea7066febd7","Type":"ContainerStarted","Data":"c504a843fa55f937deadb57a6cd891876daa0bc03677a837b8f17a95dc343a52"}
Jul 23 13:41:06.238669 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:06.238601    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-98w4s" event={"ID":"5d49627b-4f13-46b6-a3a2-da958eb12319","Type":"ContainerStarted","Data":"edda6eb42eca80647b8d1b1d0612a30e11b2c0e59e6f838e813a8b32c3e73578"}
Jul 23 13:41:06.245030 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:06.244946    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-vh5dp" event={"ID":"2d624703-978f-48c2-b02d-9af8fd337236","Type":"ContainerStarted","Data":"2974471f507bedc18a67b26efaef7e79ab87ba6ba0cfc2274803a2305dd73846"}
Jul 23 13:41:06.248982 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:06.248915    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-jmlv7" event={"ID":"bcc90ce2-5ae1-44ce-8842-aa5e7f477776","Type":"ContainerStarted","Data":"e7176020d1c9f2108af59436e43d8b1375a4310b14dbf5c8e8259769ac307f7b"}
Jul 23 13:41:06.251089 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:06.251064    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-25jdb" event={"ID":"b13a7207-47ba-4e8e-a62b-97546e957cdd","Type":"ContainerStarted","Data":"44893af0305bb5b19e6f29a2218d1df1bef01d963c7c4d6b38d40a70cfbb068b"}
Jul 23 13:41:06.256415 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:06.256390    2573 generic.go:356] "Generic (PLEG): container finished" podID="e492bdc2-dfd1-4b82-a8fc-37f82765cdb4" containerID="09e6c00c8c43cb593c668d7ad863d7a1194c196322a5780bd4532a45caa2536d" exitCode=0
Jul 23 13:41:06.256514 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:06.256460    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-65xv7" event={"ID":"e492bdc2-dfd1-4b82-a8fc-37f82765cdb4","Type":"ContainerDied","Data":"09e6c00c8c43cb593c668d7ad863d7a1194c196322a5780bd4532a45caa2536d"}
Jul 23 13:41:06.264492 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:06.264466    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-7zf2f" event={"ID":"0825a9ee-4ce9-460c-90a2-6e285f9adc51","Type":"ContainerStarted","Data":"0dc02279b45951b9310183faa716ff76c6ac12ac7d478fa3da62e4c15f8b8bcd"}
Jul 23 13:41:06.275030 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:06.269319    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-zf6lz" event={"ID":"05483fd5-7d32-4631-b508-951081e51e6f","Type":"ContainerStarted","Data":"d2a28875000778c7e81033b177e26b7df2f6a57952cfd7f1765dfd95506d5b14"}
Jul 23 13:41:07.282857 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:07.282617    2573 generic.go:356] "Generic (PLEG): container finished" podID="e492bdc2-dfd1-4b82-a8fc-37f82765cdb4" containerID="55ec5d35c0b50bbe4bccbd470b8cf20fd3f8372f209b66350a432a05fa790f68" exitCode=0
Jul 23 13:41:07.283321 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:07.282879    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-65xv7" event={"ID":"e492bdc2-dfd1-4b82-a8fc-37f82765cdb4","Type":"ContainerDied","Data":"55ec5d35c0b50bbe4bccbd470b8cf20fd3f8372f209b66350a432a05fa790f68"}
Jul 23 13:41:07.560609 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:07.560571    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/85626da9-b35f-48f6-b12e-02554ac1b7e1-registry-tls\") pod \"image-registry-6db7654c99-dnmqb\" (UID: \"85626da9-b35f-48f6-b12e-02554ac1b7e1\") " pod="openshift-image-registry/image-registry-6db7654c99-dnmqb"
Jul 23 13:41:07.560792 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:07.560747    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e20c5716-9825-474c-86cc-f4d8251ab64c-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-prghh\" (UID: \"e20c5716-9825-474c-86cc-f4d8251ab64c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-prghh"
Jul 23 13:41:07.560931 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:07.560914    2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 23 13:41:07.560993 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:07.560983    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e20c5716-9825-474c-86cc-f4d8251ab64c-samples-operator-tls podName:e20c5716-9825-474c-86cc-f4d8251ab64c nodeName:}" failed. No retries permitted until 2026-07-23 13:41:11.560964782 +0000 UTC m=+43.000465679 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e20c5716-9825-474c-86cc-f4d8251ab64c-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-prghh" (UID: "e20c5716-9825-474c-86cc-f4d8251ab64c") : secret "samples-operator-tls" not found
Jul 23 13:41:07.561461 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:07.561440    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 13:41:07.561561 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:07.561464    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6db7654c99-dnmqb: secret "image-registry-tls" not found
Jul 23 13:41:07.561561 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:07.561513    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/85626da9-b35f-48f6-b12e-02554ac1b7e1-registry-tls podName:85626da9-b35f-48f6-b12e-02554ac1b7e1 nodeName:}" failed. No retries permitted until 2026-07-23 13:41:11.56149802 +0000 UTC m=+43.000998921 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/85626da9-b35f-48f6-b12e-02554ac1b7e1-registry-tls") pod "image-registry-6db7654c99-dnmqb" (UID: "85626da9-b35f-48f6-b12e-02554ac1b7e1") : secret "image-registry-tls" not found
Jul 23 13:41:07.661940 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:07.661902    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/62b09fb2-689e-433b-8621-d6ee876b59a6-metrics-tls\") pod \"dns-default-v878n\" (UID: \"62b09fb2-689e-433b-8621-d6ee876b59a6\") " pod="openshift-dns/dns-default-v878n"
Jul 23 13:41:07.662137 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:07.662005    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e22af39-dd90-473a-9802-abfb83870e38-metrics-certs\") pod \"router-default-66578b4c86-6vhrf\" (UID: \"0e22af39-dd90-473a-9802-abfb83870e38\") " pod="openshift-ingress/router-default-66578b4c86-6vhrf"
Jul 23 13:41:07.662137 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:07.662063    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e22af39-dd90-473a-9802-abfb83870e38-service-ca-bundle\") pod \"router-default-66578b4c86-6vhrf\" (UID: \"0e22af39-dd90-473a-9802-abfb83870e38\") " pod="openshift-ingress/router-default-66578b4c86-6vhrf"
Jul 23 13:41:07.662266 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:07.662146    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/96de4e50-4208-4f42-ab50-0a702232ff33-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-jxgw7\" (UID: \"96de4e50-4208-4f42-ab50-0a702232ff33\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-jxgw7"
Jul 23 13:41:07.662319 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:07.662303    2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 23 13:41:07.662687 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:07.662377    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96de4e50-4208-4f42-ab50-0a702232ff33-cluster-monitoring-operator-tls podName:96de4e50-4208-4f42-ab50-0a702232ff33 nodeName:}" failed. No retries permitted until 2026-07-23 13:41:11.662356357 +0000 UTC m=+43.101857257 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/96de4e50-4208-4f42-ab50-0a702232ff33-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-jxgw7" (UID: "96de4e50-4208-4f42-ab50-0a702232ff33") : secret "cluster-monitoring-operator-tls" not found
Jul 23 13:41:07.662687 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:07.662465    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0e22af39-dd90-473a-9802-abfb83870e38-service-ca-bundle podName:0e22af39-dd90-473a-9802-abfb83870e38 nodeName:}" failed. No retries permitted until 2026-07-23 13:41:11.662453998 +0000 UTC m=+43.101954899 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0e22af39-dd90-473a-9802-abfb83870e38-service-ca-bundle") pod "router-default-66578b4c86-6vhrf" (UID: "0e22af39-dd90-473a-9802-abfb83870e38") : configmap references non-existent config key: service-ca.crt
Jul 23 13:41:07.662687 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:07.662484    2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 23 13:41:07.662687 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:07.662551    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e22af39-dd90-473a-9802-abfb83870e38-metrics-certs podName:0e22af39-dd90-473a-9802-abfb83870e38 nodeName:}" failed. No retries permitted until 2026-07-23 13:41:11.662533176 +0000 UTC m=+43.102034088 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0e22af39-dd90-473a-9802-abfb83870e38-metrics-certs") pod "router-default-66578b4c86-6vhrf" (UID: "0e22af39-dd90-473a-9802-abfb83870e38") : secret "router-metrics-certs-default" not found
Jul 23 13:41:07.662687 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:07.662619    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 13:41:07.662687 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:07.662657    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62b09fb2-689e-433b-8621-d6ee876b59a6-metrics-tls podName:62b09fb2-689e-433b-8621-d6ee876b59a6 nodeName:}" failed. No retries permitted until 2026-07-23 13:41:11.662646022 +0000 UTC m=+43.102146920 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/62b09fb2-689e-433b-8621-d6ee876b59a6-metrics-tls") pod "dns-default-v878n" (UID: "62b09fb2-689e-433b-8621-d6ee876b59a6") : secret "dns-default-metrics-tls" not found
Jul 23 13:41:08.290297 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:08.290259    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-65xv7" event={"ID":"e492bdc2-dfd1-4b82-a8fc-37f82765cdb4","Type":"ContainerStarted","Data":"6488c2825258f6d6c800b06d23776dbfc0220148125e6efc956507deb84c9ce0"}
Jul 23 13:41:08.318155 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:08.318093    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-65xv7" podStartSLOduration=9.323497194 podStartE2EDuration="39.318070834s" totalImagesPullingTime="29.99457364s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 13:40:29 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:41:08.316503769 +0000 UTC m=+39.756004690" watchObservedRunningTime="2026-07-23 13:41:08.318070834 +0000 UTC m=+39.757571755"
Jul 23 13:41:08.440934 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:08.440899    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:08.504740 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:08.504703    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:08.857472 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:08.857412    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:08.958489 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:08.958455    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:11.016648 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:11.016606    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:11.117204 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:11.117160    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:11.593262 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:11.593220    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e20c5716-9825-474c-86cc-f4d8251ab64c-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-prghh\" (UID: \"e20c5716-9825-474c-86cc-f4d8251ab64c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-prghh"
Jul 23 13:41:11.593412 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:11.593289    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/85626da9-b35f-48f6-b12e-02554ac1b7e1-registry-tls\") pod \"image-registry-6db7654c99-dnmqb\" (UID: \"85626da9-b35f-48f6-b12e-02554ac1b7e1\") " pod="openshift-image-registry/image-registry-6db7654c99-dnmqb"
Jul 23 13:41:11.593412 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:11.593373    2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 23 13:41:11.593412 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:11.593399    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 13:41:11.593412 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:11.593410    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6db7654c99-dnmqb: secret "image-registry-tls" not found
Jul 23 13:41:11.593544 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:11.593441    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e20c5716-9825-474c-86cc-f4d8251ab64c-samples-operator-tls podName:e20c5716-9825-474c-86cc-f4d8251ab64c nodeName:}" failed. No retries permitted until 2026-07-23 13:41:19.593425249 +0000 UTC m=+51.032926147 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e20c5716-9825-474c-86cc-f4d8251ab64c-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-prghh" (UID: "e20c5716-9825-474c-86cc-f4d8251ab64c") : secret "samples-operator-tls" not found
Jul 23 13:41:11.593544 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:11.593455    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/85626da9-b35f-48f6-b12e-02554ac1b7e1-registry-tls podName:85626da9-b35f-48f6-b12e-02554ac1b7e1 nodeName:}" failed. No retries permitted until 2026-07-23 13:41:19.593448882 +0000 UTC m=+51.032949779 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/85626da9-b35f-48f6-b12e-02554ac1b7e1-registry-tls") pod "image-registry-6db7654c99-dnmqb" (UID: "85626da9-b35f-48f6-b12e-02554ac1b7e1") : secret "image-registry-tls" not found
Jul 23 13:41:11.694245 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:11.694215    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e22af39-dd90-473a-9802-abfb83870e38-metrics-certs\") pod \"router-default-66578b4c86-6vhrf\" (UID: \"0e22af39-dd90-473a-9802-abfb83870e38\") " pod="openshift-ingress/router-default-66578b4c86-6vhrf"
Jul 23 13:41:11.694435 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:11.694255    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e22af39-dd90-473a-9802-abfb83870e38-service-ca-bundle\") pod \"router-default-66578b4c86-6vhrf\" (UID: \"0e22af39-dd90-473a-9802-abfb83870e38\") " pod="openshift-ingress/router-default-66578b4c86-6vhrf"
Jul 23 13:41:11.694435 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:11.694330    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/96de4e50-4208-4f42-ab50-0a702232ff33-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-jxgw7\" (UID: \"96de4e50-4208-4f42-ab50-0a702232ff33\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-jxgw7"
Jul 23 13:41:11.694435 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:11.694390    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/62b09fb2-689e-433b-8621-d6ee876b59a6-metrics-tls\") pod \"dns-default-v878n\" (UID: \"62b09fb2-689e-433b-8621-d6ee876b59a6\") " pod="openshift-dns/dns-default-v878n"
Jul 23 13:41:11.694435 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:11.694397    2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 23 13:41:11.694650 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:11.694474    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e22af39-dd90-473a-9802-abfb83870e38-metrics-certs podName:0e22af39-dd90-473a-9802-abfb83870e38 nodeName:}" failed. No retries permitted until 2026-07-23 13:41:19.694453025 +0000 UTC m=+51.133953951 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0e22af39-dd90-473a-9802-abfb83870e38-metrics-certs") pod "router-default-66578b4c86-6vhrf" (UID: "0e22af39-dd90-473a-9802-abfb83870e38") : secret "router-metrics-certs-default" not found
Jul 23 13:41:11.694650 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:11.694494    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0e22af39-dd90-473a-9802-abfb83870e38-service-ca-bundle podName:0e22af39-dd90-473a-9802-abfb83870e38 nodeName:}" failed. No retries permitted until 2026-07-23 13:41:19.694484418 +0000 UTC m=+51.133985328 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0e22af39-dd90-473a-9802-abfb83870e38-service-ca-bundle") pod "router-default-66578b4c86-6vhrf" (UID: "0e22af39-dd90-473a-9802-abfb83870e38") : configmap references non-existent config key: service-ca.crt
Jul 23 13:41:11.694650 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:11.694514    2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 23 13:41:11.694650 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:11.694573    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96de4e50-4208-4f42-ab50-0a702232ff33-cluster-monitoring-operator-tls podName:96de4e50-4208-4f42-ab50-0a702232ff33 nodeName:}" failed. No retries permitted until 2026-07-23 13:41:19.694554347 +0000 UTC m=+51.134055249 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/96de4e50-4208-4f42-ab50-0a702232ff33-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-jxgw7" (UID: "96de4e50-4208-4f42-ab50-0a702232ff33") : secret "cluster-monitoring-operator-tls" not found
Jul 23 13:41:11.694650 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:11.694514    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 13:41:11.694650 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:11.694612    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62b09fb2-689e-433b-8621-d6ee876b59a6-metrics-tls podName:62b09fb2-689e-433b-8621-d6ee876b59a6 nodeName:}" failed. No retries permitted until 2026-07-23 13:41:19.694603599 +0000 UTC m=+51.134104499 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/62b09fb2-689e-433b-8621-d6ee876b59a6-metrics-tls") pod "dns-default-v878n" (UID: "62b09fb2-689e-433b-8621-d6ee876b59a6") : secret "dns-default-metrics-tls" not found
Jul 23 13:41:11.955355 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:11.955261    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:12.053187 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:12.053151    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:12.837791 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:12.837711    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-4ndvj"]
Jul 23 13:41:12.850272 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:12.850242    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-4ndvj"]
Jul 23 13:41:12.850415 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:12.850341    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4ndvj"
Jul 23 13:41:12.853234 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:12.853209    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 23 13:41:12.853234 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:12.853227    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-7gncr\""
Jul 23 13:41:12.853423 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:12.853217    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 23 13:41:12.906060 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:12.905975    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7611ad79-3d20-4ba5-85ef-ed2724212082-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-4ndvj\" (UID: \"7611ad79-3d20-4ba5-85ef-ed2724212082\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4ndvj"
Jul 23 13:41:12.906224 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:12.906132    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7611ad79-3d20-4ba5-85ef-ed2724212082-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-4ndvj\" (UID: \"7611ad79-3d20-4ba5-85ef-ed2724212082\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4ndvj"
Jul 23 13:41:12.963825 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:12.963788    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:13.007174 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:13.007143    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7611ad79-3d20-4ba5-85ef-ed2724212082-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-4ndvj\" (UID: \"7611ad79-3d20-4ba5-85ef-ed2724212082\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4ndvj"
Jul 23 13:41:13.007364 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:13.007198    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7611ad79-3d20-4ba5-85ef-ed2724212082-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-4ndvj\" (UID: \"7611ad79-3d20-4ba5-85ef-ed2724212082\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4ndvj"
Jul 23 13:41:13.007364 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:13.007338    2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 23 13:41:13.007486 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:13.007431    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7611ad79-3d20-4ba5-85ef-ed2724212082-networking-console-plugin-cert podName:7611ad79-3d20-4ba5-85ef-ed2724212082 nodeName:}" failed. No retries permitted until 2026-07-23 13:41:13.507408859 +0000 UTC m=+44.946909758 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7611ad79-3d20-4ba5-85ef-ed2724212082-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-4ndvj" (UID: "7611ad79-3d20-4ba5-85ef-ed2724212082") : secret "networking-console-plugin-cert" not found
Jul 23 13:41:13.007857 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:13.007838    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7611ad79-3d20-4ba5-85ef-ed2724212082-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-4ndvj\" (UID: \"7611ad79-3d20-4ba5-85ef-ed2724212082\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4ndvj"
Jul 23 13:41:13.064101 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:13.064067    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:13.164438 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:13.164410    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:13.512665 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:13.512631    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7611ad79-3d20-4ba5-85ef-ed2724212082-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-4ndvj\" (UID: \"7611ad79-3d20-4ba5-85ef-ed2724212082\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4ndvj"
Jul 23 13:41:13.512835 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:13.512748    2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 23 13:41:13.512835 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:13.512809    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7611ad79-3d20-4ba5-85ef-ed2724212082-networking-console-plugin-cert podName:7611ad79-3d20-4ba5-85ef-ed2724212082 nodeName:}" failed. No retries permitted until 2026-07-23 13:41:14.512795686 +0000 UTC m=+45.952296583 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7611ad79-3d20-4ba5-85ef-ed2724212082-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-4ndvj" (UID: "7611ad79-3d20-4ba5-85ef-ed2724212082") : secret "networking-console-plugin-cert" not found
Jul 23 13:41:13.560442 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:13.560322    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:13.658849 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:13.658779    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:14.174468 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:14.173714    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-cjpfp"]
Jul 23 13:41:14.191684 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:14.191649    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cjpfp"]
Jul 23 13:41:14.191849 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:14.191778    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cjpfp"
Jul 23 13:41:14.194358 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:14.194321    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5fzgx\""
Jul 23 13:41:14.194513 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:14.194404    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 23 13:41:14.194513 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:14.194405    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 23 13:41:14.197651 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:14.197619    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:14.254361 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:14.254327    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:14.312623 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:14.312585    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-zf6lz" event={"ID":"05483fd5-7d32-4631-b508-951081e51e6f","Type":"ContainerStarted","Data":"99f055b932c1fc2a39394c692e99464d30fdcb1979f22107704f5881467815b3"}
Jul 23 13:41:14.314258 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:14.314230    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-7rvsv" event={"ID":"001764b2-a882-42f4-9ef6-2ea7066febd7","Type":"ContainerStarted","Data":"96815e0db4fc82d36531fd85a67a77d59384e36eb8157a72d70fd0a9e969138f"}
Jul 23 13:41:14.315858 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:14.315831    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-98w4s" event={"ID":"5d49627b-4f13-46b6-a3a2-da958eb12319","Type":"ContainerStarted","Data":"e1bf001233c72033172ed6503a155b4870364184e1116d26a0e93c4d4ec59f25"}
Jul 23 13:41:14.317799 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:14.317778    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-vh5dp_2d624703-978f-48c2-b02d-9af8fd337236/console-operator/0.log"
Jul 23 13:41:14.317896 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:14.317820    2573 generic.go:356] "Generic (PLEG): container finished" podID="2d624703-978f-48c2-b02d-9af8fd337236" containerID="b0e781bb8b8786535df38e2acf2dcf980ffe2111d985ac054343326707d87099" exitCode=255
Jul 23 13:41:14.317896 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:14.317874    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-vh5dp" event={"ID":"2d624703-978f-48c2-b02d-9af8fd337236","Type":"ContainerDied","Data":"b0e781bb8b8786535df38e2acf2dcf980ffe2111d985ac054343326707d87099"}
Jul 23 13:41:14.318083 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:14.318067    2573 scope.go:117] "RemoveContainer" containerID="b0e781bb8b8786535df38e2acf2dcf980ffe2111d985ac054343326707d87099"
Jul 23 13:41:14.319535 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:14.319510    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-jmlv7" event={"ID":"bcc90ce2-5ae1-44ce-8842-aa5e7f477776","Type":"ContainerStarted","Data":"88c4014eab15a2abba2c587776aa076bae0815c9f4f6a65ba760b92ab8cddd11"}
Jul 23 13:41:14.320291 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:14.320269    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lz2vh\" (UniqueName: \"kubernetes.io/projected/361da523-6b42-450e-ba3d-0b52b7865320-kube-api-access-lz2vh\") pod \"insights-runtime-extractor-cjpfp\" (UID: \"361da523-6b42-450e-ba3d-0b52b7865320\") " pod="openshift-insights/insights-runtime-extractor-cjpfp"
Jul 23 13:41:14.320383 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:14.320325    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/361da523-6b42-450e-ba3d-0b52b7865320-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cjpfp\" (UID: \"361da523-6b42-450e-ba3d-0b52b7865320\") " pod="openshift-insights/insights-runtime-extractor-cjpfp"
Jul 23 13:41:14.320569 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:14.320550    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/361da523-6b42-450e-ba3d-0b52b7865320-crio-socket\") pod \"insights-runtime-extractor-cjpfp\" (UID: \"361da523-6b42-450e-ba3d-0b52b7865320\") " pod="openshift-insights/insights-runtime-extractor-cjpfp"
Jul 23 13:41:14.320639 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:14.320624    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/361da523-6b42-450e-ba3d-0b52b7865320-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cjpfp\" (UID: \"361da523-6b42-450e-ba3d-0b52b7865320\") " pod="openshift-insights/insights-runtime-extractor-cjpfp"
Jul 23 13:41:14.320725 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:14.320712    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/361da523-6b42-450e-ba3d-0b52b7865320-data-volume\") pod \"insights-runtime-extractor-cjpfp\" (UID: \"361da523-6b42-450e-ba3d-0b52b7865320\") " pod="openshift-insights/insights-runtime-extractor-cjpfp"
Jul 23 13:41:14.321214 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:14.321190    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-25jdb" event={"ID":"b13a7207-47ba-4e8e-a62b-97546e957cdd","Type":"ContainerStarted","Data":"9f3f29706b519000dd5176d2aaa2ba98cc0e44a6a663f69de52468c27ecf939e"}
Jul 23 13:41:14.322575 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:14.322539    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:14.322845 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:14.322823    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-7zf2f" event={"ID":"0825a9ee-4ce9-460c-90a2-6e285f9adc51","Type":"ContainerStarted","Data":"badb0d43015185f759c05a7ccd06589c8e15fbc90269d40bdc4bbeb3ae925cc0"}
Jul 23 13:41:14.332358 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:14.332318    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-zf6lz" podStartSLOduration=23.621727532 podStartE2EDuration="31.33230727s" totalImagesPullingTime="7.710579738s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:40:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:41:14.331453236 +0000 UTC m=+45.770954168" watchObservedRunningTime="2026-07-23 13:41:14.33230727 +0000 UTC m=+45.771808248"
Jul 23 13:41:14.365565 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:14.365499    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-jmlv7" podStartSLOduration=25.655825217 podStartE2EDuration="33.365479433s" totalImagesPullingTime="7.709654216s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:40:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:41:14.350459581 +0000 UTC m=+45.789960502" watchObservedRunningTime="2026-07-23 13:41:14.365479433 +0000 UTC m=+45.804980333"
Jul 23 13:41:14.365897 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:14.365865    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-98w4s" podStartSLOduration=3.647816574 podStartE2EDuration="11.365852544s" totalImagesPullingTime="7.71803597s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:41:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:41:14.365151085 +0000 UTC m=+45.804652000" watchObservedRunningTime="2026-07-23 13:41:14.365852544 +0000 UTC m=+45.805353444"
Jul 23 13:41:14.405929 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:14.405873    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-7zf2f" podStartSLOduration=27.699659192 podStartE2EDuration="35.405854982s" totalImagesPullingTime="7.70619579s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:40:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:41:14.404942271 +0000 UTC m=+45.844443191" watchObservedRunningTime="2026-07-23 13:41:14.405854982 +0000 UTC m=+45.845355902"
Jul 23 13:41:14.421244 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:14.421215    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/361da523-6b42-450e-ba3d-0b52b7865320-crio-socket\") pod \"insights-runtime-extractor-cjpfp\" (UID: \"361da523-6b42-450e-ba3d-0b52b7865320\") " pod="openshift-insights/insights-runtime-extractor-cjpfp"
Jul 23 13:41:14.422329 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:14.421440    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/361da523-6b42-450e-ba3d-0b52b7865320-crio-socket\") pod \"insights-runtime-extractor-cjpfp\" (UID: \"361da523-6b42-450e-ba3d-0b52b7865320\") " pod="openshift-insights/insights-runtime-extractor-cjpfp"
Jul 23 13:41:14.422329 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:14.421449    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/361da523-6b42-450e-ba3d-0b52b7865320-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cjpfp\" (UID: \"361da523-6b42-450e-ba3d-0b52b7865320\") " pod="openshift-insights/insights-runtime-extractor-cjpfp"
Jul 23 13:41:14.422329 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:14.421522    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 13:41:14.422329 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:14.421577    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/361da523-6b42-450e-ba3d-0b52b7865320-kube-rbac-proxy-cm podName:361da523-6b42-450e-ba3d-0b52b7865320 nodeName:}" failed. No retries permitted until 2026-07-23 13:41:14.92155965 +0000 UTC m=+46.361060554 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/361da523-6b42-450e-ba3d-0b52b7865320-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cjpfp" (UID: "361da523-6b42-450e-ba3d-0b52b7865320") : configmap "kube-rbac-proxy" not found
Jul 23 13:41:14.422973 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:14.422678    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/361da523-6b42-450e-ba3d-0b52b7865320-data-volume\") pod \"insights-runtime-extractor-cjpfp\" (UID: \"361da523-6b42-450e-ba3d-0b52b7865320\") " pod="openshift-insights/insights-runtime-extractor-cjpfp"
Jul 23 13:41:14.422973 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:14.422802    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lz2vh\" (UniqueName: \"kubernetes.io/projected/361da523-6b42-450e-ba3d-0b52b7865320-kube-api-access-lz2vh\") pod \"insights-runtime-extractor-cjpfp\" (UID: \"361da523-6b42-450e-ba3d-0b52b7865320\") " pod="openshift-insights/insights-runtime-extractor-cjpfp"
Jul 23 13:41:14.423460 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:14.423285    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/361da523-6b42-450e-ba3d-0b52b7865320-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cjpfp\" (UID: \"361da523-6b42-450e-ba3d-0b52b7865320\") " pod="openshift-insights/insights-runtime-extractor-cjpfp"
Jul 23 13:41:14.423579 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:14.423475    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 13:41:14.423579 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:14.423539    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/361da523-6b42-450e-ba3d-0b52b7865320-insights-runtime-extractor-tls podName:361da523-6b42-450e-ba3d-0b52b7865320 nodeName:}" failed. No retries permitted until 2026-07-23 13:41:14.923521397 +0000 UTC m=+46.363022301 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/361da523-6b42-450e-ba3d-0b52b7865320-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cjpfp" (UID: "361da523-6b42-450e-ba3d-0b52b7865320") : secret "insights-runtime-extractor-tls" not found
Jul 23 13:41:14.423819 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:14.423790    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/361da523-6b42-450e-ba3d-0b52b7865320-data-volume\") pod \"insights-runtime-extractor-cjpfp\" (UID: \"361da523-6b42-450e-ba3d-0b52b7865320\") " pod="openshift-insights/insights-runtime-extractor-cjpfp"
Jul 23 13:41:14.424943 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:14.424871    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-25jdb" podStartSLOduration=27.662447488 podStartE2EDuration="35.424858698s" totalImagesPullingTime="7.76241121s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:40:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:41:14.424250756 +0000 UTC m=+45.863751675" watchObservedRunningTime="2026-07-23 13:41:14.424858698 +0000 UTC m=+45.864359597"
Jul 23 13:41:14.439163 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:14.439129    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lz2vh\" (UniqueName: \"kubernetes.io/projected/361da523-6b42-450e-ba3d-0b52b7865320-kube-api-access-lz2vh\") pod \"insights-runtime-extractor-cjpfp\" (UID: \"361da523-6b42-450e-ba3d-0b52b7865320\") " pod="openshift-insights/insights-runtime-extractor-cjpfp"
Jul 23 13:41:14.446085 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:14.445838    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-7rvsv" podStartSLOduration=27.235963777 podStartE2EDuration="35.445819724s" totalImagesPullingTime="8.209855947s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:40:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:41:14.444330308 +0000 UTC m=+45.883831227" watchObservedRunningTime="2026-07-23 13:41:14.445819724 +0000 UTC m=+45.885320645"
Jul 23 13:41:14.524990 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:14.524963    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7611ad79-3d20-4ba5-85ef-ed2724212082-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-4ndvj\" (UID: \"7611ad79-3d20-4ba5-85ef-ed2724212082\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4ndvj"
Jul 23 13:41:14.525152 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:14.525133    2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 23 13:41:14.525224 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:14.525214    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7611ad79-3d20-4ba5-85ef-ed2724212082-networking-console-plugin-cert podName:7611ad79-3d20-4ba5-85ef-ed2724212082 nodeName:}" failed. No retries permitted until 2026-07-23 13:41:16.525190994 +0000 UTC m=+47.964691896 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7611ad79-3d20-4ba5-85ef-ed2724212082-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-4ndvj" (UID: "7611ad79-3d20-4ba5-85ef-ed2724212082") : secret "networking-console-plugin-cert" not found
Jul 23 13:41:14.927753 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:14.927713    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/361da523-6b42-450e-ba3d-0b52b7865320-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cjpfp\" (UID: \"361da523-6b42-450e-ba3d-0b52b7865320\") " pod="openshift-insights/insights-runtime-extractor-cjpfp"
Jul 23 13:41:14.927926 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:14.927831    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/361da523-6b42-450e-ba3d-0b52b7865320-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cjpfp\" (UID: \"361da523-6b42-450e-ba3d-0b52b7865320\") " pod="openshift-insights/insights-runtime-extractor-cjpfp"
Jul 23 13:41:14.927926 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:14.927882    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 13:41:14.928002 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:14.927946    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 13:41:14.928002 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:14.927963    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/361da523-6b42-450e-ba3d-0b52b7865320-insights-runtime-extractor-tls podName:361da523-6b42-450e-ba3d-0b52b7865320 nodeName:}" failed. No retries permitted until 2026-07-23 13:41:15.927943299 +0000 UTC m=+47.367444214 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/361da523-6b42-450e-ba3d-0b52b7865320-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cjpfp" (UID: "361da523-6b42-450e-ba3d-0b52b7865320") : secret "insights-runtime-extractor-tls" not found
Jul 23 13:41:14.928002 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:14.927984    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/361da523-6b42-450e-ba3d-0b52b7865320-kube-rbac-proxy-cm podName:361da523-6b42-450e-ba3d-0b52b7865320 nodeName:}" failed. No retries permitted until 2026-07-23 13:41:15.927974397 +0000 UTC m=+47.367475305 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/361da523-6b42-450e-ba3d-0b52b7865320-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cjpfp" (UID: "361da523-6b42-450e-ba3d-0b52b7865320") : configmap "kube-rbac-proxy" not found
Jul 23 13:41:15.329483 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:15.329452    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-vh5dp_2d624703-978f-48c2-b02d-9af8fd337236/console-operator/1.log"
Jul 23 13:41:15.329903 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:15.329883    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-vh5dp_2d624703-978f-48c2-b02d-9af8fd337236/console-operator/0.log"
Jul 23 13:41:15.329967 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:15.329925    2573 generic.go:356] "Generic (PLEG): container finished" podID="2d624703-978f-48c2-b02d-9af8fd337236" containerID="f2e3e81cc2150f0414d5c2d799caf53233261b4f18c1e2b1659d1abda959ac51" exitCode=255
Jul 23 13:41:15.330046 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:15.330003    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-vh5dp" event={"ID":"2d624703-978f-48c2-b02d-9af8fd337236","Type":"ContainerDied","Data":"f2e3e81cc2150f0414d5c2d799caf53233261b4f18c1e2b1659d1abda959ac51"}
Jul 23 13:41:15.330113 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:15.330079    2573 scope.go:117] "RemoveContainer" containerID="b0e781bb8b8786535df38e2acf2dcf980ffe2111d985ac054343326707d87099"
Jul 23 13:41:15.330307 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:15.330287    2573 scope.go:117] "RemoveContainer" containerID="f2e3e81cc2150f0414d5c2d799caf53233261b4f18c1e2b1659d1abda959ac51"
Jul 23 13:41:15.330509 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:15.330459    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-vh5dp_openshift-console-operator(2d624703-978f-48c2-b02d-9af8fd337236)\"" pod="openshift-console-operator/console-operator-565b7b569d-vh5dp" podUID="2d624703-978f-48c2-b02d-9af8fd337236"
Jul 23 13:41:15.506741 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:15.506707    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-8z6pg"]
Jul 23 13:41:15.529444 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:15.529413    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-8z6pg"]
Jul 23 13:41:15.529619 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:15.529528    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-8z6pg"
Jul 23 13:41:15.531875 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:15.531833    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 23 13:41:15.531875 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:15.531839    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 23 13:41:15.532120 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:15.531927    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-ck86r\""
Jul 23 13:41:15.548229 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:15.548212    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-h5h9z_382c782e-058b-4863-bd13-2e88a5f465bf/dns-node-resolver/0.log"
Jul 23 13:41:15.634127 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:15.634048    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scdph\" (UniqueName: \"kubernetes.io/projected/87b31edb-a6d7-4c9c-bc0d-c9c8e0475b5b-kube-api-access-scdph\") pod \"migrator-7cc9c7ffd7-8z6pg\" (UID: \"87b31edb-a6d7-4c9c-bc0d-c9c8e0475b5b\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-8z6pg"
Jul 23 13:41:15.734940 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:15.734909    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scdph\" (UniqueName: \"kubernetes.io/projected/87b31edb-a6d7-4c9c-bc0d-c9c8e0475b5b-kube-api-access-scdph\") pod \"migrator-7cc9c7ffd7-8z6pg\" (UID: \"87b31edb-a6d7-4c9c-bc0d-c9c8e0475b5b\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-8z6pg"
Jul 23 13:41:15.743267 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:15.743241    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-scdph\" (UniqueName: \"kubernetes.io/projected/87b31edb-a6d7-4c9c-bc0d-c9c8e0475b5b-kube-api-access-scdph\") pod \"migrator-7cc9c7ffd7-8z6pg\" (UID: \"87b31edb-a6d7-4c9c-bc0d-c9c8e0475b5b\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-8z6pg"
Jul 23 13:41:15.838946 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:15.838912    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-8z6pg"
Jul 23 13:41:15.936796 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:15.936757    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/361da523-6b42-450e-ba3d-0b52b7865320-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cjpfp\" (UID: \"361da523-6b42-450e-ba3d-0b52b7865320\") " pod="openshift-insights/insights-runtime-extractor-cjpfp"
Jul 23 13:41:15.936942 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:15.936887    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/361da523-6b42-450e-ba3d-0b52b7865320-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cjpfp\" (UID: \"361da523-6b42-450e-ba3d-0b52b7865320\") " pod="openshift-insights/insights-runtime-extractor-cjpfp"
Jul 23 13:41:15.936942 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:15.936897    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 13:41:15.937059 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:15.936964    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/361da523-6b42-450e-ba3d-0b52b7865320-insights-runtime-extractor-tls podName:361da523-6b42-450e-ba3d-0b52b7865320 nodeName:}" failed. No retries permitted until 2026-07-23 13:41:17.936946362 +0000 UTC m=+49.376447262 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/361da523-6b42-450e-ba3d-0b52b7865320-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cjpfp" (UID: "361da523-6b42-450e-ba3d-0b52b7865320") : secret "insights-runtime-extractor-tls" not found
Jul 23 13:41:15.937059 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:15.936978    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 13:41:15.937059 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:15.937058    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/361da523-6b42-450e-ba3d-0b52b7865320-kube-rbac-proxy-cm podName:361da523-6b42-450e-ba3d-0b52b7865320 nodeName:}" failed. No retries permitted until 2026-07-23 13:41:17.937040249 +0000 UTC m=+49.376541153 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/361da523-6b42-450e-ba3d-0b52b7865320-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cjpfp" (UID: "361da523-6b42-450e-ba3d-0b52b7865320") : configmap "kube-rbac-proxy" not found
Jul 23 13:41:15.979102 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:15.979072    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-8z6pg"]
Jul 23 13:41:15.981925 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:41:15.981897    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87b31edb_a6d7_4c9c_bc0d_c9c8e0475b5b.slice/crio-ea8403aa41649affbc92abd470b82377c908081d0b5ae2d6e740266e48d445bf WatchSource:0}: Error finding container ea8403aa41649affbc92abd470b82377c908081d0b5ae2d6e740266e48d445bf: Status 404 returned error can't find the container with id ea8403aa41649affbc92abd470b82377c908081d0b5ae2d6e740266e48d445bf
Jul 23 13:41:16.147476 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:16.147453    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5gxsc_d846e487-3440-4729-89d1-57211afe3328/node-ca/0.log"
Jul 23 13:41:16.334374 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:16.334337    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-8z6pg" event={"ID":"87b31edb-a6d7-4c9c-bc0d-c9c8e0475b5b","Type":"ContainerStarted","Data":"ea8403aa41649affbc92abd470b82377c908081d0b5ae2d6e740266e48d445bf"}
Jul 23 13:41:16.335650 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:16.335630    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-vh5dp_2d624703-978f-48c2-b02d-9af8fd337236/console-operator/1.log"
Jul 23 13:41:16.335970 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:16.335952    2573 scope.go:117] "RemoveContainer" containerID="f2e3e81cc2150f0414d5c2d799caf53233261b4f18c1e2b1659d1abda959ac51"
Jul 23 13:41:16.336145 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:16.336127    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-vh5dp_openshift-console-operator(2d624703-978f-48c2-b02d-9af8fd337236)\"" pod="openshift-console-operator/console-operator-565b7b569d-vh5dp" podUID="2d624703-978f-48c2-b02d-9af8fd337236"
Jul 23 13:41:16.542407 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:16.542374    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7611ad79-3d20-4ba5-85ef-ed2724212082-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-4ndvj\" (UID: \"7611ad79-3d20-4ba5-85ef-ed2724212082\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4ndvj"
Jul 23 13:41:16.542610 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:16.542515    2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 23 13:41:16.542610 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:16.542574    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7611ad79-3d20-4ba5-85ef-ed2724212082-networking-console-plugin-cert podName:7611ad79-3d20-4ba5-85ef-ed2724212082 nodeName:}" failed. No retries permitted until 2026-07-23 13:41:20.542560011 +0000 UTC m=+51.982060914 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7611ad79-3d20-4ba5-85ef-ed2724212082-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-4ndvj" (UID: "7611ad79-3d20-4ba5-85ef-ed2724212082") : secret "networking-console-plugin-cert" not found
Jul 23 13:41:16.640411 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:16.640320    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-58598695f7-f5h6v"]
Jul 23 13:41:16.663303 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:16.663273    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-f5h6v"]
Jul 23 13:41:16.663446 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:16.663370    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-f5h6v"
Jul 23 13:41:16.665837 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:16.665809    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 23 13:41:16.665964 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:16.665848    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 23 13:41:16.665964 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:16.665878    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 23 13:41:16.665964 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:16.665928    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-9q96b\""
Jul 23 13:41:16.665964 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:16.665957    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 23 13:41:16.744206 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:16.744174    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/8cc79204-1015-4154-9eee-057c1a175d09-signing-key\") pod \"service-ca-58598695f7-f5h6v\" (UID: \"8cc79204-1015-4154-9eee-057c1a175d09\") " pod="openshift-service-ca/service-ca-58598695f7-f5h6v"
Jul 23 13:41:16.744345 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:16.744296    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdrsn\" (UniqueName: \"kubernetes.io/projected/8cc79204-1015-4154-9eee-057c1a175d09-kube-api-access-vdrsn\") pod \"service-ca-58598695f7-f5h6v\" (UID: \"8cc79204-1015-4154-9eee-057c1a175d09\") " pod="openshift-service-ca/service-ca-58598695f7-f5h6v"
Jul 23 13:41:16.744401 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:16.744341    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/8cc79204-1015-4154-9eee-057c1a175d09-signing-cabundle\") pod \"service-ca-58598695f7-f5h6v\" (UID: \"8cc79204-1015-4154-9eee-057c1a175d09\") " pod="openshift-service-ca/service-ca-58598695f7-f5h6v"
Jul 23 13:41:16.845585 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:16.845555    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdrsn\" (UniqueName: \"kubernetes.io/projected/8cc79204-1015-4154-9eee-057c1a175d09-kube-api-access-vdrsn\") pod \"service-ca-58598695f7-f5h6v\" (UID: \"8cc79204-1015-4154-9eee-057c1a175d09\") " pod="openshift-service-ca/service-ca-58598695f7-f5h6v"
Jul 23 13:41:16.845585 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:16.845589    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/8cc79204-1015-4154-9eee-057c1a175d09-signing-cabundle\") pod \"service-ca-58598695f7-f5h6v\" (UID: \"8cc79204-1015-4154-9eee-057c1a175d09\") " pod="openshift-service-ca/service-ca-58598695f7-f5h6v"
Jul 23 13:41:16.845766 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:16.845688    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/8cc79204-1015-4154-9eee-057c1a175d09-signing-key\") pod \"service-ca-58598695f7-f5h6v\" (UID: \"8cc79204-1015-4154-9eee-057c1a175d09\") " pod="openshift-service-ca/service-ca-58598695f7-f5h6v"
Jul 23 13:41:16.846254 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:16.846233    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/8cc79204-1015-4154-9eee-057c1a175d09-signing-cabundle\") pod \"service-ca-58598695f7-f5h6v\" (UID: \"8cc79204-1015-4154-9eee-057c1a175d09\") " pod="openshift-service-ca/service-ca-58598695f7-f5h6v"
Jul 23 13:41:16.847984 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:16.847954    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/8cc79204-1015-4154-9eee-057c1a175d09-signing-key\") pod \"service-ca-58598695f7-f5h6v\" (UID: \"8cc79204-1015-4154-9eee-057c1a175d09\") " pod="openshift-service-ca/service-ca-58598695f7-f5h6v"
Jul 23 13:41:16.853776 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:16.853755    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdrsn\" (UniqueName: \"kubernetes.io/projected/8cc79204-1015-4154-9eee-057c1a175d09-kube-api-access-vdrsn\") pod \"service-ca-58598695f7-f5h6v\" (UID: \"8cc79204-1015-4154-9eee-057c1a175d09\") " pod="openshift-service-ca/service-ca-58598695f7-f5h6v"
Jul 23 13:41:16.948086 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:16.947991    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-98w4s_5d49627b-4f13-46b6-a3a2-da958eb12319/serve-healthcheck-canary/0.log"
Jul 23 13:41:16.963496 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:16.963462    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:16.972221 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:16.972196    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-f5h6v"
Jul 23 13:41:17.046101 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:17.046065    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:17.149610 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:17.149576    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-f5h6v"]
Jul 23 13:41:17.156665 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:41:17.156640    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cc79204_1015_4154_9eee_057c1a175d09.slice/crio-0fe9b1a9b9e0d74ffedeaa4460dd128ad30f249fcb6907f73ec89144ef57bb13 WatchSource:0}: Error finding container 0fe9b1a9b9e0d74ffedeaa4460dd128ad30f249fcb6907f73ec89144ef57bb13: Status 404 returned error can't find the container with id 0fe9b1a9b9e0d74ffedeaa4460dd128ad30f249fcb6907f73ec89144ef57bb13
Jul 23 13:41:17.341691 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:17.341656    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-f5h6v" event={"ID":"8cc79204-1015-4154-9eee-057c1a175d09","Type":"ContainerStarted","Data":"bb2c46e880f7883601f11aad2c13901feea00c7545943ecb8ad7b142602c4287"}
Jul 23 13:41:17.342074 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:17.341714    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-f5h6v" event={"ID":"8cc79204-1015-4154-9eee-057c1a175d09","Type":"ContainerStarted","Data":"0fe9b1a9b9e0d74ffedeaa4460dd128ad30f249fcb6907f73ec89144ef57bb13"}
Jul 23 13:41:17.375656 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:17.374682    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-58598695f7-f5h6v" podStartSLOduration=1.374661301 podStartE2EDuration="1.374661301s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:41:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:41:17.373905772 +0000 UTC m=+48.813406694" watchObservedRunningTime="2026-07-23 13:41:17.374661301 +0000 UTC m=+48.814162221"
Jul 23 13:41:17.573494 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:17.573459    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:17.652923 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:17.652892    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:17.729653 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:17.729618    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:17.957400 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:17.957375    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/361da523-6b42-450e-ba3d-0b52b7865320-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cjpfp\" (UID: \"361da523-6b42-450e-ba3d-0b52b7865320\") " pod="openshift-insights/insights-runtime-extractor-cjpfp"
Jul 23 13:41:17.957521 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:17.957499    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 13:41:17.957578 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:17.957555    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/361da523-6b42-450e-ba3d-0b52b7865320-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cjpfp\" (UID: \"361da523-6b42-450e-ba3d-0b52b7865320\") " pod="openshift-insights/insights-runtime-extractor-cjpfp"
Jul 23 13:41:17.957578 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:17.957573    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/361da523-6b42-450e-ba3d-0b52b7865320-kube-rbac-proxy-cm podName:361da523-6b42-450e-ba3d-0b52b7865320 nodeName:}" failed. No retries permitted until 2026-07-23 13:41:21.957552823 +0000 UTC m=+53.397053726 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/361da523-6b42-450e-ba3d-0b52b7865320-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cjpfp" (UID: "361da523-6b42-450e-ba3d-0b52b7865320") : configmap "kube-rbac-proxy" not found
Jul 23 13:41:17.957715 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:17.957666    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 13:41:17.957759 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:17.957729    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/361da523-6b42-450e-ba3d-0b52b7865320-insights-runtime-extractor-tls podName:361da523-6b42-450e-ba3d-0b52b7865320 nodeName:}" failed. No retries permitted until 2026-07-23 13:41:21.957713307 +0000 UTC m=+53.397214206 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/361da523-6b42-450e-ba3d-0b52b7865320-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cjpfp" (UID: "361da523-6b42-450e-ba3d-0b52b7865320") : secret "insights-runtime-extractor-tls" not found
Jul 23 13:41:18.347077 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:18.347036    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-8z6pg" event={"ID":"87b31edb-a6d7-4c9c-bc0d-c9c8e0475b5b","Type":"ContainerStarted","Data":"8830cea4a51e1c3770a02bde56c01be9896861b4bc32f67f2efa5c99a8ce5acd"}
Jul 23 13:41:18.347465 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:18.347103    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-8z6pg" event={"ID":"87b31edb-a6d7-4c9c-bc0d-c9c8e0475b5b","Type":"ContainerStarted","Data":"8090fc71dba0bc9f46b46786a56443946578ac643fb0168f6771f1cdd82589ca"}
Jul 23 13:41:18.368299 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:18.368247    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-8z6pg" podStartSLOduration=1.422693251 podStartE2EDuration="3.368231708s" totalImagesPullingTime="1.945538457s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:41:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:41:18.366698996 +0000 UTC m=+49.806199914" watchObservedRunningTime="2026-07-23 13:41:18.368231708 +0000 UTC m=+49.807732627"
Jul 23 13:41:18.555637 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:18.555598    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:18.656194 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:18.656101    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:18.721282 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:18.721251    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:18.830048 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:18.829972    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:18.976585 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:18.976497    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:19.077386 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:19.077349    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:19.264459 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:19.264369    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:19.676459 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:19.676422    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e20c5716-9825-474c-86cc-f4d8251ab64c-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-prghh\" (UID: \"e20c5716-9825-474c-86cc-f4d8251ab64c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-prghh"
Jul 23 13:41:19.676937 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:19.676520    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/85626da9-b35f-48f6-b12e-02554ac1b7e1-registry-tls\") pod \"image-registry-6db7654c99-dnmqb\" (UID: \"85626da9-b35f-48f6-b12e-02554ac1b7e1\") " pod="openshift-image-registry/image-registry-6db7654c99-dnmqb"
Jul 23 13:41:19.676937 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:19.676657    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 13:41:19.676937 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:19.676676    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6db7654c99-dnmqb: secret "image-registry-tls" not found
Jul 23 13:41:19.676937 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:19.676732    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/85626da9-b35f-48f6-b12e-02554ac1b7e1-registry-tls podName:85626da9-b35f-48f6-b12e-02554ac1b7e1 nodeName:}" failed. No retries permitted until 2026-07-23 13:41:35.676717342 +0000 UTC m=+67.116218239 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/85626da9-b35f-48f6-b12e-02554ac1b7e1-registry-tls") pod "image-registry-6db7654c99-dnmqb" (UID: "85626da9-b35f-48f6-b12e-02554ac1b7e1") : secret "image-registry-tls" not found
Jul 23 13:41:19.678905 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:19.678880    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e20c5716-9825-474c-86cc-f4d8251ab64c-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-prghh\" (UID: \"e20c5716-9825-474c-86cc-f4d8251ab64c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-prghh"
Jul 23 13:41:19.777824 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:19.777788    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/96de4e50-4208-4f42-ab50-0a702232ff33-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-jxgw7\" (UID: \"96de4e50-4208-4f42-ab50-0a702232ff33\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-jxgw7"
Jul 23 13:41:19.778039 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:19.777860    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/62b09fb2-689e-433b-8621-d6ee876b59a6-metrics-tls\") pod \"dns-default-v878n\" (UID: \"62b09fb2-689e-433b-8621-d6ee876b59a6\") " pod="openshift-dns/dns-default-v878n"
Jul 23 13:41:19.778039 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:19.777901    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e22af39-dd90-473a-9802-abfb83870e38-metrics-certs\") pod \"router-default-66578b4c86-6vhrf\" (UID: \"0e22af39-dd90-473a-9802-abfb83870e38\") " pod="openshift-ingress/router-default-66578b4c86-6vhrf"
Jul 23 13:41:19.778039 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:19.777926    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e22af39-dd90-473a-9802-abfb83870e38-service-ca-bundle\") pod \"router-default-66578b4c86-6vhrf\" (UID: \"0e22af39-dd90-473a-9802-abfb83870e38\") " pod="openshift-ingress/router-default-66578b4c86-6vhrf"
Jul 23 13:41:19.778039 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:19.777936    2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 23 13:41:19.778039 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:19.777958    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 13:41:19.778039 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:19.777997    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96de4e50-4208-4f42-ab50-0a702232ff33-cluster-monitoring-operator-tls podName:96de4e50-4208-4f42-ab50-0a702232ff33 nodeName:}" failed. No retries permitted until 2026-07-23 13:41:35.77798208 +0000 UTC m=+67.217483006 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/96de4e50-4208-4f42-ab50-0a702232ff33-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-jxgw7" (UID: "96de4e50-4208-4f42-ab50-0a702232ff33") : secret "cluster-monitoring-operator-tls" not found
Jul 23 13:41:19.778039 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:19.778041    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62b09fb2-689e-433b-8621-d6ee876b59a6-metrics-tls podName:62b09fb2-689e-433b-8621-d6ee876b59a6 nodeName:}" failed. No retries permitted until 2026-07-23 13:41:35.778002932 +0000 UTC m=+67.217503829 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/62b09fb2-689e-433b-8621-d6ee876b59a6-metrics-tls") pod "dns-default-v878n" (UID: "62b09fb2-689e-433b-8621-d6ee876b59a6") : secret "dns-default-metrics-tls" not found
Jul 23 13:41:19.778376 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:19.778054    2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 23 13:41:19.778376 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:19.778071    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0e22af39-dd90-473a-9802-abfb83870e38-service-ca-bundle podName:0e22af39-dd90-473a-9802-abfb83870e38 nodeName:}" failed. No retries permitted until 2026-07-23 13:41:35.778061657 +0000 UTC m=+67.217562557 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0e22af39-dd90-473a-9802-abfb83870e38-service-ca-bundle") pod "router-default-66578b4c86-6vhrf" (UID: "0e22af39-dd90-473a-9802-abfb83870e38") : configmap references non-existent config key: service-ca.crt
Jul 23 13:41:19.778376 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:19.778099    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e22af39-dd90-473a-9802-abfb83870e38-metrics-certs podName:0e22af39-dd90-473a-9802-abfb83870e38 nodeName:}" failed. No retries permitted until 2026-07-23 13:41:35.778087986 +0000 UTC m=+67.217588883 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0e22af39-dd90-473a-9802-abfb83870e38-metrics-certs") pod "router-default-66578b4c86-6vhrf" (UID: "0e22af39-dd90-473a-9802-abfb83870e38") : secret "router-metrics-certs-default" not found
Jul 23 13:41:19.818726 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:19.818698    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-prghh"
Jul 23 13:41:19.958028 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:19.957935    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-prghh"]
Jul 23 13:41:19.986047 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:19.986001    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:20.048416 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:20.048388    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:20.113978 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:20.113946    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:20.256685 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:20.256603    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:20.355460 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:20.355425    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-prghh" event={"ID":"e20c5716-9825-474c-86cc-f4d8251ab64c","Type":"ContainerStarted","Data":"bedd4d49ac90454c12d40b5a76b32b74ae275b8187cdea3e71f7d0069360bcbb"}
Jul 23 13:41:20.468405 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:20.468364    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:20.586363 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:20.586316    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7611ad79-3d20-4ba5-85ef-ed2724212082-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-4ndvj\" (UID: \"7611ad79-3d20-4ba5-85ef-ed2724212082\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4ndvj"
Jul 23 13:41:20.586548 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:20.586494    2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 23 13:41:20.586617 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:20.586597    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7611ad79-3d20-4ba5-85ef-ed2724212082-networking-console-plugin-cert podName:7611ad79-3d20-4ba5-85ef-ed2724212082 nodeName:}" failed. No retries permitted until 2026-07-23 13:41:28.586573304 +0000 UTC m=+60.026074219 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7611ad79-3d20-4ba5-85ef-ed2724212082-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-4ndvj" (UID: "7611ad79-3d20-4ba5-85ef-ed2724212082") : secret "networking-console-plugin-cert" not found
Jul 23 13:41:20.849458 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:20.849359    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:20.964677 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:20.964640    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:21.065442 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:21.065409    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:21.488788 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:21.488748    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:21.859672 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:21.859624    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:21.938458 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:21.938421    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:22.000476 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:22.000434    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/361da523-6b42-450e-ba3d-0b52b7865320-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cjpfp\" (UID: \"361da523-6b42-450e-ba3d-0b52b7865320\") " pod="openshift-insights/insights-runtime-extractor-cjpfp"
Jul 23 13:41:22.000657 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:22.000610    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/361da523-6b42-450e-ba3d-0b52b7865320-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cjpfp\" (UID: \"361da523-6b42-450e-ba3d-0b52b7865320\") " pod="openshift-insights/insights-runtime-extractor-cjpfp"
Jul 23 13:41:22.000797 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:22.000779    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 13:41:22.000866 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:22.000854    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/361da523-6b42-450e-ba3d-0b52b7865320-insights-runtime-extractor-tls podName:361da523-6b42-450e-ba3d-0b52b7865320 nodeName:}" failed. No retries permitted until 2026-07-23 13:41:30.000835478 +0000 UTC m=+61.440336399 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/361da523-6b42-450e-ba3d-0b52b7865320-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cjpfp" (UID: "361da523-6b42-450e-ba3d-0b52b7865320") : secret "insights-runtime-extractor-tls" not found
Jul 23 13:41:22.001109 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:22.001073    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/361da523-6b42-450e-ba3d-0b52b7865320-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cjpfp\" (UID: \"361da523-6b42-450e-ba3d-0b52b7865320\") " pod="openshift-insights/insights-runtime-extractor-cjpfp"
Jul 23 13:41:22.319722 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:22.319692    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:22.455122 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:22.455086    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:22.867838 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:22.867758    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:22.926369 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:22.926333    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:23.054190 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:23.054153    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:23.367478 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:23.367445    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-prghh" event={"ID":"e20c5716-9825-474c-86cc-f4d8251ab64c","Type":"ContainerStarted","Data":"aaaf1cf26c2cb178141e2030bc29c1820b45f25ef87fdcb2f4cdf5533a53433a"}
Jul 23 13:41:23.367685 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:23.367493    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-prghh" event={"ID":"e20c5716-9825-474c-86cc-f4d8251ab64c","Type":"ContainerStarted","Data":"876964d92ce0056345f7d78cc999fc3d7009e8bd76dbd3cb456361991cf099e3"}
Jul 23 13:41:23.385872 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:23.385816    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-prghh" podStartSLOduration=41.916687939 podStartE2EDuration="44.385794362s" totalImagesPullingTime="2.469106423s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:40:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:41:23.385491216 +0000 UTC m=+54.824992135" watchObservedRunningTime="2026-07-23 13:41:23.385794362 +0000 UTC m=+54.825295283"
Jul 23 13:41:23.456536 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:23.456498    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:24.242134 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:24.242099    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-vh5dp"
Jul 23 13:41:24.242523 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:24.242147    2573 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-vh5dp"
Jul 23 13:41:24.242523 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:24.242490    2573 scope.go:117] "RemoveContainer" containerID="f2e3e81cc2150f0414d5c2d799caf53233261b4f18c1e2b1659d1abda959ac51"
Jul 23 13:41:24.242651 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:41:24.242632    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-vh5dp_openshift-console-operator(2d624703-978f-48c2-b02d-9af8fd337236)\"" pod="openshift-console-operator/console-operator-565b7b569d-vh5dp" podUID="2d624703-978f-48c2-b02d-9af8fd337236"
Jul 23 13:41:24.252047 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:24.251990    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:24.454294 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:24.454257    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:24.516376 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:24.516292    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:24.879555 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:24.879521    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:25.053145 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:25.053083    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:25.700139 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:25.700085    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:26.060812 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:26.060775    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:26.459315 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:26.459220    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:26.563894 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:26.563856    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:26.854875 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:26.854845    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:28.662421 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:28.662386    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7611ad79-3d20-4ba5-85ef-ed2724212082-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-4ndvj\" (UID: \"7611ad79-3d20-4ba5-85ef-ed2724212082\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4ndvj"
Jul 23 13:41:28.664742 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:28.664725    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7611ad79-3d20-4ba5-85ef-ed2724212082-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-4ndvj\" (UID: \"7611ad79-3d20-4ba5-85ef-ed2724212082\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4ndvj"
Jul 23 13:41:28.760155 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:28.760116    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4ndvj"
Jul 23 13:41:28.887254 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:28.887224    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-4ndvj"]
Jul 23 13:41:28.894561 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:41:28.894536    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7611ad79_3d20_4ba5_85ef_ed2724212082.slice/crio-b9adc1d8a78fda31f4f80f1fea233647b545d5eb74042154b4965ea1d3a95db8 WatchSource:0}: Error finding container b9adc1d8a78fda31f4f80f1fea233647b545d5eb74042154b4965ea1d3a95db8: Status 404 returned error can't find the container with id b9adc1d8a78fda31f4f80f1fea233647b545d5eb74042154b4965ea1d3a95db8
Jul 23 13:41:29.387896 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:29.387857    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4ndvj" event={"ID":"7611ad79-3d20-4ba5-85ef-ed2724212082","Type":"ContainerStarted","Data":"b9adc1d8a78fda31f4f80f1fea233647b545d5eb74042154b4965ea1d3a95db8"}
Jul 23 13:41:29.399840 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:29.399805    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:29.462159 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:29.462126    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:30.074910 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:30.074877    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/361da523-6b42-450e-ba3d-0b52b7865320-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cjpfp\" (UID: \"361da523-6b42-450e-ba3d-0b52b7865320\") " pod="openshift-insights/insights-runtime-extractor-cjpfp"
Jul 23 13:41:30.077097 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:30.077073    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/361da523-6b42-450e-ba3d-0b52b7865320-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cjpfp\" (UID: \"361da523-6b42-450e-ba3d-0b52b7865320\") " pod="openshift-insights/insights-runtime-extractor-cjpfp"
Jul 23 13:41:30.104666 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:30.104641    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5fzgx\""
Jul 23 13:41:30.112691 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:30.112674    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cjpfp"
Jul 23 13:41:30.229326 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:30.229298    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bpbpp"
Jul 23 13:41:30.262715 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:30.262688    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cjpfp"]
Jul 23 13:41:30.266563 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:41:30.266532    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod361da523_6b42_450e_ba3d_0b52b7865320.slice/crio-63fa816dfaec12b7dbe9c6088dc2d9abf9e02d05306e3d348f78abd09d642629 WatchSource:0}: Error finding container 63fa816dfaec12b7dbe9c6088dc2d9abf9e02d05306e3d348f78abd09d642629: Status 404 returned error can't find the container with id 63fa816dfaec12b7dbe9c6088dc2d9abf9e02d05306e3d348f78abd09d642629
Jul 23 13:41:30.392550 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:30.392482    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cjpfp" event={"ID":"361da523-6b42-450e-ba3d-0b52b7865320","Type":"ContainerStarted","Data":"63fa816dfaec12b7dbe9c6088dc2d9abf9e02d05306e3d348f78abd09d642629"}
Jul 23 13:41:32.402279 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:32.402241    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4ndvj" event={"ID":"7611ad79-3d20-4ba5-85ef-ed2724212082","Type":"ContainerStarted","Data":"a411c34024ab95dfa010a2be88ca211f8513dc21907779cee81216d079cc7792"}
Jul 23 13:41:32.419266 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:32.419176    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4ndvj" podStartSLOduration=17.14569844 podStartE2EDuration="20.419156491s" totalImagesPullingTime="3.273458051s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:41:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:41:32.418152116 +0000 UTC m=+63.857653036" watchObservedRunningTime="2026-07-23 13:41:32.419156491 +0000 UTC m=+63.858657412"
Jul 23 13:41:34.716899 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:34.716857    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ebc1dbc1-a42e-4498-8678-0f6a33a11f5f-original-pull-secret\") pod \"global-pull-secret-syncer-wx249\" (UID: \"ebc1dbc1-a42e-4498-8678-0f6a33a11f5f\") " pod="kube-system/global-pull-secret-syncer-wx249"
Jul 23 13:41:34.719688 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:34.719671    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 23 13:41:34.729911 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:34.729884    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ebc1dbc1-a42e-4498-8678-0f6a33a11f5f-original-pull-secret\") pod \"global-pull-secret-syncer-wx249\" (UID: \"ebc1dbc1-a42e-4498-8678-0f6a33a11f5f\") " pod="kube-system/global-pull-secret-syncer-wx249"
Jul 23 13:41:34.817337 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:34.817303    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f460d16d-e05e-45bb-b8cb-71fd972809f5-metrics-certs\") pod \"network-metrics-daemon-74ntz\" (UID: \"f460d16d-e05e-45bb-b8cb-71fd972809f5\") " pod="openshift-multus/network-metrics-daemon-74ntz"
Jul 23 13:41:34.819968 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:34.819941    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 23 13:41:34.829922 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:34.829892    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f460d16d-e05e-45bb-b8cb-71fd972809f5-metrics-certs\") pod \"network-metrics-daemon-74ntz\" (UID: \"f460d16d-e05e-45bb-b8cb-71fd972809f5\") " pod="openshift-multus/network-metrics-daemon-74ntz"
Jul 23 13:41:34.918717 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:34.918682    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jljs\" (UniqueName: \"kubernetes.io/projected/0f9ef7a1-2fa9-46bc-acc8-83a25209e294-kube-api-access-7jljs\") pod \"network-check-target-rvjth\" (UID: \"0f9ef7a1-2fa9-46bc-acc8-83a25209e294\") " pod="openshift-network-diagnostics/network-check-target-rvjth"
Jul 23 13:41:34.921344 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:34.921314    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jljs\" (UniqueName: \"kubernetes.io/projected/0f9ef7a1-2fa9-46bc-acc8-83a25209e294-kube-api-access-7jljs\") pod \"network-check-target-rvjth\" (UID: \"0f9ef7a1-2fa9-46bc-acc8-83a25209e294\") " pod="openshift-network-diagnostics/network-check-target-rvjth"
Jul 23 13:41:34.972878 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:34.972797    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:34.976462 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:34.976441    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5nz2m\""
Jul 23 13:41:34.983518 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:34.983482    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pwdgr\""
Jul 23 13:41:34.984538 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:34.984518    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rvjth"
Jul 23 13:41:34.987952 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:34.987930    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wx249"
Jul 23 13:41:34.991712 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:34.991689    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-74ntz"
Jul 23 13:41:35.032945 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:35.032918    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:35.607052 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:35.607023    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-74ntz"]
Jul 23 13:41:35.610735 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:41:35.610710    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf460d16d_e05e_45bb_b8cb_71fd972809f5.slice/crio-a80c64860bad22cdf51a177860d28aa8848707e58573d5adad48930621bbe52f WatchSource:0}: Error finding container a80c64860bad22cdf51a177860d28aa8848707e58573d5adad48930621bbe52f: Status 404 returned error can't find the container with id a80c64860bad22cdf51a177860d28aa8848707e58573d5adad48930621bbe52f
Jul 23 13:41:35.725816 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:35.725726    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/85626da9-b35f-48f6-b12e-02554ac1b7e1-registry-tls\") pod \"image-registry-6db7654c99-dnmqb\" (UID: \"85626da9-b35f-48f6-b12e-02554ac1b7e1\") " pod="openshift-image-registry/image-registry-6db7654c99-dnmqb"
Jul 23 13:41:35.728085 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:35.728068    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/85626da9-b35f-48f6-b12e-02554ac1b7e1-registry-tls\") pod \"image-registry-6db7654c99-dnmqb\" (UID: \"85626da9-b35f-48f6-b12e-02554ac1b7e1\") " pod="openshift-image-registry/image-registry-6db7654c99-dnmqb"
Jul 23 13:41:35.735773 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:35.735750    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-9kx5c\""
Jul 23 13:41:35.741836 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:35.741817    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6db7654c99-dnmqb"
Jul 23 13:41:35.827319 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:35.827285    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e22af39-dd90-473a-9802-abfb83870e38-metrics-certs\") pod \"router-default-66578b4c86-6vhrf\" (UID: \"0e22af39-dd90-473a-9802-abfb83870e38\") " pod="openshift-ingress/router-default-66578b4c86-6vhrf"
Jul 23 13:41:35.827471 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:35.827336    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e22af39-dd90-473a-9802-abfb83870e38-service-ca-bundle\") pod \"router-default-66578b4c86-6vhrf\" (UID: \"0e22af39-dd90-473a-9802-abfb83870e38\") " pod="openshift-ingress/router-default-66578b4c86-6vhrf"
Jul 23 13:41:35.827471 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:35.827394    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/96de4e50-4208-4f42-ab50-0a702232ff33-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-jxgw7\" (UID: \"96de4e50-4208-4f42-ab50-0a702232ff33\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-jxgw7"
Jul 23 13:41:35.827585 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:35.827547    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/62b09fb2-689e-433b-8621-d6ee876b59a6-metrics-tls\") pod \"dns-default-v878n\" (UID: \"62b09fb2-689e-433b-8621-d6ee876b59a6\") " pod="openshift-dns/dns-default-v878n"
Jul 23 13:41:35.828148 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:35.828122    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e22af39-dd90-473a-9802-abfb83870e38-service-ca-bundle\") pod \"router-default-66578b4c86-6vhrf\" (UID: \"0e22af39-dd90-473a-9802-abfb83870e38\") " pod="openshift-ingress/router-default-66578b4c86-6vhrf"
Jul 23 13:41:35.830076 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:35.830045    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e22af39-dd90-473a-9802-abfb83870e38-metrics-certs\") pod \"router-default-66578b4c86-6vhrf\" (UID: \"0e22af39-dd90-473a-9802-abfb83870e38\") " pod="openshift-ingress/router-default-66578b4c86-6vhrf"
Jul 23 13:41:35.830288 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:35.830254    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/62b09fb2-689e-433b-8621-d6ee876b59a6-metrics-tls\") pod \"dns-default-v878n\" (UID: \"62b09fb2-689e-433b-8621-d6ee876b59a6\") " pod="openshift-dns/dns-default-v878n"
Jul 23 13:41:35.830409 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:35.830384    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/96de4e50-4208-4f42-ab50-0a702232ff33-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-jxgw7\" (UID: \"96de4e50-4208-4f42-ab50-0a702232ff33\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-jxgw7"
Jul 23 13:41:35.845823 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:35.845782    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wx249"]
Jul 23 13:41:35.848132 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:41:35.848100    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebc1dbc1_a42e_4498_8678_0f6a33a11f5f.slice/crio-9d75018291a879f758dfd7689d8e1fc1b23a0eb54668ac8f525592327e14ee8d WatchSource:0}: Error finding container 9d75018291a879f758dfd7689d8e1fc1b23a0eb54668ac8f525592327e14ee8d: Status 404 returned error can't find the container with id 9d75018291a879f758dfd7689d8e1fc1b23a0eb54668ac8f525592327e14ee8d
Jul 23 13:41:35.852942 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:35.852892    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rvjth"]
Jul 23 13:41:35.856289 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:41:35.856259    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f9ef7a1_2fa9_46bc_acc8_83a25209e294.slice/crio-6611e300800f9f17d4102229a5eb67ec98dfaaeaf3a013f5012d158582988316 WatchSource:0}: Error finding container 6611e300800f9f17d4102229a5eb67ec98dfaaeaf3a013f5012d158582988316: Status 404 returned error can't find the container with id 6611e300800f9f17d4102229a5eb67ec98dfaaeaf3a013f5012d158582988316
Jul 23 13:41:35.895942 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:35.895912    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6db7654c99-dnmqb"]
Jul 23 13:41:35.899190 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:41:35.899165    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85626da9_b35f_48f6_b12e_02554ac1b7e1.slice/crio-d15f604c6f1455702b73e4145c6d84638133a65c04bbc41d56b0089c6c5127a9 WatchSource:0}: Error finding container d15f604c6f1455702b73e4145c6d84638133a65c04bbc41d56b0089c6c5127a9: Status 404 returned error can't find the container with id d15f604c6f1455702b73e4145c6d84638133a65c04bbc41d56b0089c6c5127a9
Jul 23 13:41:36.055022 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:36.054991    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-c4wr8\""
Jul 23 13:41:36.062505 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:36.062480    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-jxgw7"
Jul 23 13:41:36.083065 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:36.083043    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-pjdvn\""
Jul 23 13:41:36.091104 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:36.091079    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-66578b4c86-6vhrf"
Jul 23 13:41:36.105556 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:36.105524    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-l4fll\""
Jul 23 13:41:36.113543 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:36.113284    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-v878n"
Jul 23 13:41:36.237403 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:36.237325    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-jxgw7"]
Jul 23 13:41:36.243405 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:41:36.243240    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96de4e50_4208_4f42_ab50_0a702232ff33.slice/crio-461b1ddfcd19d0b616c338de89c5142ce9ab21480939eeeed3e57d3f1f2a7cf6 WatchSource:0}: Error finding container 461b1ddfcd19d0b616c338de89c5142ce9ab21480939eeeed3e57d3f1f2a7cf6: Status 404 returned error can't find the container with id 461b1ddfcd19d0b616c338de89c5142ce9ab21480939eeeed3e57d3f1f2a7cf6
Jul 23 13:41:36.275859 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:36.275825    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-66578b4c86-6vhrf"]
Jul 23 13:41:36.280402 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:41:36.280369    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e22af39_dd90_473a_9802_abfb83870e38.slice/crio-729323bb41ccf1673f4aaa13ff8cc253c02fce0e6315c96a51efff3dfa4f1937 WatchSource:0}: Error finding container 729323bb41ccf1673f4aaa13ff8cc253c02fce0e6315c96a51efff3dfa4f1937: Status 404 returned error can't find the container with id 729323bb41ccf1673f4aaa13ff8cc253c02fce0e6315c96a51efff3dfa4f1937
Jul 23 13:41:36.296134 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:36.296086    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-v878n"]
Jul 23 13:41:36.300566 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:41:36.300527    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62b09fb2_689e_433b_8621_d6ee876b59a6.slice/crio-6b7dbfaa2d6eb3f537d0639ea4573330b8fbe61aa9c9df4e0b673812dae03227 WatchSource:0}: Error finding container 6b7dbfaa2d6eb3f537d0639ea4573330b8fbe61aa9c9df4e0b673812dae03227: Status 404 returned error can't find the container with id 6b7dbfaa2d6eb3f537d0639ea4573330b8fbe61aa9c9df4e0b673812dae03227
Jul 23 13:41:36.420299 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:36.420265    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-74ntz" event={"ID":"f460d16d-e05e-45bb-b8cb-71fd972809f5","Type":"ContainerStarted","Data":"a80c64860bad22cdf51a177860d28aa8848707e58573d5adad48930621bbe52f"}
Jul 23 13:41:36.422066 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:36.422038    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wx249" event={"ID":"ebc1dbc1-a42e-4498-8678-0f6a33a11f5f","Type":"ContainerStarted","Data":"9d75018291a879f758dfd7689d8e1fc1b23a0eb54668ac8f525592327e14ee8d"}
Jul 23 13:41:36.423641 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:36.423615    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rvjth" event={"ID":"0f9ef7a1-2fa9-46bc-acc8-83a25209e294","Type":"ContainerStarted","Data":"774b0776fa89f1a9f00fe07669e272feb822f7867810c3793cd998f7e4ccf2ea"}
Jul 23 13:41:36.423733 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:36.423662    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rvjth" event={"ID":"0f9ef7a1-2fa9-46bc-acc8-83a25209e294","Type":"ContainerStarted","Data":"6611e300800f9f17d4102229a5eb67ec98dfaaeaf3a013f5012d158582988316"}
Jul 23 13:41:36.424065 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:36.424048    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-rvjth"
Jul 23 13:41:36.425689 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:36.425663    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6db7654c99-dnmqb" event={"ID":"85626da9-b35f-48f6-b12e-02554ac1b7e1","Type":"ContainerStarted","Data":"98963f5b46d84878ce0d520b69e27d340000bb7fe19dada3fdc02e438544b291"}
Jul 23 13:41:36.425773 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:36.425710    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6db7654c99-dnmqb" event={"ID":"85626da9-b35f-48f6-b12e-02554ac1b7e1","Type":"ContainerStarted","Data":"d15f604c6f1455702b73e4145c6d84638133a65c04bbc41d56b0089c6c5127a9"}
Jul 23 13:41:36.425773 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:36.425761    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6db7654c99-dnmqb"
Jul 23 13:41:36.427438 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:36.427415    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-jxgw7" event={"ID":"96de4e50-4208-4f42-ab50-0a702232ff33","Type":"ContainerStarted","Data":"461b1ddfcd19d0b616c338de89c5142ce9ab21480939eeeed3e57d3f1f2a7cf6"}
Jul 23 13:41:36.429611 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:36.429587    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cjpfp" event={"ID":"361da523-6b42-450e-ba3d-0b52b7865320","Type":"ContainerStarted","Data":"5e47ecd8f8a47bf557c94d1f5ad9f56a7bcf7e20f73c573064bf4e4ce11cb4ba"}
Jul 23 13:41:36.430829 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:36.430808    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-v878n" event={"ID":"62b09fb2-689e-433b-8621-d6ee876b59a6","Type":"ContainerStarted","Data":"6b7dbfaa2d6eb3f537d0639ea4573330b8fbe61aa9c9df4e0b673812dae03227"}
Jul 23 13:41:36.432408 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:36.432386    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-66578b4c86-6vhrf" event={"ID":"0e22af39-dd90-473a-9802-abfb83870e38","Type":"ContainerStarted","Data":"a978c980abf797456421465866249301686a054e79b46245b70971612c0b71c3"}
Jul 23 13:41:36.432487 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:36.432421    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-66578b4c86-6vhrf" event={"ID":"0e22af39-dd90-473a-9802-abfb83870e38","Type":"ContainerStarted","Data":"729323bb41ccf1673f4aaa13ff8cc253c02fce0e6315c96a51efff3dfa4f1937"}
Jul 23 13:41:36.440900 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:36.440854    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-rvjth" podStartSLOduration=67.440836469 podStartE2EDuration="1m7.440836469s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:40:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:41:36.440300414 +0000 UTC m=+67.879801337" watchObservedRunningTime="2026-07-23 13:41:36.440836469 +0000 UTC m=+67.880337388"
Jul 23 13:41:36.462316 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:36.462276    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-66578b4c86-6vhrf" podStartSLOduration=57.462262456 podStartE2EDuration="57.462262456s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:40:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:41:36.461556323 +0000 UTC m=+67.901057243" watchObservedRunningTime="2026-07-23 13:41:36.462262456 +0000 UTC m=+67.901763352"
Jul 23 13:41:36.485621 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:36.485573    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6db7654c99-dnmqb" podStartSLOduration=67.485557911 podStartE2EDuration="1m7.485557911s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:40:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:41:36.484459722 +0000 UTC m=+67.923960647" watchObservedRunningTime="2026-07-23 13:41:36.485557911 +0000 UTC m=+67.925058829"
Jul 23 13:41:37.062276 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:37.062244    2573 scope.go:117] "RemoveContainer" containerID="f2e3e81cc2150f0414d5c2d799caf53233261b4f18c1e2b1659d1abda959ac51"
Jul 23 13:41:37.093040 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:37.091808    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-66578b4c86-6vhrf"
Jul 23 13:41:37.095937 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:37.095910    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-66578b4c86-6vhrf"
Jul 23 13:41:37.167620 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:37.167590    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:37.347388 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:37.347279    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:37.444063 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:37.443973    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-vh5dp_2d624703-978f-48c2-b02d-9af8fd337236/console-operator/1.log"
Jul 23 13:41:37.444228 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:37.444130    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-vh5dp" event={"ID":"2d624703-978f-48c2-b02d-9af8fd337236","Type":"ContainerStarted","Data":"b6570eb10ad1d2f73f3ecfd7877446ae8c58f6169fa12a03d395b67383f8f31c"}
Jul 23 13:41:37.446403 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:37.444773    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:37.446403 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:37.444964    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-vh5dp"
Jul 23 13:41:37.449171 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:37.449147    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-74ntz" event={"ID":"f460d16d-e05e-45bb-b8cb-71fd972809f5","Type":"ContainerStarted","Data":"1fa8dd1aa9289fe616419db3619ab07f5fe4f71619486558d893329df06d4c3f"}
Jul 23 13:41:37.449292 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:37.449193    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-74ntz" event={"ID":"f460d16d-e05e-45bb-b8cb-71fd972809f5","Type":"ContainerStarted","Data":"eab06d00b28f86551d57be478eb3a682a1dd5be2f4cdcb34c201eefc2e4da7dc"}
Jul 23 13:41:37.449292 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:37.449224    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-66578b4c86-6vhrf"
Jul 23 13:41:37.453893 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:37.453852    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-66578b4c86-6vhrf"
Jul 23 13:41:37.468698 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:37.468288    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-vh5dp" podStartSLOduration=50.729865835 podStartE2EDuration="58.468268935s" totalImagesPullingTime="7.7384031s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:40:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:41:37.466682824 +0000 UTC m=+68.906183744" watchObservedRunningTime="2026-07-23 13:41:37.468268935 +0000 UTC m=+68.907769856"
Jul 23 13:41:37.488727 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:37.488677    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-vh5dp"
Jul 23 13:41:37.504547 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:37.503466    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-74ntz" podStartSLOduration=67.229512811 podStartE2EDuration="1m8.503450133s" totalImagesPullingTime="1.273937322s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:40:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:41:37.503388446 +0000 UTC m=+68.942889365" watchObservedRunningTime="2026-07-23 13:41:37.503450133 +0000 UTC m=+68.942951053"
Jul 23 13:41:37.536883 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:37.536845    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:37.695634 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:37.695545    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-bgxjf"]
Jul 23 13:41:37.714947 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:37.714810    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-bgxjf"]
Jul 23 13:41:37.714947 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:37.714925    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:37.715216 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:37.715053    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-bgxjf"
Jul 23 13:41:37.717782 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:37.717748    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 23 13:41:37.718519 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:37.718328    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 23 13:41:37.729300 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:37.729095    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-g5v94\""
Jul 23 13:41:37.747904 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:37.747841    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgf6r\" (UniqueName: \"kubernetes.io/projected/2b17e1f0-a160-4024-9a5d-3e9ed3cedf88-kube-api-access-zgf6r\") pod \"downloads-5bc67dcd46-bgxjf\" (UID: \"2b17e1f0-a160-4024-9a5d-3e9ed3cedf88\") " pod="openshift-console/downloads-5bc67dcd46-bgxjf"
Jul 23 13:41:37.834603 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:37.834510    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:37.848682 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:37.848651    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgf6r\" (UniqueName: \"kubernetes.io/projected/2b17e1f0-a160-4024-9a5d-3e9ed3cedf88-kube-api-access-zgf6r\") pod \"downloads-5bc67dcd46-bgxjf\" (UID: \"2b17e1f0-a160-4024-9a5d-3e9ed3cedf88\") " pod="openshift-console/downloads-5bc67dcd46-bgxjf"
Jul 23 13:41:37.866502 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:37.866429    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgf6r\" (UniqueName: \"kubernetes.io/projected/2b17e1f0-a160-4024-9a5d-3e9ed3cedf88-kube-api-access-zgf6r\") pod \"downloads-5bc67dcd46-bgxjf\" (UID: \"2b17e1f0-a160-4024-9a5d-3e9ed3cedf88\") " pod="openshift-console/downloads-5bc67dcd46-bgxjf"
Jul 23 13:41:37.979297 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:37.979174    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:38.031121 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:38.031088    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-bgxjf"
Jul 23 13:41:38.055621 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:38.055565    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:38.147029 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:38.146963    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:38.219916 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:38.219891    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-bgxjf"]
Jul 23 13:41:38.222548 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:41:38.222521    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b17e1f0_a160_4024_9a5d_3e9ed3cedf88.slice/crio-3968402a2fb6de4602cb58348c89dab606920dfc7bc351aa93c8e2d9c2e1d48d WatchSource:0}: Error finding container 3968402a2fb6de4602cb58348c89dab606920dfc7bc351aa93c8e2d9c2e1d48d: Status 404 returned error can't find the container with id 3968402a2fb6de4602cb58348c89dab606920dfc7bc351aa93c8e2d9c2e1d48d
Jul 23 13:41:38.225553 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:38.225457    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:38.347025 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:38.346973    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:38.454443 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:38.454352    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-bgxjf" event={"ID":"2b17e1f0-a160-4024-9a5d-3e9ed3cedf88","Type":"ContainerStarted","Data":"3968402a2fb6de4602cb58348c89dab606920dfc7bc351aa93c8e2d9c2e1d48d"}
Jul 23 13:41:38.536976 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:38.536940    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:38.602577 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:38.602494    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:39.372485 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:39.372449    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:39.474680 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:39.474643    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:39.598377 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:39.598308    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:39.890049 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:39.889990    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:42.082605 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:42.082538    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:42.176751 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:42.176658    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:43.039793 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:43.039755    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:43.132549 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:43.132401    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:43.205964 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:43.205805    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:43.478524 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:43.478441    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-jxgw7" event={"ID":"96de4e50-4208-4f42-ab50-0a702232ff33","Type":"ContainerStarted","Data":"f0408614a41fa90535d18dd1d6157855398363fa38b8ac61770fb858260f555f"}
Jul 23 13:41:43.480847 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:43.480813    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cjpfp" event={"ID":"361da523-6b42-450e-ba3d-0b52b7865320","Type":"ContainerStarted","Data":"0b5e0e590ea68b5acea3f2d930f9f609ba750502f481599dc1ba4e19250514d0"}
Jul 23 13:41:43.483280 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:43.483252    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-v878n" event={"ID":"62b09fb2-689e-433b-8621-d6ee876b59a6","Type":"ContainerStarted","Data":"73aab957e0cf183a01595910902564b7a1335ba89bae50acdc8335ac3f459c8e"}
Jul 23 13:41:43.483381 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:43.483307    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-v878n" event={"ID":"62b09fb2-689e-433b-8621-d6ee876b59a6","Type":"ContainerStarted","Data":"cc20edf8f38bf1f09aa63fae178f97ff9d16dcfcf7f62a9a49b4fabb7b596b8a"}
Jul 23 13:41:43.483381 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:43.483359    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-v878n"
Jul 23 13:41:43.498273 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:43.498222    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-jxgw7" podStartSLOduration=58.49552428 podStartE2EDuration="1m4.498205076s" totalImagesPullingTime="6.002680796s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:40:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:41:43.497521424 +0000 UTC m=+74.937022346" watchObservedRunningTime="2026-07-23 13:41:43.498205076 +0000 UTC m=+74.937705995"
Jul 23 13:41:43.522022 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:43.521963    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-v878n" podStartSLOduration=34.215614804 podStartE2EDuration="40.521949446s" totalImagesPullingTime="6.306334642s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:41:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:41:43.520057741 +0000 UTC m=+74.959558658" watchObservedRunningTime="2026-07-23 13:41:43.521949446 +0000 UTC m=+74.961450357"
Jul 23 13:41:43.709925 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:43.709777    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:45.493566 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:45.493467    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wx249" event={"ID":"ebc1dbc1-a42e-4498-8678-0f6a33a11f5f","Type":"ContainerStarted","Data":"9a2b79367541ed089e621957fefad6fd7d538cab3c530d9c3fe08c9016069809"}
Jul 23 13:41:45.512678 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:45.512321    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-wx249" podStartSLOduration=67.306029118 podStartE2EDuration="1m16.512298504s" totalImagesPullingTime="9.206269386s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 13:40:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:41:45.51060276 +0000 UTC m=+76.950103684" watchObservedRunningTime="2026-07-23 13:41:45.512298504 +0000 UTC m=+76.951799422"
Jul 23 13:41:46.360602 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:46.360568    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:46.463241 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:46.463205    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:49.024000 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:49.023966    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:49.124242 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:49.124209    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:49.514798 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:49.514757    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cjpfp" event={"ID":"361da523-6b42-450e-ba3d-0b52b7865320","Type":"ContainerStarted","Data":"15a9ea5a2460055c8fb36d251f06fdccfd2dfae85d8c474bd63d03ffe738e75b"}
Jul 23 13:41:49.534567 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:49.534514    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-cjpfp" podStartSLOduration=17.528389126 podStartE2EDuration="35.534498234s" totalImagesPullingTime="18.006109108s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 13:41:14 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:41:49.533187303 +0000 UTC m=+80.972688225" watchObservedRunningTime="2026-07-23 13:41:49.534498234 +0000 UTC m=+80.973999152"
Jul 23 13:41:49.983869 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:49.983824    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:50.045552 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:50.045494    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:50.237122 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:50.237046    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:50.332001 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:50.331964    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:50.665843 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:50.665801    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:50.721522 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:50.721484    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:52.388376 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:52.388327    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:52.488645 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:52.488597    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:53.490613 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:53.490577    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-v878n"
Jul 23 13:41:53.874254 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:53.874219    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:54.416131 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:54.416086    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:54.515603 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:54.515567    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:54.887299 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:54.887258    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:55.397700 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:55.397638    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:55.527937 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:55.527902    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:55.646724 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:55.646665    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:55.664123 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:55.664051    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-vch6s"]
Jul 23 13:41:55.669317 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:55.669290    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vch6s"
Jul 23 13:41:55.671714 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:55.671693    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-j9cvs\""
Jul 23 13:41:55.672097 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:55.672078    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 23 13:41:55.673431 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:55.672618    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 23 13:41:55.673431 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:55.672829    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 23 13:41:55.673431 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:55.673257    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 23 13:41:55.744409 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:55.744373    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:55.747955 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:55.747909    2573 patch_prober.go:28] interesting pod/image-registry-6db7654c99-dnmqb container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 23 13:41:55.748108 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:55.747971    2573 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6db7654c99-dnmqb" podUID="85626da9-b35f-48f6-b12e-02554ac1b7e1" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 23 13:41:55.802366 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:55.802328    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/13911ca8-4762-4532-8c6d-780f80f39478-root\") pod \"node-exporter-vch6s\" (UID: \"13911ca8-4762-4532-8c6d-780f80f39478\") " pod="openshift-monitoring/node-exporter-vch6s"
Jul 23 13:41:55.802531 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:55.802376    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/13911ca8-4762-4532-8c6d-780f80f39478-metrics-client-ca\") pod \"node-exporter-vch6s\" (UID: \"13911ca8-4762-4532-8c6d-780f80f39478\") " pod="openshift-monitoring/node-exporter-vch6s"
Jul 23 13:41:55.802531 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:55.802449    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/13911ca8-4762-4532-8c6d-780f80f39478-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vch6s\" (UID: \"13911ca8-4762-4532-8c6d-780f80f39478\") " pod="openshift-monitoring/node-exporter-vch6s"
Jul 23 13:41:55.802633 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:55.802544    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/13911ca8-4762-4532-8c6d-780f80f39478-sys\") pod \"node-exporter-vch6s\" (UID: \"13911ca8-4762-4532-8c6d-780f80f39478\") " pod="openshift-monitoring/node-exporter-vch6s"
Jul 23 13:41:55.802633 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:55.802596    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jn457\" (UniqueName: \"kubernetes.io/projected/13911ca8-4762-4532-8c6d-780f80f39478-kube-api-access-jn457\") pod \"node-exporter-vch6s\" (UID: \"13911ca8-4762-4532-8c6d-780f80f39478\") " pod="openshift-monitoring/node-exporter-vch6s"
Jul 23 13:41:55.802730 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:55.802636    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/13911ca8-4762-4532-8c6d-780f80f39478-node-exporter-tls\") pod \"node-exporter-vch6s\" (UID: \"13911ca8-4762-4532-8c6d-780f80f39478\") " pod="openshift-monitoring/node-exporter-vch6s"
Jul 23 13:41:55.802730 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:55.802697    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/13911ca8-4762-4532-8c6d-780f80f39478-node-exporter-wtmp\") pod \"node-exporter-vch6s\" (UID: \"13911ca8-4762-4532-8c6d-780f80f39478\") " pod="openshift-monitoring/node-exporter-vch6s"
Jul 23 13:41:55.802730 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:55.802722    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/13911ca8-4762-4532-8c6d-780f80f39478-node-exporter-accelerators-collector-config\") pod \"node-exporter-vch6s\" (UID: \"13911ca8-4762-4532-8c6d-780f80f39478\") " pod="openshift-monitoring/node-exporter-vch6s"
Jul 23 13:41:55.802859 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:55.802787    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/13911ca8-4762-4532-8c6d-780f80f39478-node-exporter-textfile\") pod \"node-exporter-vch6s\" (UID: \"13911ca8-4762-4532-8c6d-780f80f39478\") " pod="openshift-monitoring/node-exporter-vch6s"
Jul 23 13:41:55.848223 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:55.848166    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:55.903362 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:55.903325    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/13911ca8-4762-4532-8c6d-780f80f39478-node-exporter-wtmp\") pod \"node-exporter-vch6s\" (UID: \"13911ca8-4762-4532-8c6d-780f80f39478\") " pod="openshift-monitoring/node-exporter-vch6s"
Jul 23 13:41:55.903524 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:55.903374    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/13911ca8-4762-4532-8c6d-780f80f39478-node-exporter-accelerators-collector-config\") pod \"node-exporter-vch6s\" (UID: \"13911ca8-4762-4532-8c6d-780f80f39478\") " pod="openshift-monitoring/node-exporter-vch6s"
Jul 23 13:41:55.903524 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:55.903413    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/13911ca8-4762-4532-8c6d-780f80f39478-node-exporter-textfile\") pod \"node-exporter-vch6s\" (UID: \"13911ca8-4762-4532-8c6d-780f80f39478\") " pod="openshift-monitoring/node-exporter-vch6s"
Jul 23 13:41:55.903524 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:55.903443    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/13911ca8-4762-4532-8c6d-780f80f39478-root\") pod \"node-exporter-vch6s\" (UID: \"13911ca8-4762-4532-8c6d-780f80f39478\") " pod="openshift-monitoring/node-exporter-vch6s"
Jul 23 13:41:55.903524 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:55.903470    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/13911ca8-4762-4532-8c6d-780f80f39478-metrics-client-ca\") pod \"node-exporter-vch6s\" (UID: \"13911ca8-4762-4532-8c6d-780f80f39478\") " pod="openshift-monitoring/node-exporter-vch6s"
Jul 23 13:41:55.903524 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:55.903512    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/13911ca8-4762-4532-8c6d-780f80f39478-node-exporter-wtmp\") pod \"node-exporter-vch6s\" (UID: \"13911ca8-4762-4532-8c6d-780f80f39478\") " pod="openshift-monitoring/node-exporter-vch6s"
Jul 23 13:41:55.903722 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:55.903547    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/13911ca8-4762-4532-8c6d-780f80f39478-root\") pod \"node-exporter-vch6s\" (UID: \"13911ca8-4762-4532-8c6d-780f80f39478\") " pod="openshift-monitoring/node-exporter-vch6s"
Jul 23 13:41:55.903722 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:55.903634    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/13911ca8-4762-4532-8c6d-780f80f39478-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vch6s\" (UID: \"13911ca8-4762-4532-8c6d-780f80f39478\") " pod="openshift-monitoring/node-exporter-vch6s"
Jul 23 13:41:55.903722 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:55.903693    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/13911ca8-4762-4532-8c6d-780f80f39478-sys\") pod \"node-exporter-vch6s\" (UID: \"13911ca8-4762-4532-8c6d-780f80f39478\") " pod="openshift-monitoring/node-exporter-vch6s"
Jul 23 13:41:55.903841 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:55.903740    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jn457\" (UniqueName: \"kubernetes.io/projected/13911ca8-4762-4532-8c6d-780f80f39478-kube-api-access-jn457\") pod \"node-exporter-vch6s\" (UID: \"13911ca8-4762-4532-8c6d-780f80f39478\") " pod="openshift-monitoring/node-exporter-vch6s"
Jul 23 13:41:55.903841 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:55.903784    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/13911ca8-4762-4532-8c6d-780f80f39478-node-exporter-tls\") pod \"node-exporter-vch6s\" (UID: \"13911ca8-4762-4532-8c6d-780f80f39478\") " pod="openshift-monitoring/node-exporter-vch6s"
Jul 23 13:41:55.903940 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:55.903925    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/13911ca8-4762-4532-8c6d-780f80f39478-node-exporter-textfile\") pod \"node-exporter-vch6s\" (UID: \"13911ca8-4762-4532-8c6d-780f80f39478\") " pod="openshift-monitoring/node-exporter-vch6s"
Jul 23 13:41:55.903994 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:55.903984    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/13911ca8-4762-4532-8c6d-780f80f39478-sys\") pod \"node-exporter-vch6s\" (UID: \"13911ca8-4762-4532-8c6d-780f80f39478\") " pod="openshift-monitoring/node-exporter-vch6s"
Jul 23 13:41:55.904100 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:55.904078    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/13911ca8-4762-4532-8c6d-780f80f39478-node-exporter-accelerators-collector-config\") pod \"node-exporter-vch6s\" (UID: \"13911ca8-4762-4532-8c6d-780f80f39478\") " pod="openshift-monitoring/node-exporter-vch6s"
Jul 23 13:41:55.904211 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:55.904187    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/13911ca8-4762-4532-8c6d-780f80f39478-metrics-client-ca\") pod \"node-exporter-vch6s\" (UID: \"13911ca8-4762-4532-8c6d-780f80f39478\") " pod="openshift-monitoring/node-exporter-vch6s"
Jul 23 13:41:55.906693 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:55.906666    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/13911ca8-4762-4532-8c6d-780f80f39478-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vch6s\" (UID: \"13911ca8-4762-4532-8c6d-780f80f39478\") " pod="openshift-monitoring/node-exporter-vch6s"
Jul 23 13:41:55.906795 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:55.906778    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/13911ca8-4762-4532-8c6d-780f80f39478-node-exporter-tls\") pod \"node-exporter-vch6s\" (UID: \"13911ca8-4762-4532-8c6d-780f80f39478\") " pod="openshift-monitoring/node-exporter-vch6s"
Jul 23 13:41:55.912983 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:55.912962    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jn457\" (UniqueName: \"kubernetes.io/projected/13911ca8-4762-4532-8c6d-780f80f39478-kube-api-access-jn457\") pod \"node-exporter-vch6s\" (UID: \"13911ca8-4762-4532-8c6d-780f80f39478\") " pod="openshift-monitoring/node-exporter-vch6s"
Jul 23 13:41:55.945086 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:55.944267    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:55.982066 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:55.981821    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vch6s"
Jul 23 13:41:56.043874 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:56.043832    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:56.120742 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:56.120684    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:56.633277 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:56.633241    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:57.456259 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:57.456225    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6db7654c99-dnmqb"
Jul 23 13:41:58.538471 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:58.538376    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:58.641904 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:58.641812    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:58.947306 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:58.947226    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:59.702032 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:59.701972    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:59.803113 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:59.803076    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:59.910255 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:41:59.910218    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:42:00.028478 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:00.028396    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6db7654c99-dnmqb"]
Jul 23 13:42:00.065940 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:42:00.065912    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13911ca8_4762_4532_8c6d_780f80f39478.slice/crio-7385633ddacacc3483d81c6577a94a00c41c46548873b0a6efd4382ad9ff756d WatchSource:0}: Error finding container 7385633ddacacc3483d81c6577a94a00c41c46548873b0a6efd4382ad9ff756d: Status 404 returned error can't find the container with id 7385633ddacacc3483d81c6577a94a00c41c46548873b0a6efd4382ad9ff756d
Jul 23 13:42:00.122429 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:00.122398    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:42:00.186314 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:00.186281    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:42:00.440865 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:00.440816    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:42:00.524509 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:00.524472    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:42:00.564707 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:00.564631    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vch6s" event={"ID":"13911ca8-4762-4532-8c6d-780f80f39478","Type":"ContainerStarted","Data":"7385633ddacacc3483d81c6577a94a00c41c46548873b0a6efd4382ad9ff756d"}
Jul 23 13:42:00.805301 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:00.805265    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:42:01.061088 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:01.061056    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:42:01.574774 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:01.573635    2573 generic.go:356] "Generic (PLEG): container finished" podID="13911ca8-4762-4532-8c6d-780f80f39478" containerID="5693c23fb536264a473f1e358eca43e4d240d6dfd95ca5cd2f22d3835ac84970" exitCode=0
Jul 23 13:42:01.574774 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:01.573725    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vch6s" event={"ID":"13911ca8-4762-4532-8c6d-780f80f39478","Type":"ContainerDied","Data":"5693c23fb536264a473f1e358eca43e4d240d6dfd95ca5cd2f22d3835ac84970"}
Jul 23 13:42:01.575861 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:01.575829    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-bgxjf" event={"ID":"2b17e1f0-a160-4024-9a5d-3e9ed3cedf88","Type":"ContainerStarted","Data":"36f9f6401b9629ac9668b2ebfd1f2b89bcc2231b3c9f0f6b6442e1a3ee2ef700"}
Jul 23 13:42:01.576270 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:01.576203    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-bgxjf"
Jul 23 13:42:01.588579 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:01.588557    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-bgxjf"
Jul 23 13:42:01.631270 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:01.631208    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-bgxjf" podStartSLOduration=2.395528256 podStartE2EDuration="24.631188747s" totalImagesPullingTime="22.235660491s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:41:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:42:01.630515817 +0000 UTC m=+93.070016736" watchObservedRunningTime="2026-07-23 13:42:01.631188747 +0000 UTC m=+93.070689753"
Jul 23 13:42:01.908709 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:01.908666    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:42:02.583247 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:02.583198    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vch6s" event={"ID":"13911ca8-4762-4532-8c6d-780f80f39478","Type":"ContainerStarted","Data":"37461c42517536782d4b12e0ed3d760e7844dfeac49c1ec825ebe6b5cf2c97f4"}
Jul 23 13:42:02.583423 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:02.583272    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vch6s" event={"ID":"13911ca8-4762-4532-8c6d-780f80f39478","Type":"ContainerStarted","Data":"b9536e2e8484d1689575fb6b3e443b00536c78cf60b35b1fcdbc8aab730f9a2a"}
Jul 23 13:42:02.607665 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:02.607616    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-vch6s" podStartSLOduration=6.550499879 podStartE2EDuration="7.607596259s" totalImagesPullingTime="979.301246ms" totalInitContainerRuntime="77.795134ms" isStatefulPod=true podCreationTimestamp="2026-07-23 13:41:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:42:02.605890511 +0000 UTC m=+94.045391444" watchObservedRunningTime="2026-07-23 13:42:02.607596259 +0000 UTC m=+94.047097180"
Jul 23 13:42:02.696705 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:02.696667    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:42:02.798733 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:02.798688    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:42:03.809928 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:03.809884    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:42:03.916472 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:03.916429    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:42:04.993536 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:04.993502    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:42:05.091921 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:05.091884    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:42:05.213794 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:05.213761    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:42:05.286656 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:05.286619    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:42:05.928843 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:05.928806    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:42:06.029588 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:06.029543    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:42:07.240570 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:07.240533    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:42:07.315875 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:07.315837    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:42:07.453034 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:07.452976    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-rvjth"
Jul 23 13:42:08.084134 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:08.084090    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:42:11.854534 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:11.854500    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:42:12.054123 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:12.054093    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:42:14.697854 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:14.697820    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:42:14.764258 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:14.764220    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:42:14.824662 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:14.824627    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:42:15.068894 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:15.068856    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:42:15.173169 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:15.173129    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:42:19.998950 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:19.998907    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:42:20.207863 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:20.207829    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:42:25.049770 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:25.049705    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6db7654c99-dnmqb" podUID="85626da9-b35f-48f6-b12e-02554ac1b7e1" containerName="registry" containerID="cri-o://98963f5b46d84878ce0d520b69e27d340000bb7fe19dada3fdc02e438544b291" gracePeriod=30
Jul 23 13:42:25.342003 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:25.341969    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6db7654c99-dnmqb"
Jul 23 13:42:25.360883 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:25.360850    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/85626da9-b35f-48f6-b12e-02554ac1b7e1-installation-pull-secrets\") pod \"85626da9-b35f-48f6-b12e-02554ac1b7e1\" (UID: \"85626da9-b35f-48f6-b12e-02554ac1b7e1\") "
Jul 23 13:42:25.360883 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:25.360885    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/85626da9-b35f-48f6-b12e-02554ac1b7e1-registry-tls\") pod \"85626da9-b35f-48f6-b12e-02554ac1b7e1\" (UID: \"85626da9-b35f-48f6-b12e-02554ac1b7e1\") "
Jul 23 13:42:25.361129 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:25.360908    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/85626da9-b35f-48f6-b12e-02554ac1b7e1-ca-trust-extracted\") pod \"85626da9-b35f-48f6-b12e-02554ac1b7e1\" (UID: \"85626da9-b35f-48f6-b12e-02554ac1b7e1\") "
Jul 23 13:42:25.361129 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:25.360927    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-47grr\" (UniqueName: \"kubernetes.io/projected/85626da9-b35f-48f6-b12e-02554ac1b7e1-kube-api-access-47grr\") pod \"85626da9-b35f-48f6-b12e-02554ac1b7e1\" (UID: \"85626da9-b35f-48f6-b12e-02554ac1b7e1\") "
Jul 23 13:42:25.361129 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:25.361055    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/85626da9-b35f-48f6-b12e-02554ac1b7e1-bound-sa-token\") pod \"85626da9-b35f-48f6-b12e-02554ac1b7e1\" (UID: \"85626da9-b35f-48f6-b12e-02554ac1b7e1\") "
Jul 23 13:42:25.361129 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:25.361097    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/85626da9-b35f-48f6-b12e-02554ac1b7e1-registry-certificates\") pod \"85626da9-b35f-48f6-b12e-02554ac1b7e1\" (UID: \"85626da9-b35f-48f6-b12e-02554ac1b7e1\") "
Jul 23 13:42:25.361349 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:25.361246    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/85626da9-b35f-48f6-b12e-02554ac1b7e1-trusted-ca\") pod \"85626da9-b35f-48f6-b12e-02554ac1b7e1\" (UID: \"85626da9-b35f-48f6-b12e-02554ac1b7e1\") "
Jul 23 13:42:25.361349 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:25.361323    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/85626da9-b35f-48f6-b12e-02554ac1b7e1-image-registry-private-configuration\") pod \"85626da9-b35f-48f6-b12e-02554ac1b7e1\" (UID: \"85626da9-b35f-48f6-b12e-02554ac1b7e1\") "
Jul 23 13:42:25.361605 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:25.361580    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85626da9-b35f-48f6-b12e-02554ac1b7e1-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "85626da9-b35f-48f6-b12e-02554ac1b7e1" (UID: "85626da9-b35f-48f6-b12e-02554ac1b7e1"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 13:42:25.361680 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:25.361643    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85626da9-b35f-48f6-b12e-02554ac1b7e1-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "85626da9-b35f-48f6-b12e-02554ac1b7e1" (UID: "85626da9-b35f-48f6-b12e-02554ac1b7e1"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 13:42:25.363433 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:25.363380    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85626da9-b35f-48f6-b12e-02554ac1b7e1-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "85626da9-b35f-48f6-b12e-02554ac1b7e1" (UID: "85626da9-b35f-48f6-b12e-02554ac1b7e1"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 13:42:25.363573 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:25.363449    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85626da9-b35f-48f6-b12e-02554ac1b7e1-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "85626da9-b35f-48f6-b12e-02554ac1b7e1" (UID: "85626da9-b35f-48f6-b12e-02554ac1b7e1"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:42:25.363573 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:25.363518    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85626da9-b35f-48f6-b12e-02554ac1b7e1-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "85626da9-b35f-48f6-b12e-02554ac1b7e1" (UID: "85626da9-b35f-48f6-b12e-02554ac1b7e1"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:42:25.363876 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:25.363855    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85626da9-b35f-48f6-b12e-02554ac1b7e1-kube-api-access-47grr" (OuterVolumeSpecName: "kube-api-access-47grr") pod "85626da9-b35f-48f6-b12e-02554ac1b7e1" (UID: "85626da9-b35f-48f6-b12e-02554ac1b7e1"). InnerVolumeSpecName "kube-api-access-47grr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:42:25.363948 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:25.363860    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85626da9-b35f-48f6-b12e-02554ac1b7e1-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "85626da9-b35f-48f6-b12e-02554ac1b7e1" (UID: "85626da9-b35f-48f6-b12e-02554ac1b7e1"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 13:42:25.369787 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:25.369758    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85626da9-b35f-48f6-b12e-02554ac1b7e1-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "85626da9-b35f-48f6-b12e-02554ac1b7e1" (UID: "85626da9-b35f-48f6-b12e-02554ac1b7e1"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 13:42:25.462485 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:25.462445    2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/85626da9-b35f-48f6-b12e-02554ac1b7e1-trusted-ca\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 13:42:25.462485 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:25.462479    2573 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/85626da9-b35f-48f6-b12e-02554ac1b7e1-image-registry-private-configuration\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 13:42:25.462485 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:25.462491    2573 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/85626da9-b35f-48f6-b12e-02554ac1b7e1-installation-pull-secrets\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 13:42:25.462711 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:25.462501    2573 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/85626da9-b35f-48f6-b12e-02554ac1b7e1-registry-tls\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 13:42:25.462711 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:25.462509    2573 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/85626da9-b35f-48f6-b12e-02554ac1b7e1-ca-trust-extracted\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 13:42:25.462711 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:25.462540    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-47grr\" (UniqueName: \"kubernetes.io/projected/85626da9-b35f-48f6-b12e-02554ac1b7e1-kube-api-access-47grr\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 13:42:25.462711 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:25.462550    2573 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/85626da9-b35f-48f6-b12e-02554ac1b7e1-bound-sa-token\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 13:42:25.462711 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:25.462558    2573 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/85626da9-b35f-48f6-b12e-02554ac1b7e1-registry-certificates\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 13:42:25.673325 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:25.673231    2573 generic.go:356] "Generic (PLEG): container finished" podID="85626da9-b35f-48f6-b12e-02554ac1b7e1" containerID="98963f5b46d84878ce0d520b69e27d340000bb7fe19dada3fdc02e438544b291" exitCode=0
Jul 23 13:42:25.673325 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:25.673298    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6db7654c99-dnmqb"
Jul 23 13:42:25.673497 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:25.673319    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6db7654c99-dnmqb" event={"ID":"85626da9-b35f-48f6-b12e-02554ac1b7e1","Type":"ContainerDied","Data":"98963f5b46d84878ce0d520b69e27d340000bb7fe19dada3fdc02e438544b291"}
Jul 23 13:42:25.673497 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:25.673399    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6db7654c99-dnmqb" event={"ID":"85626da9-b35f-48f6-b12e-02554ac1b7e1","Type":"ContainerDied","Data":"d15f604c6f1455702b73e4145c6d84638133a65c04bbc41d56b0089c6c5127a9"}
Jul 23 13:42:25.673497 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:25.673421    2573 scope.go:117] "RemoveContainer" containerID="98963f5b46d84878ce0d520b69e27d340000bb7fe19dada3fdc02e438544b291"
Jul 23 13:42:25.682097 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:25.682078    2573 scope.go:117] "RemoveContainer" containerID="98963f5b46d84878ce0d520b69e27d340000bb7fe19dada3fdc02e438544b291"
Jul 23 13:42:25.682393 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:42:25.682372    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98963f5b46d84878ce0d520b69e27d340000bb7fe19dada3fdc02e438544b291\": container with ID starting with 98963f5b46d84878ce0d520b69e27d340000bb7fe19dada3fdc02e438544b291 not found: ID does not exist" containerID="98963f5b46d84878ce0d520b69e27d340000bb7fe19dada3fdc02e438544b291"
Jul 23 13:42:25.682443 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:25.682401    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98963f5b46d84878ce0d520b69e27d340000bb7fe19dada3fdc02e438544b291"} err="failed to get container status \"98963f5b46d84878ce0d520b69e27d340000bb7fe19dada3fdc02e438544b291\": rpc error: code = NotFound desc = could not find container \"98963f5b46d84878ce0d520b69e27d340000bb7fe19dada3fdc02e438544b291\": container with ID starting with 98963f5b46d84878ce0d520b69e27d340000bb7fe19dada3fdc02e438544b291 not found: ID does not exist"
Jul 23 13:42:25.697705 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:25.697684    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6db7654c99-dnmqb"]
Jul 23 13:42:25.699851 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:25.699831    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6db7654c99-dnmqb"]
Jul 23 13:42:27.066427 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:27.066393    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85626da9-b35f-48f6-b12e-02554ac1b7e1" path="/var/lib/kubelet/pods/85626da9-b35f-48f6-b12e-02554ac1b7e1/volumes"
Jul 23 13:42:29.690810 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:29.690776    2573 generic.go:356] "Generic (PLEG): container finished" podID="0825a9ee-4ce9-460c-90a2-6e285f9adc51" containerID="badb0d43015185f759c05a7ccd06589c8e15fbc90269d40bdc4bbeb3ae925cc0" exitCode=0
Jul 23 13:42:29.691203 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:29.690838    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-7zf2f" event={"ID":"0825a9ee-4ce9-460c-90a2-6e285f9adc51","Type":"ContainerDied","Data":"badb0d43015185f759c05a7ccd06589c8e15fbc90269d40bdc4bbeb3ae925cc0"}
Jul 23 13:42:29.691203 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:29.691152    2573 scope.go:117] "RemoveContainer" containerID="badb0d43015185f759c05a7ccd06589c8e15fbc90269d40bdc4bbeb3ae925cc0"
Jul 23 13:42:30.697163 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:30.697124    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-7zf2f" event={"ID":"0825a9ee-4ce9-460c-90a2-6e285f9adc51","Type":"ContainerStarted","Data":"14bb43fe66fde0d9cb0921239497b11f414576aefe001af9944819a7fadaae50"}
Jul 23 13:42:32.764488 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:32.764457    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:42:32.826519 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:32.826488    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:42:34.976065 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:34.976003    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:42:35.077590 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:35.077556    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:42:39.731348 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:39.731312    2573 generic.go:356] "Generic (PLEG): container finished" podID="bcc90ce2-5ae1-44ce-8842-aa5e7f477776" containerID="88c4014eab15a2abba2c587776aa076bae0815c9f4f6a65ba760b92ab8cddd11" exitCode=0
Jul 23 13:42:39.731712 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:39.731383    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-jmlv7" event={"ID":"bcc90ce2-5ae1-44ce-8842-aa5e7f477776","Type":"ContainerDied","Data":"88c4014eab15a2abba2c587776aa076bae0815c9f4f6a65ba760b92ab8cddd11"}
Jul 23 13:42:39.731767 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:39.731738    2573 scope.go:117] "RemoveContainer" containerID="88c4014eab15a2abba2c587776aa076bae0815c9f4f6a65ba760b92ab8cddd11"
Jul 23 13:42:40.737245 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:40.737206    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-jmlv7" event={"ID":"bcc90ce2-5ae1-44ce-8842-aa5e7f477776","Type":"ContainerStarted","Data":"2a3f5d1a4a388f8e67171048da515a982b887d48dbd0439eae8137956ce75c89"}
Jul 23 13:42:44.376140 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:44.376108    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:42:44.432728 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:44.432689    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:42:48.768429 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:48.768400    2573 generic.go:356] "Generic (PLEG): container finished" podID="b13a7207-47ba-4e8e-a62b-97546e957cdd" containerID="9f3f29706b519000dd5176d2aaa2ba98cc0e44a6a663f69de52468c27ecf939e" exitCode=0
Jul 23 13:42:48.768743 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:48.768479    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-25jdb" event={"ID":"b13a7207-47ba-4e8e-a62b-97546e957cdd","Type":"ContainerDied","Data":"9f3f29706b519000dd5176d2aaa2ba98cc0e44a6a663f69de52468c27ecf939e"}
Jul 23 13:42:48.768831 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:48.768816    2573 scope.go:117] "RemoveContainer" containerID="9f3f29706b519000dd5176d2aaa2ba98cc0e44a6a663f69de52468c27ecf939e"
Jul 23 13:42:49.687725 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:49.687669    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:42:49.755383 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:49.755345    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:42:49.773772 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:42:49.773745    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-25jdb" event={"ID":"b13a7207-47ba-4e8e-a62b-97546e957cdd","Type":"ContainerStarted","Data":"b32c580ca78afbe20986922ed37d35d2d38765d308b38275a3610ba055483684"}
Jul 23 13:43:14.883091 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:43:14.883035    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:43:15.240001 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:43:15.239892    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:43:24.067462 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:43:24.067356    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:43:24.168915 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:43:24.168880    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:43:24.222350 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:43:24.222320    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:43:24.768955 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:43:24.768906    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:43:24.834973 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:43:24.834940    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:43:35.023481 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:43:35.023444    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:43:35.123376 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:43:35.123330    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:43:35.224939 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:43:35.224902    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:44:19.850340 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:44:19.850301    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:44:20.076336 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:44:20.076294    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:44:30.197222 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:44:30.197179    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:44:30.291193 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:44:30.291150    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:44:37.859696 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:44:37.859655    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:44:37.924653 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:44:37.924609    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:44:37.996981 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:44:37.996943    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:44:38.055295 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:44:38.055258    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:44:38.705217 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:44:38.705183    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:44:42.137822 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:44:42.137787    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:44:42.199282 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:44:42.199240    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:44:48.395176 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:44:48.395141    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:44:48.469765 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:44:48.469735    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:44:50.000293 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:44:50.000253    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:44:50.093801 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:44:50.093762    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:44:53.607465 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:44:53.607377    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:44:53.707488 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:44:53.707442    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:45:12.546922 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:45:12.546883    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:45:12.631169 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:45:12.631135    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:45:12.638772 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:45:12.638746    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d95d7b58d-jjwd5"]
Jul 23 13:45:12.639101 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:45:12.639088    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85626da9-b35f-48f6-b12e-02554ac1b7e1" containerName="registry"
Jul 23 13:45:12.639154 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:45:12.639104    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="85626da9-b35f-48f6-b12e-02554ac1b7e1" containerName="registry"
Jul 23 13:45:12.639189 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:45:12.639160    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="85626da9-b35f-48f6-b12e-02554ac1b7e1" containerName="registry"
Jul 23 13:45:12.642006 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:45:12.641990    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d95d7b58d-jjwd5"
Jul 23 13:45:12.645388 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:45:12.645365    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 23 13:45:12.645388 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:45:12.645390    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 23 13:45:12.645580 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:45:12.645393    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 23 13:45:12.645580 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:45:12.645469    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 23 13:45:12.656680 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:45:12.656656    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d95d7b58d-jjwd5"]
Jul 23 13:45:12.708167 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:45:12.708137    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:45:12.726318 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:45:12.726287    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/d2e6ca0a-3716-45b4-917c-fa2f614d183e-klusterlet-config\") pod \"klusterlet-addon-workmgr-6d95d7b58d-jjwd5\" (UID: \"d2e6ca0a-3716-45b4-917c-fa2f614d183e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d95d7b58d-jjwd5"
Jul 23 13:45:12.726458 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:45:12.726327    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d2e6ca0a-3716-45b4-917c-fa2f614d183e-tmp\") pod \"klusterlet-addon-workmgr-6d95d7b58d-jjwd5\" (UID: \"d2e6ca0a-3716-45b4-917c-fa2f614d183e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d95d7b58d-jjwd5"
Jul 23 13:45:12.726458 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:45:12.726395    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6p27m\" (UniqueName: \"kubernetes.io/projected/d2e6ca0a-3716-45b4-917c-fa2f614d183e-kube-api-access-6p27m\") pod \"klusterlet-addon-workmgr-6d95d7b58d-jjwd5\" (UID: \"d2e6ca0a-3716-45b4-917c-fa2f614d183e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d95d7b58d-jjwd5"
Jul 23 13:45:12.827352 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:45:12.827266    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d2e6ca0a-3716-45b4-917c-fa2f614d183e-tmp\") pod \"klusterlet-addon-workmgr-6d95d7b58d-jjwd5\" (UID: \"d2e6ca0a-3716-45b4-917c-fa2f614d183e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d95d7b58d-jjwd5"
Jul 23 13:45:12.827352 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:45:12.827311    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6p27m\" (UniqueName: \"kubernetes.io/projected/d2e6ca0a-3716-45b4-917c-fa2f614d183e-kube-api-access-6p27m\") pod \"klusterlet-addon-workmgr-6d95d7b58d-jjwd5\" (UID: \"d2e6ca0a-3716-45b4-917c-fa2f614d183e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d95d7b58d-jjwd5"
Jul 23 13:45:12.827579 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:45:12.827358    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/d2e6ca0a-3716-45b4-917c-fa2f614d183e-klusterlet-config\") pod \"klusterlet-addon-workmgr-6d95d7b58d-jjwd5\" (UID: \"d2e6ca0a-3716-45b4-917c-fa2f614d183e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d95d7b58d-jjwd5"
Jul 23 13:45:12.827720 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:45:12.827694    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d2e6ca0a-3716-45b4-917c-fa2f614d183e-tmp\") pod \"klusterlet-addon-workmgr-6d95d7b58d-jjwd5\" (UID: \"d2e6ca0a-3716-45b4-917c-fa2f614d183e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d95d7b58d-jjwd5"
Jul 23 13:45:12.829689 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:45:12.829670    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/d2e6ca0a-3716-45b4-917c-fa2f614d183e-klusterlet-config\") pod \"klusterlet-addon-workmgr-6d95d7b58d-jjwd5\" (UID: \"d2e6ca0a-3716-45b4-917c-fa2f614d183e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d95d7b58d-jjwd5"
Jul 23 13:45:12.835125 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:45:12.835099    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6p27m\" (UniqueName: \"kubernetes.io/projected/d2e6ca0a-3716-45b4-917c-fa2f614d183e-kube-api-access-6p27m\") pod \"klusterlet-addon-workmgr-6d95d7b58d-jjwd5\" (UID: \"d2e6ca0a-3716-45b4-917c-fa2f614d183e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d95d7b58d-jjwd5"
Jul 23 13:45:12.951122 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:45:12.951080    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d95d7b58d-jjwd5"
Jul 23 13:45:13.075328 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:45:13.075295    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d95d7b58d-jjwd5"]
Jul 23 13:45:13.078375 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:45:13.078321    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2e6ca0a_3716_45b4_917c_fa2f614d183e.slice/crio-bbc9456f426bb30576da37d31c05bfd4c87f05cb1672f527414f4ea7ee2132e5 WatchSource:0}: Error finding container bbc9456f426bb30576da37d31c05bfd4c87f05cb1672f527414f4ea7ee2132e5: Status 404 returned error can't find the container with id bbc9456f426bb30576da37d31c05bfd4c87f05cb1672f527414f4ea7ee2132e5
Jul 23 13:45:13.302393 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:45:13.302348    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d95d7b58d-jjwd5" event={"ID":"d2e6ca0a-3716-45b4-917c-fa2f614d183e","Type":"ContainerStarted","Data":"bbc9456f426bb30576da37d31c05bfd4c87f05cb1672f527414f4ea7ee2132e5"}
Jul 23 13:45:17.321426 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:45:17.321386    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d95d7b58d-jjwd5" event={"ID":"d2e6ca0a-3716-45b4-917c-fa2f614d183e","Type":"ContainerStarted","Data":"7338812e2c6652c69f3ee8a60a9c233907a8de73c3720fb59985de4726980b7f"}
Jul 23 13:45:17.321811 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:45:17.321583    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d95d7b58d-jjwd5"
Jul 23 13:45:17.323342 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:45:17.323318    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d95d7b58d-jjwd5"
Jul 23 13:45:17.340927 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:45:17.340880    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d95d7b58d-jjwd5" podStartSLOduration=1.764482032 podStartE2EDuration="5.340865365s" totalImagesPullingTime="3.576383333s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:45:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:45:17.340058108 +0000 UTC m=+288.779559027" watchObservedRunningTime="2026-07-23 13:45:17.340865365 +0000 UTC m=+288.780366284"
Jul 23 13:45:28.930042 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:45:28.929999    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-vh5dp_2d624703-978f-48c2-b02d-9af8fd337236/console-operator/1.log"
Jul 23 13:45:28.930605 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:45:28.929999    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-vh5dp_2d624703-978f-48c2-b02d-9af8fd337236/console-operator/1.log"
Jul 23 13:45:28.941341 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:45:28.941311    2573 kubelet.go:1648] "Image garbage collection succeeded"
Jul 23 13:45:35.902182 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:45:35.902143    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:45:37.061138 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:45:37.061100    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408ssfx"]
Jul 23 13:45:37.063665 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:45:37.063643    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408ssfx"
Jul 23 13:45:37.066375 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:45:37.066355    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 23 13:45:37.067275 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:45:37.067248    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 23 13:45:37.067395 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:45:37.067300    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5vjl4\""
Jul 23 13:45:37.073563 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:45:37.073541    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408ssfx"]
Jul 23 13:45:37.216099 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:45:37.216068    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pzfm\" (UniqueName: \"kubernetes.io/projected/4c233de5-e92b-4697-af28-63e7b823f121-kube-api-access-5pzfm\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408ssfx\" (UID: \"4c233de5-e92b-4697-af28-63e7b823f121\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408ssfx"
Jul 23 13:45:37.216252 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:45:37.216123    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4c233de5-e92b-4697-af28-63e7b823f121-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408ssfx\" (UID: \"4c233de5-e92b-4697-af28-63e7b823f121\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408ssfx"
Jul 23 13:45:37.216252 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:45:37.216178    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4c233de5-e92b-4697-af28-63e7b823f121-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408ssfx\" (UID: \"4c233de5-e92b-4697-af28-63e7b823f121\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408ssfx"
Jul 23 13:45:37.317066 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:45:37.316961    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pzfm\" (UniqueName: \"kubernetes.io/projected/4c233de5-e92b-4697-af28-63e7b823f121-kube-api-access-5pzfm\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408ssfx\" (UID: \"4c233de5-e92b-4697-af28-63e7b823f121\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408ssfx"
Jul 23 13:45:37.317066 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:45:37.317005    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4c233de5-e92b-4697-af28-63e7b823f121-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408ssfx\" (UID: \"4c233de5-e92b-4697-af28-63e7b823f121\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408ssfx"
Jul 23 13:45:37.317066 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:45:37.317052    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4c233de5-e92b-4697-af28-63e7b823f121-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408ssfx\" (UID: \"4c233de5-e92b-4697-af28-63e7b823f121\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408ssfx"
Jul 23 13:45:37.317510 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:45:37.317488    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4c233de5-e92b-4697-af28-63e7b823f121-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408ssfx\" (UID: \"4c233de5-e92b-4697-af28-63e7b823f121\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408ssfx"
Jul 23 13:45:37.317558 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:45:37.317499    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4c233de5-e92b-4697-af28-63e7b823f121-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408ssfx\" (UID: \"4c233de5-e92b-4697-af28-63e7b823f121\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408ssfx"
Jul 23 13:45:37.326580 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:45:37.326547    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pzfm\" (UniqueName: \"kubernetes.io/projected/4c233de5-e92b-4697-af28-63e7b823f121-kube-api-access-5pzfm\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408ssfx\" (UID: \"4c233de5-e92b-4697-af28-63e7b823f121\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408ssfx"
Jul 23 13:45:37.373682 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:45:37.373655    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408ssfx"
Jul 23 13:45:37.504278 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:45:37.504242    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408ssfx"]
Jul 23 13:45:37.507107 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:45:37.507080    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c233de5_e92b_4697_af28_63e7b823f121.slice/crio-ea65633f06eba7d56c0567ad430be3350a0a0bf58346943d47d06af86c52b1f9 WatchSource:0}: Error finding container ea65633f06eba7d56c0567ad430be3350a0a0bf58346943d47d06af86c52b1f9: Status 404 returned error can't find the container with id ea65633f06eba7d56c0567ad430be3350a0a0bf58346943d47d06af86c52b1f9
Jul 23 13:45:37.509376 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:45:37.509356    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 13:45:38.403596 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:45:38.403556    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408ssfx" event={"ID":"4c233de5-e92b-4697-af28-63e7b823f121","Type":"ContainerStarted","Data":"ea65633f06eba7d56c0567ad430be3350a0a0bf58346943d47d06af86c52b1f9"}
Jul 23 13:45:39.405584 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:45:39.405553    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:45:44.439320 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:45:44.439276    2573 generic.go:356] "Generic (PLEG): container finished" podID="4c233de5-e92b-4697-af28-63e7b823f121" containerID="2052867015ad65ab8a73671e42e7a3781dbb9abfe8b825342b8647fa0235f2b5" exitCode=0
Jul 23 13:45:44.439802 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:45:44.439354    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408ssfx" event={"ID":"4c233de5-e92b-4697-af28-63e7b823f121","Type":"ContainerDied","Data":"2052867015ad65ab8a73671e42e7a3781dbb9abfe8b825342b8647fa0235f2b5"}
Jul 23 13:45:46.447866 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:45:46.447830    2573 generic.go:356] "Generic (PLEG): container finished" podID="4c233de5-e92b-4697-af28-63e7b823f121" containerID="d87775520f0ca1f09d3c97221f125e0df412e6699267d717e37905cdca6d6498" exitCode=0
Jul 23 13:45:46.447866 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:45:46.447868    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408ssfx" event={"ID":"4c233de5-e92b-4697-af28-63e7b823f121","Type":"ContainerDied","Data":"d87775520f0ca1f09d3c97221f125e0df412e6699267d717e37905cdca6d6498"}
Jul 23 13:45:55.485691 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:45:55.485655    2573 generic.go:356] "Generic (PLEG): container finished" podID="4c233de5-e92b-4697-af28-63e7b823f121" containerID="c1439273f9930e221c0b37da7e5358f634d383c839832839a849199e29edfc00" exitCode=0
Jul 23 13:45:55.486142 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:45:55.485739    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408ssfx" event={"ID":"4c233de5-e92b-4697-af28-63e7b823f121","Type":"ContainerDied","Data":"c1439273f9930e221c0b37da7e5358f634d383c839832839a849199e29edfc00"}
Jul 23 13:45:56.612997 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:45:56.612973    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408ssfx"
Jul 23 13:45:56.783991 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:45:56.783894    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4c233de5-e92b-4697-af28-63e7b823f121-util\") pod \"4c233de5-e92b-4697-af28-63e7b823f121\" (UID: \"4c233de5-e92b-4697-af28-63e7b823f121\") "
Jul 23 13:45:56.783991 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:45:56.783971    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4c233de5-e92b-4697-af28-63e7b823f121-bundle\") pod \"4c233de5-e92b-4697-af28-63e7b823f121\" (UID: \"4c233de5-e92b-4697-af28-63e7b823f121\") "
Jul 23 13:45:56.784232 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:45:56.783999    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5pzfm\" (UniqueName: \"kubernetes.io/projected/4c233de5-e92b-4697-af28-63e7b823f121-kube-api-access-5pzfm\") pod \"4c233de5-e92b-4697-af28-63e7b823f121\" (UID: \"4c233de5-e92b-4697-af28-63e7b823f121\") "
Jul 23 13:45:56.784557 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:45:56.784532    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c233de5-e92b-4697-af28-63e7b823f121-bundle" (OuterVolumeSpecName: "bundle") pod "4c233de5-e92b-4697-af28-63e7b823f121" (UID: "4c233de5-e92b-4697-af28-63e7b823f121"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 13:45:56.786200 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:45:56.786180    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c233de5-e92b-4697-af28-63e7b823f121-kube-api-access-5pzfm" (OuterVolumeSpecName: "kube-api-access-5pzfm") pod "4c233de5-e92b-4697-af28-63e7b823f121" (UID: "4c233de5-e92b-4697-af28-63e7b823f121"). InnerVolumeSpecName "kube-api-access-5pzfm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:45:56.790189 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:45:56.790163    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c233de5-e92b-4697-af28-63e7b823f121-util" (OuterVolumeSpecName: "util") pod "4c233de5-e92b-4697-af28-63e7b823f121" (UID: "4c233de5-e92b-4697-af28-63e7b823f121"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 13:45:56.884880 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:45:56.884833    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5pzfm\" (UniqueName: \"kubernetes.io/projected/4c233de5-e92b-4697-af28-63e7b823f121-kube-api-access-5pzfm\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 13:45:56.884880 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:45:56.884873    2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4c233de5-e92b-4697-af28-63e7b823f121-util\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 13:45:56.884880 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:45:56.884888    2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4c233de5-e92b-4697-af28-63e7b823f121-bundle\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 13:45:57.495357 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:45:57.495273    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408ssfx" event={"ID":"4c233de5-e92b-4697-af28-63e7b823f121","Type":"ContainerDied","Data":"ea65633f06eba7d56c0567ad430be3350a0a0bf58346943d47d06af86c52b1f9"}
Jul 23 13:45:57.495357 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:45:57.495322    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408ssfx"
Jul 23 13:45:57.495538 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:45:57.495325    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ea65633f06eba7d56c0567ad430be3350a0a0bf58346943d47d06af86c52b1f9"
Jul 23 13:46:00.063193 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:00.063157    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:46:03.153987 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:03.153946    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:46:04.032738 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:04.032709    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:46:05.183537 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:05.183501    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m229c"]
Jul 23 13:46:05.184052 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:05.183921    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c233de5-e92b-4697-af28-63e7b823f121" containerName="pull"
Jul 23 13:46:05.184052 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:05.183940    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c233de5-e92b-4697-af28-63e7b823f121" containerName="pull"
Jul 23 13:46:05.184052 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:05.183954    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c233de5-e92b-4697-af28-63e7b823f121" containerName="extract"
Jul 23 13:46:05.184052 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:05.183962    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c233de5-e92b-4697-af28-63e7b823f121" containerName="extract"
Jul 23 13:46:05.184052 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:05.183995    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c233de5-e92b-4697-af28-63e7b823f121" containerName="util"
Jul 23 13:46:05.184052 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:05.184004    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c233de5-e92b-4697-af28-63e7b823f121" containerName="util"
Jul 23 13:46:05.184354 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:05.184098    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c233de5-e92b-4697-af28-63e7b823f121" containerName="extract"
Jul 23 13:46:05.187177 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:05.187156    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m229c"
Jul 23 13:46:05.190864 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:05.190844    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 23 13:46:05.191514 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:05.191501    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 23 13:46:05.195282 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:05.195261    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-x79ll\""
Jul 23 13:46:05.205809 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:05.205784    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m229c"]
Jul 23 13:46:05.247103 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:05.247064    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/96d4f006-8a52-448c-8cf5-62c9d471a156-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-m229c\" (UID: \"96d4f006-8a52-448c-8cf5-62c9d471a156\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m229c"
Jul 23 13:46:05.247285 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:05.247126    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njjsz\" (UniqueName: \"kubernetes.io/projected/96d4f006-8a52-448c-8cf5-62c9d471a156-kube-api-access-njjsz\") pod \"cert-manager-operator-controller-manager-55c444bf86-m229c\" (UID: \"96d4f006-8a52-448c-8cf5-62c9d471a156\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m229c"
Jul 23 13:46:05.348194 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:05.348150    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/96d4f006-8a52-448c-8cf5-62c9d471a156-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-m229c\" (UID: \"96d4f006-8a52-448c-8cf5-62c9d471a156\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m229c"
Jul 23 13:46:05.348360 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:05.348236    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njjsz\" (UniqueName: \"kubernetes.io/projected/96d4f006-8a52-448c-8cf5-62c9d471a156-kube-api-access-njjsz\") pod \"cert-manager-operator-controller-manager-55c444bf86-m229c\" (UID: \"96d4f006-8a52-448c-8cf5-62c9d471a156\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m229c"
Jul 23 13:46:05.348618 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:05.348601    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/96d4f006-8a52-448c-8cf5-62c9d471a156-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-m229c\" (UID: \"96d4f006-8a52-448c-8cf5-62c9d471a156\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m229c"
Jul 23 13:46:05.357913 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:05.357881    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-njjsz\" (UniqueName: \"kubernetes.io/projected/96d4f006-8a52-448c-8cf5-62c9d471a156-kube-api-access-njjsz\") pod \"cert-manager-operator-controller-manager-55c444bf86-m229c\" (UID: \"96d4f006-8a52-448c-8cf5-62c9d471a156\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m229c"
Jul 23 13:46:05.496024 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:05.495928    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m229c"
Jul 23 13:46:05.637850 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:05.637821    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m229c"]
Jul 23 13:46:05.640165 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:46:05.640140    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96d4f006_8a52_448c_8cf5_62c9d471a156.slice/crio-eda7fec89166bb5f1ec6e2e572f363590a5c0b7ac863e9a26cfbdffa34eefc22 WatchSource:0}: Error finding container eda7fec89166bb5f1ec6e2e572f363590a5c0b7ac863e9a26cfbdffa34eefc22: Status 404 returned error can't find the container with id eda7fec89166bb5f1ec6e2e572f363590a5c0b7ac863e9a26cfbdffa34eefc22
Jul 23 13:46:06.536066 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:06.536023    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m229c" event={"ID":"96d4f006-8a52-448c-8cf5-62c9d471a156","Type":"ContainerStarted","Data":"eda7fec89166bb5f1ec6e2e572f363590a5c0b7ac863e9a26cfbdffa34eefc22"}
Jul 23 13:46:06.815994 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:06.815951    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:46:06.876483 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:06.876442    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:46:07.544736 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:07.544702    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m229c" event={"ID":"96d4f006-8a52-448c-8cf5-62c9d471a156","Type":"ContainerStarted","Data":"21c084e2ef0715c92c003345159013be3912b389edde1fd500b94fc80335837f"}
Jul 23 13:46:07.569556 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:07.569498    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m229c" podStartSLOduration=1.03869187 podStartE2EDuration="2.569478289s" totalImagesPullingTime="1.530786419s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:46:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:46:07.567444773 +0000 UTC m=+339.006945703" watchObservedRunningTime="2026-07-23 13:46:07.569478289 +0000 UTC m=+339.008979209"
Jul 23 13:46:08.022099 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:08.021993    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:46:08.158380 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:08.158343    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:46:08.852699 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:08.852666    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:46:08.878249 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:08.878211    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl6n68"]
Jul 23 13:46:08.881671 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:08.881654    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl6n68"
Jul 23 13:46:08.883988 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:08.883968    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 23 13:46:08.884809 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:08.884788    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5vjl4\""
Jul 23 13:46:08.884926 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:08.884788    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 23 13:46:08.892309 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:08.892283    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl6n68"]
Jul 23 13:46:08.949624 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:08.949561    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:46:08.971103 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:08.971075    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/737d8a0e-3052-4f92-865b-7d279cefe942-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl6n68\" (UID: \"737d8a0e-3052-4f92-865b-7d279cefe942\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl6n68"
Jul 23 13:46:08.971224 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:08.971107    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/737d8a0e-3052-4f92-865b-7d279cefe942-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl6n68\" (UID: \"737d8a0e-3052-4f92-865b-7d279cefe942\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl6n68"
Jul 23 13:46:08.971224 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:08.971171    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgnxk\" (UniqueName: \"kubernetes.io/projected/737d8a0e-3052-4f92-865b-7d279cefe942-kube-api-access-kgnxk\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl6n68\" (UID: \"737d8a0e-3052-4f92-865b-7d279cefe942\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl6n68"
Jul 23 13:46:08.991770 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:08.991741    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-nzs87"]
Jul 23 13:46:08.994882 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:08.994867    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-nzs87"
Jul 23 13:46:08.996937 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:08.996921    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 23 13:46:08.997150 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:08.997137    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 23 13:46:09.006459 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:09.006435    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-nzs87"]
Jul 23 13:46:09.071628 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:09.071598    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4ccf\" (UniqueName: \"kubernetes.io/projected/25954637-72af-4cab-aa71-132b877ee655-kube-api-access-d4ccf\") pod \"cert-manager-webhook-6486ffd997-nzs87\" (UID: \"25954637-72af-4cab-aa71-132b877ee655\") " pod="cert-manager/cert-manager-webhook-6486ffd997-nzs87"
Jul 23 13:46:09.071814 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:09.071664    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/737d8a0e-3052-4f92-865b-7d279cefe942-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl6n68\" (UID: \"737d8a0e-3052-4f92-865b-7d279cefe942\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl6n68"
Jul 23 13:46:09.071814 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:09.071693    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/737d8a0e-3052-4f92-865b-7d279cefe942-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl6n68\" (UID: \"737d8a0e-3052-4f92-865b-7d279cefe942\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl6n68"
Jul 23 13:46:09.071814 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:09.071719    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/25954637-72af-4cab-aa71-132b877ee655-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-nzs87\" (UID: \"25954637-72af-4cab-aa71-132b877ee655\") " pod="cert-manager/cert-manager-webhook-6486ffd997-nzs87"
Jul 23 13:46:09.071814 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:09.071772    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgnxk\" (UniqueName: \"kubernetes.io/projected/737d8a0e-3052-4f92-865b-7d279cefe942-kube-api-access-kgnxk\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl6n68\" (UID: \"737d8a0e-3052-4f92-865b-7d279cefe942\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl6n68"
Jul 23 13:46:09.072143 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:09.072118    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/737d8a0e-3052-4f92-865b-7d279cefe942-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl6n68\" (UID: \"737d8a0e-3052-4f92-865b-7d279cefe942\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl6n68"
Jul 23 13:46:09.072262 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:09.072141    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/737d8a0e-3052-4f92-865b-7d279cefe942-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl6n68\" (UID: \"737d8a0e-3052-4f92-865b-7d279cefe942\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl6n68"
Jul 23 13:46:09.081026 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:09.080993    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgnxk\" (UniqueName: \"kubernetes.io/projected/737d8a0e-3052-4f92-865b-7d279cefe942-kube-api-access-kgnxk\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl6n68\" (UID: \"737d8a0e-3052-4f92-865b-7d279cefe942\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl6n68"
Jul 23 13:46:09.172772 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:09.172689    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4ccf\" (UniqueName: \"kubernetes.io/projected/25954637-72af-4cab-aa71-132b877ee655-kube-api-access-d4ccf\") pod \"cert-manager-webhook-6486ffd997-nzs87\" (UID: \"25954637-72af-4cab-aa71-132b877ee655\") " pod="cert-manager/cert-manager-webhook-6486ffd997-nzs87"
Jul 23 13:46:09.172772 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:09.172739    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/25954637-72af-4cab-aa71-132b877ee655-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-nzs87\" (UID: \"25954637-72af-4cab-aa71-132b877ee655\") " pod="cert-manager/cert-manager-webhook-6486ffd997-nzs87"
Jul 23 13:46:09.180555 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:09.180523    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/25954637-72af-4cab-aa71-132b877ee655-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-nzs87\" (UID: \"25954637-72af-4cab-aa71-132b877ee655\") " pod="cert-manager/cert-manager-webhook-6486ffd997-nzs87"
Jul 23 13:46:09.180725 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:09.180704    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4ccf\" (UniqueName: \"kubernetes.io/projected/25954637-72af-4cab-aa71-132b877ee655-kube-api-access-d4ccf\") pod \"cert-manager-webhook-6486ffd997-nzs87\" (UID: \"25954637-72af-4cab-aa71-132b877ee655\") " pod="cert-manager/cert-manager-webhook-6486ffd997-nzs87"
Jul 23 13:46:09.190553 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:09.190530    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl6n68"
Jul 23 13:46:09.318646 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:09.318605    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-nzs87"
Jul 23 13:46:09.322460 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:09.322432    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl6n68"]
Jul 23 13:46:09.324637 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:46:09.324608    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod737d8a0e_3052_4f92_865b_7d279cefe942.slice/crio-23dc2e2be6e65a043b65f0124fda882720900a0a4fec9d88e8d20b35c2118839 WatchSource:0}: Error finding container 23dc2e2be6e65a043b65f0124fda882720900a0a4fec9d88e8d20b35c2118839: Status 404 returned error can't find the container with id 23dc2e2be6e65a043b65f0124fda882720900a0a4fec9d88e8d20b35c2118839
Jul 23 13:46:09.460105 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:09.456887    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-nzs87"]
Jul 23 13:46:09.471975 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:46:09.471947    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod25954637_72af_4cab_aa71_132b877ee655.slice/crio-5182c37109911128f009d5e9e743089283c630d2899b39a4a15640d665dff3cc WatchSource:0}: Error finding container 5182c37109911128f009d5e9e743089283c630d2899b39a4a15640d665dff3cc: Status 404 returned error can't find the container with id 5182c37109911128f009d5e9e743089283c630d2899b39a4a15640d665dff3cc
Jul 23 13:46:09.555330 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:09.555295    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-nzs87" event={"ID":"25954637-72af-4cab-aa71-132b877ee655","Type":"ContainerStarted","Data":"5182c37109911128f009d5e9e743089283c630d2899b39a4a15640d665dff3cc"}
Jul 23 13:46:09.556690 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:09.556661    2573 generic.go:356] "Generic (PLEG): container finished" podID="737d8a0e-3052-4f92-865b-7d279cefe942" containerID="608bee0c9977381d7a615cffcc0dcc7db0006fa6f98e0301590c83101a6c7ac7" exitCode=0
Jul 23 13:46:09.556792 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:09.556699    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl6n68" event={"ID":"737d8a0e-3052-4f92-865b-7d279cefe942","Type":"ContainerDied","Data":"608bee0c9977381d7a615cffcc0dcc7db0006fa6f98e0301590c83101a6c7ac7"}
Jul 23 13:46:09.556792 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:09.556765    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl6n68" event={"ID":"737d8a0e-3052-4f92-865b-7d279cefe942","Type":"ContainerStarted","Data":"23dc2e2be6e65a043b65f0124fda882720900a0a4fec9d88e8d20b35c2118839"}
Jul 23 13:46:10.896476 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:10.896439    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:46:11.234604 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:11.234509    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:46:13.554340 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:13.554303    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:46:13.577037 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:13.576978    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-nzs87" event={"ID":"25954637-72af-4cab-aa71-132b877ee655","Type":"ContainerStarted","Data":"aafb1351a8689c2ad9bbd7112beabbfe02078a000388dd5412664c24395a322e"}
Jul 23 13:46:13.577225 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:13.577073    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-nzs87"
Jul 23 13:46:13.578748 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:13.578727    2573 generic.go:356] "Generic (PLEG): container finished" podID="737d8a0e-3052-4f92-865b-7d279cefe942" containerID="d4e577e30a46eb8604015c22ca3261210c90c4688512005f9fa25d822b98b26c" exitCode=0
Jul 23 13:46:13.578830 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:13.578786    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl6n68" event={"ID":"737d8a0e-3052-4f92-865b-7d279cefe942","Type":"ContainerDied","Data":"d4e577e30a46eb8604015c22ca3261210c90c4688512005f9fa25d822b98b26c"}
Jul 23 13:46:13.595384 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:13.595343    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-nzs87" podStartSLOduration=2.504686818 podStartE2EDuration="5.595329463s" totalImagesPullingTime="3.090642645s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:46:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:46:13.593637863 +0000 UTC m=+345.033138786" watchObservedRunningTime="2026-07-23 13:46:13.595329463 +0000 UTC m=+345.034830381"
Jul 23 13:46:13.620405 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:13.620377    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:46:13.951148 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:13.951047    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:46:14.584949 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:14.584909    2573 generic.go:356] "Generic (PLEG): container finished" podID="737d8a0e-3052-4f92-865b-7d279cefe942" containerID="9955e6bea1602804870f355a059a03a33f9a925a98a8b62fe93dc98d61259c31" exitCode=0
Jul 23 13:46:14.585355 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:14.584985    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl6n68" event={"ID":"737d8a0e-3052-4f92-865b-7d279cefe942","Type":"ContainerDied","Data":"9955e6bea1602804870f355a059a03a33f9a925a98a8b62fe93dc98d61259c31"}
Jul 23 13:46:15.728134 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:15.728111    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl6n68"
Jul 23 13:46:15.830876 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:15.830849    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kgnxk\" (UniqueName: \"kubernetes.io/projected/737d8a0e-3052-4f92-865b-7d279cefe942-kube-api-access-kgnxk\") pod \"737d8a0e-3052-4f92-865b-7d279cefe942\" (UID: \"737d8a0e-3052-4f92-865b-7d279cefe942\") "
Jul 23 13:46:15.831096 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:15.830890    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/737d8a0e-3052-4f92-865b-7d279cefe942-bundle\") pod \"737d8a0e-3052-4f92-865b-7d279cefe942\" (UID: \"737d8a0e-3052-4f92-865b-7d279cefe942\") "
Jul 23 13:46:15.831096 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:15.830919    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/737d8a0e-3052-4f92-865b-7d279cefe942-util\") pod \"737d8a0e-3052-4f92-865b-7d279cefe942\" (UID: \"737d8a0e-3052-4f92-865b-7d279cefe942\") "
Jul 23 13:46:15.831352 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:15.831328    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/737d8a0e-3052-4f92-865b-7d279cefe942-bundle" (OuterVolumeSpecName: "bundle") pod "737d8a0e-3052-4f92-865b-7d279cefe942" (UID: "737d8a0e-3052-4f92-865b-7d279cefe942"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 13:46:15.832997 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:15.832972    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/737d8a0e-3052-4f92-865b-7d279cefe942-kube-api-access-kgnxk" (OuterVolumeSpecName: "kube-api-access-kgnxk") pod "737d8a0e-3052-4f92-865b-7d279cefe942" (UID: "737d8a0e-3052-4f92-865b-7d279cefe942"). InnerVolumeSpecName "kube-api-access-kgnxk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:46:15.836091 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:15.836057    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/737d8a0e-3052-4f92-865b-7d279cefe942-util" (OuterVolumeSpecName: "util") pod "737d8a0e-3052-4f92-865b-7d279cefe942" (UID: "737d8a0e-3052-4f92-865b-7d279cefe942"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 13:46:15.932455 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:15.932368    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kgnxk\" (UniqueName: \"kubernetes.io/projected/737d8a0e-3052-4f92-865b-7d279cefe942-kube-api-access-kgnxk\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 13:46:15.932455 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:15.932398    2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/737d8a0e-3052-4f92-865b-7d279cefe942-bundle\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 13:46:15.932455 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:15.932411    2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/737d8a0e-3052-4f92-865b-7d279cefe942-util\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 13:46:16.218454 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:16.218374    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:46:16.319077 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:16.319032    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:46:16.595221 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:16.595192    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl6n68"
Jul 23 13:46:16.595389 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:16.595190    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl6n68" event={"ID":"737d8a0e-3052-4f92-865b-7d279cefe942","Type":"ContainerDied","Data":"23dc2e2be6e65a043b65f0124fda882720900a0a4fec9d88e8d20b35c2118839"}
Jul 23 13:46:16.595389 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:16.595306    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="23dc2e2be6e65a043b65f0124fda882720900a0a4fec9d88e8d20b35c2118839"
Jul 23 13:46:19.587503 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:19.587470    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-nzs87"
Jul 23 13:46:20.045954 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:20.045921    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:46:24.974713 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:24.974627    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:46:25.070798 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:25.070737    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:46:27.031326 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:27.031290    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ww6jh"]
Jul 23 13:46:27.031685 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:27.031587    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="737d8a0e-3052-4f92-865b-7d279cefe942" containerName="extract"
Jul 23 13:46:27.031685 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:27.031597    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="737d8a0e-3052-4f92-865b-7d279cefe942" containerName="extract"
Jul 23 13:46:27.031685 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:27.031607    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="737d8a0e-3052-4f92-865b-7d279cefe942" containerName="pull"
Jul 23 13:46:27.031685 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:27.031612    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="737d8a0e-3052-4f92-865b-7d279cefe942" containerName="pull"
Jul 23 13:46:27.031685 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:27.031619    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="737d8a0e-3052-4f92-865b-7d279cefe942" containerName="util"
Jul 23 13:46:27.031685 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:27.031625    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="737d8a0e-3052-4f92-865b-7d279cefe942" containerName="util"
Jul 23 13:46:27.031685 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:27.031670    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="737d8a0e-3052-4f92-865b-7d279cefe942" containerName="extract"
Jul 23 13:46:27.034415 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:27.034398    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ww6jh"
Jul 23 13:46:27.036862 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:27.036832    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 23 13:46:27.038032 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:27.037986    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-xf7fp\""
Jul 23 13:46:27.038123 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:27.037985    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 23 13:46:27.044665 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:27.044645    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ww6jh"]
Jul 23 13:46:27.116084 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:27.116051    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nn58m\" (UniqueName: \"kubernetes.io/projected/6d2af49d-0c41-47c6-91e3-779f3c8441ac-kube-api-access-nn58m\") pod \"openshift-lws-operator-fd8ccff4c-ww6jh\" (UID: \"6d2af49d-0c41-47c6-91e3-779f3c8441ac\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ww6jh"
Jul 23 13:46:27.116084 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:27.116088    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6d2af49d-0c41-47c6-91e3-779f3c8441ac-tmp\") pod \"openshift-lws-operator-fd8ccff4c-ww6jh\" (UID: \"6d2af49d-0c41-47c6-91e3-779f3c8441ac\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ww6jh"
Jul 23 13:46:27.217221 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:27.217191    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nn58m\" (UniqueName: \"kubernetes.io/projected/6d2af49d-0c41-47c6-91e3-779f3c8441ac-kube-api-access-nn58m\") pod \"openshift-lws-operator-fd8ccff4c-ww6jh\" (UID: \"6d2af49d-0c41-47c6-91e3-779f3c8441ac\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ww6jh"
Jul 23 13:46:27.217382 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:27.217228    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6d2af49d-0c41-47c6-91e3-779f3c8441ac-tmp\") pod \"openshift-lws-operator-fd8ccff4c-ww6jh\" (UID: \"6d2af49d-0c41-47c6-91e3-779f3c8441ac\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ww6jh"
Jul 23 13:46:27.217575 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:27.217554    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6d2af49d-0c41-47c6-91e3-779f3c8441ac-tmp\") pod \"openshift-lws-operator-fd8ccff4c-ww6jh\" (UID: \"6d2af49d-0c41-47c6-91e3-779f3c8441ac\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ww6jh"
Jul 23 13:46:27.225884 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:27.225860    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nn58m\" (UniqueName: \"kubernetes.io/projected/6d2af49d-0c41-47c6-91e3-779f3c8441ac-kube-api-access-nn58m\") pod \"openshift-lws-operator-fd8ccff4c-ww6jh\" (UID: \"6d2af49d-0c41-47c6-91e3-779f3c8441ac\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ww6jh"
Jul 23 13:46:27.343600 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:27.343566    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ww6jh"
Jul 23 13:46:27.476927 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:27.476839    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ww6jh"]
Jul 23 13:46:27.479535 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:46:27.479508    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6d2af49d_0c41_47c6_91e3_779f3c8441ac.slice/crio-d68d327a953dba800a827638cc0fa6d6c0ecd388ee826a8b341d314d1146d090 WatchSource:0}: Error finding container d68d327a953dba800a827638cc0fa6d6c0ecd388ee826a8b341d314d1146d090: Status 404 returned error can't find the container with id d68d327a953dba800a827638cc0fa6d6c0ecd388ee826a8b341d314d1146d090
Jul 23 13:46:27.642034 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:27.641929    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ww6jh" event={"ID":"6d2af49d-0c41-47c6-91e3-779f3c8441ac","Type":"ContainerStarted","Data":"d68d327a953dba800a827638cc0fa6d6c0ecd388ee826a8b341d314d1146d090"}
Jul 23 13:46:30.657891 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:30.657853    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ww6jh" event={"ID":"6d2af49d-0c41-47c6-91e3-779f3c8441ac","Type":"ContainerStarted","Data":"b883161343f1ecf132092eef5ebc3ae60efd41149a1fad7200e7d244b9205968"}
Jul 23 13:46:30.677702 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:30.677651    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ww6jh" podStartSLOduration=1.480300908 podStartE2EDuration="3.677635571s" totalImagesPullingTime="2.197334663s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:46:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:46:30.677473062 +0000 UTC m=+362.116973982" watchObservedRunningTime="2026-07-23 13:46:30.677635571 +0000 UTC m=+362.117136491"
Jul 23 13:46:31.424284 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:31.424245    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:46:31.522881 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:31.522847    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:46:33.592988 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:33.592943    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:46:34.656461 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:34.656422    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxgllw"]
Jul 23 13:46:34.660080 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:34.660058    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxgllw"
Jul 23 13:46:34.662622 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:34.662602    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 23 13:46:34.663461 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:34.663437    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 23 13:46:34.663568 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:34.663465    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5vjl4\""
Jul 23 13:46:34.668654 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:34.668633    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxgllw"]
Jul 23 13:46:34.781304 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:34.781264    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a2175077-dcf5-448d-8e3b-e8fab62403d4-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxgllw\" (UID: \"a2175077-dcf5-448d-8e3b-e8fab62403d4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxgllw"
Jul 23 13:46:34.781488 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:34.781326    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzcvm\" (UniqueName: \"kubernetes.io/projected/a2175077-dcf5-448d-8e3b-e8fab62403d4-kube-api-access-nzcvm\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxgllw\" (UID: \"a2175077-dcf5-448d-8e3b-e8fab62403d4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxgllw"
Jul 23 13:46:34.781488 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:34.781445    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a2175077-dcf5-448d-8e3b-e8fab62403d4-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxgllw\" (UID: \"a2175077-dcf5-448d-8e3b-e8fab62403d4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxgllw"
Jul 23 13:46:34.882574 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:34.882537    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a2175077-dcf5-448d-8e3b-e8fab62403d4-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxgllw\" (UID: \"a2175077-dcf5-448d-8e3b-e8fab62403d4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxgllw"
Jul 23 13:46:34.882768 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:34.882599    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzcvm\" (UniqueName: \"kubernetes.io/projected/a2175077-dcf5-448d-8e3b-e8fab62403d4-kube-api-access-nzcvm\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxgllw\" (UID: \"a2175077-dcf5-448d-8e3b-e8fab62403d4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxgllw"
Jul 23 13:46:34.882768 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:34.882643    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a2175077-dcf5-448d-8e3b-e8fab62403d4-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxgllw\" (UID: \"a2175077-dcf5-448d-8e3b-e8fab62403d4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxgllw"
Jul 23 13:46:34.882995 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:34.882971    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a2175077-dcf5-448d-8e3b-e8fab62403d4-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxgllw\" (UID: \"a2175077-dcf5-448d-8e3b-e8fab62403d4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxgllw"
Jul 23 13:46:34.883089 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:34.882994    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a2175077-dcf5-448d-8e3b-e8fab62403d4-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxgllw\" (UID: \"a2175077-dcf5-448d-8e3b-e8fab62403d4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxgllw"
Jul 23 13:46:34.909076 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:34.908987    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzcvm\" (UniqueName: \"kubernetes.io/projected/a2175077-dcf5-448d-8e3b-e8fab62403d4-kube-api-access-nzcvm\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxgllw\" (UID: \"a2175077-dcf5-448d-8e3b-e8fab62403d4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxgllw"
Jul 23 13:46:34.969998 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:34.969962    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxgllw"
Jul 23 13:46:35.097523 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:35.097384    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxgllw"]
Jul 23 13:46:35.100091 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:46:35.100062    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2175077_dcf5_448d_8e3b_e8fab62403d4.slice/crio-c279d7dcee8c2763898fd554989c414359e979ebd06ed00977b2346078d87d7b WatchSource:0}: Error finding container c279d7dcee8c2763898fd554989c414359e979ebd06ed00977b2346078d87d7b: Status 404 returned error can't find the container with id c279d7dcee8c2763898fd554989c414359e979ebd06ed00977b2346078d87d7b
Jul 23 13:46:35.687156 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:35.687122    2573 generic.go:356] "Generic (PLEG): container finished" podID="a2175077-dcf5-448d-8e3b-e8fab62403d4" containerID="36cb8456732d645b67488aa608fc2c22feed01b0e6a82bc4acfca7a49feee25d" exitCode=0
Jul 23 13:46:35.687571 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:35.687211    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxgllw" event={"ID":"a2175077-dcf5-448d-8e3b-e8fab62403d4","Type":"ContainerDied","Data":"36cb8456732d645b67488aa608fc2c22feed01b0e6a82bc4acfca7a49feee25d"}
Jul 23 13:46:35.687571 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:35.687257    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxgllw" event={"ID":"a2175077-dcf5-448d-8e3b-e8fab62403d4","Type":"ContainerStarted","Data":"c279d7dcee8c2763898fd554989c414359e979ebd06ed00977b2346078d87d7b"}
Jul 23 13:46:36.694549 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:36.694462    2573 generic.go:356] "Generic (PLEG): container finished" podID="a2175077-dcf5-448d-8e3b-e8fab62403d4" containerID="a9ca44d1c7689ca680576c5b80a139c6dc212695d10c358909031650350255c8" exitCode=0
Jul 23 13:46:36.694549 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:36.694507    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxgllw" event={"ID":"a2175077-dcf5-448d-8e3b-e8fab62403d4","Type":"ContainerDied","Data":"a9ca44d1c7689ca680576c5b80a139c6dc212695d10c358909031650350255c8"}
Jul 23 13:46:37.701162 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:37.701130    2573 generic.go:356] "Generic (PLEG): container finished" podID="a2175077-dcf5-448d-8e3b-e8fab62403d4" containerID="c3cd56178df658e26dd5a48a0ea43123abcd86bedea4c6c9b12144188b09b5b5" exitCode=0
Jul 23 13:46:37.701551 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:37.701198    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxgllw" event={"ID":"a2175077-dcf5-448d-8e3b-e8fab62403d4","Type":"ContainerDied","Data":"c3cd56178df658e26dd5a48a0ea43123abcd86bedea4c6c9b12144188b09b5b5"}
Jul 23 13:46:38.831354 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:38.831328    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxgllw"
Jul 23 13:46:38.917116 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:38.917084    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a2175077-dcf5-448d-8e3b-e8fab62403d4-util\") pod \"a2175077-dcf5-448d-8e3b-e8fab62403d4\" (UID: \"a2175077-dcf5-448d-8e3b-e8fab62403d4\") "
Jul 23 13:46:38.917273 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:38.917124    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nzcvm\" (UniqueName: \"kubernetes.io/projected/a2175077-dcf5-448d-8e3b-e8fab62403d4-kube-api-access-nzcvm\") pod \"a2175077-dcf5-448d-8e3b-e8fab62403d4\" (UID: \"a2175077-dcf5-448d-8e3b-e8fab62403d4\") "
Jul 23 13:46:38.917273 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:38.917197    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a2175077-dcf5-448d-8e3b-e8fab62403d4-bundle\") pod \"a2175077-dcf5-448d-8e3b-e8fab62403d4\" (UID: \"a2175077-dcf5-448d-8e3b-e8fab62403d4\") "
Jul 23 13:46:38.917890 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:38.917856    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2175077-dcf5-448d-8e3b-e8fab62403d4-bundle" (OuterVolumeSpecName: "bundle") pod "a2175077-dcf5-448d-8e3b-e8fab62403d4" (UID: "a2175077-dcf5-448d-8e3b-e8fab62403d4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 13:46:38.919242 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:38.919214    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2175077-dcf5-448d-8e3b-e8fab62403d4-kube-api-access-nzcvm" (OuterVolumeSpecName: "kube-api-access-nzcvm") pod "a2175077-dcf5-448d-8e3b-e8fab62403d4" (UID: "a2175077-dcf5-448d-8e3b-e8fab62403d4"). InnerVolumeSpecName "kube-api-access-nzcvm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:46:38.922328 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:38.922303    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2175077-dcf5-448d-8e3b-e8fab62403d4-util" (OuterVolumeSpecName: "util") pod "a2175077-dcf5-448d-8e3b-e8fab62403d4" (UID: "a2175077-dcf5-448d-8e3b-e8fab62403d4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 13:46:39.018477 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:39.018395    2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a2175077-dcf5-448d-8e3b-e8fab62403d4-bundle\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 13:46:39.018477 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:39.018424    2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a2175077-dcf5-448d-8e3b-e8fab62403d4-util\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 13:46:39.018477 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:39.018434    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nzcvm\" (UniqueName: \"kubernetes.io/projected/a2175077-dcf5-448d-8e3b-e8fab62403d4-kube-api-access-nzcvm\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 13:46:39.712116 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:39.712080    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxgllw" event={"ID":"a2175077-dcf5-448d-8e3b-e8fab62403d4","Type":"ContainerDied","Data":"c279d7dcee8c2763898fd554989c414359e979ebd06ed00977b2346078d87d7b"}
Jul 23 13:46:39.712116 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:39.712115    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxgllw"
Jul 23 13:46:39.712316 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:39.712129    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c279d7dcee8c2763898fd554989c414359e979ebd06ed00977b2346078d87d7b"
Jul 23 13:46:43.873000 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:43.872966    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:46:43.978239 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:43.978203    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:46:46.382957 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:46.382910    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:46:46.515502 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:46.515463    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:46:46.994927 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:46.994890    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:46:47.317687 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:47.317647    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:46:47.435554 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:47.435518    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:46:47.474737 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:47.474709    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c8b88fb69-2kgqt"]
Jul 23 13:46:47.475030 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:47.475002    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2175077-dcf5-448d-8e3b-e8fab62403d4" containerName="extract"
Jul 23 13:46:47.475076 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:47.475031    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2175077-dcf5-448d-8e3b-e8fab62403d4" containerName="extract"
Jul 23 13:46:47.475076 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:47.475045    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2175077-dcf5-448d-8e3b-e8fab62403d4" containerName="util"
Jul 23 13:46:47.475076 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:47.475051    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2175077-dcf5-448d-8e3b-e8fab62403d4" containerName="util"
Jul 23 13:46:47.475076 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:47.475060    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2175077-dcf5-448d-8e3b-e8fab62403d4" containerName="pull"
Jul 23 13:46:47.475076 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:47.475065    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2175077-dcf5-448d-8e3b-e8fab62403d4" containerName="pull"
Jul 23 13:46:47.475223 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:47.475117    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2175077-dcf5-448d-8e3b-e8fab62403d4" containerName="extract"
Jul 23 13:46:47.481316 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:47.481300    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7c8b88fb69-2kgqt"
Jul 23 13:46:47.483965 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:47.483943    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 23 13:46:47.484256 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:47.484228    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 23 13:46:47.484596 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:47.484582    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 23 13:46:47.484646 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:47.484625    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-4qrml\""
Jul 23 13:46:47.489369 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:47.489351    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 23 13:46:47.515626 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:47.515605    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c8b88fb69-2kgqt"]
Jul 23 13:46:47.588432 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:47.588277    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9458335b-4941-48d6-bcd7-b37005bd9aaf-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c8b88fb69-2kgqt\" (UID: \"9458335b-4941-48d6-bcd7-b37005bd9aaf\") " pod="opendatahub/opendatahub-operator-controller-manager-7c8b88fb69-2kgqt"
Jul 23 13:46:47.588432 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:47.588326    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9458335b-4941-48d6-bcd7-b37005bd9aaf-manifests\") pod \"opendatahub-operator-controller-manager-7c8b88fb69-2kgqt\" (UID: \"9458335b-4941-48d6-bcd7-b37005bd9aaf\") " pod="opendatahub/opendatahub-operator-controller-manager-7c8b88fb69-2kgqt"
Jul 23 13:46:47.588432 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:47.588413    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxxxm\" (UniqueName: \"kubernetes.io/projected/9458335b-4941-48d6-bcd7-b37005bd9aaf-kube-api-access-rxxxm\") pod \"opendatahub-operator-controller-manager-7c8b88fb69-2kgqt\" (UID: \"9458335b-4941-48d6-bcd7-b37005bd9aaf\") " pod="opendatahub/opendatahub-operator-controller-manager-7c8b88fb69-2kgqt"
Jul 23 13:46:47.588679 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:47.588477    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9458335b-4941-48d6-bcd7-b37005bd9aaf-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c8b88fb69-2kgqt\" (UID: \"9458335b-4941-48d6-bcd7-b37005bd9aaf\") " pod="opendatahub/opendatahub-operator-controller-manager-7c8b88fb69-2kgqt"
Jul 23 13:46:47.588679 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:47.588525    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9458335b-4941-48d6-bcd7-b37005bd9aaf-tmp\") pod \"opendatahub-operator-controller-manager-7c8b88fb69-2kgqt\" (UID: \"9458335b-4941-48d6-bcd7-b37005bd9aaf\") " pod="opendatahub/opendatahub-operator-controller-manager-7c8b88fb69-2kgqt"
Jul 23 13:46:47.678515 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:47.678478    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:46:47.689536 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:47.689507    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9458335b-4941-48d6-bcd7-b37005bd9aaf-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c8b88fb69-2kgqt\" (UID: \"9458335b-4941-48d6-bcd7-b37005bd9aaf\") " pod="opendatahub/opendatahub-operator-controller-manager-7c8b88fb69-2kgqt"
Jul 23 13:46:47.689646 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:47.689545    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9458335b-4941-48d6-bcd7-b37005bd9aaf-manifests\") pod \"opendatahub-operator-controller-manager-7c8b88fb69-2kgqt\" (UID: \"9458335b-4941-48d6-bcd7-b37005bd9aaf\") " pod="opendatahub/opendatahub-operator-controller-manager-7c8b88fb69-2kgqt"
Jul 23 13:46:47.689693 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:47.689668    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxxxm\" (UniqueName: \"kubernetes.io/projected/9458335b-4941-48d6-bcd7-b37005bd9aaf-kube-api-access-rxxxm\") pod \"opendatahub-operator-controller-manager-7c8b88fb69-2kgqt\" (UID: \"9458335b-4941-48d6-bcd7-b37005bd9aaf\") " pod="opendatahub/opendatahub-operator-controller-manager-7c8b88fb69-2kgqt"
Jul 23 13:46:47.689743 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:47.689700    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9458335b-4941-48d6-bcd7-b37005bd9aaf-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c8b88fb69-2kgqt\" (UID: \"9458335b-4941-48d6-bcd7-b37005bd9aaf\") " pod="opendatahub/opendatahub-operator-controller-manager-7c8b88fb69-2kgqt"
Jul 23 13:46:47.689743 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:47.689731    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9458335b-4941-48d6-bcd7-b37005bd9aaf-tmp\") pod \"opendatahub-operator-controller-manager-7c8b88fb69-2kgqt\" (UID: \"9458335b-4941-48d6-bcd7-b37005bd9aaf\") " pod="opendatahub/opendatahub-operator-controller-manager-7c8b88fb69-2kgqt"
Jul 23 13:46:47.689966 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:47.689941    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9458335b-4941-48d6-bcd7-b37005bd9aaf-manifests\") pod \"opendatahub-operator-controller-manager-7c8b88fb69-2kgqt\" (UID: \"9458335b-4941-48d6-bcd7-b37005bd9aaf\") " pod="opendatahub/opendatahub-operator-controller-manager-7c8b88fb69-2kgqt"
Jul 23 13:46:47.691955 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:47.691922    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9458335b-4941-48d6-bcd7-b37005bd9aaf-tmp\") pod \"opendatahub-operator-controller-manager-7c8b88fb69-2kgqt\" (UID: \"9458335b-4941-48d6-bcd7-b37005bd9aaf\") " pod="opendatahub/opendatahub-operator-controller-manager-7c8b88fb69-2kgqt"
Jul 23 13:46:47.692090 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:47.692045    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9458335b-4941-48d6-bcd7-b37005bd9aaf-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c8b88fb69-2kgqt\" (UID: \"9458335b-4941-48d6-bcd7-b37005bd9aaf\") " pod="opendatahub/opendatahub-operator-controller-manager-7c8b88fb69-2kgqt"
Jul 23 13:46:47.692147 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:47.692112    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9458335b-4941-48d6-bcd7-b37005bd9aaf-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c8b88fb69-2kgqt\" (UID: \"9458335b-4941-48d6-bcd7-b37005bd9aaf\") " pod="opendatahub/opendatahub-operator-controller-manager-7c8b88fb69-2kgqt"
Jul 23 13:46:47.698255 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:47.698237    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxxxm\" (UniqueName: \"kubernetes.io/projected/9458335b-4941-48d6-bcd7-b37005bd9aaf-kube-api-access-rxxxm\") pod \"opendatahub-operator-controller-manager-7c8b88fb69-2kgqt\" (UID: \"9458335b-4941-48d6-bcd7-b37005bd9aaf\") " pod="opendatahub/opendatahub-operator-controller-manager-7c8b88fb69-2kgqt"
Jul 23 13:46:47.777941 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:47.777901    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:46:47.791841 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:47.791817    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7c8b88fb69-2kgqt"
Jul 23 13:46:47.883073 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:47.883037    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:46:47.929925 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:47.929902    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c8b88fb69-2kgqt"]
Jul 23 13:46:47.932024 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:46:47.931978    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9458335b_4941_48d6_bcd7_b37005bd9aaf.slice/crio-99bc49f13a95db32e57662561633f35efbc75130b76719c008bb6233c934eee8 WatchSource:0}: Error finding container 99bc49f13a95db32e57662561633f35efbc75130b76719c008bb6233c934eee8: Status 404 returned error can't find the container with id 99bc49f13a95db32e57662561633f35efbc75130b76719c008bb6233c934eee8
Jul 23 13:46:47.979165 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:47.979135    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:46:48.051925 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:48.051895    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:46:48.152417 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:48.152319    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:46:48.756118 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:48.756080    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c8b88fb69-2kgqt" event={"ID":"9458335b-4941-48d6-bcd7-b37005bd9aaf","Type":"ContainerStarted","Data":"99bc49f13a95db32e57662561633f35efbc75130b76719c008bb6233c934eee8"}
Jul 23 13:46:51.773146 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:51.773104    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c8b88fb69-2kgqt" event={"ID":"9458335b-4941-48d6-bcd7-b37005bd9aaf","Type":"ContainerStarted","Data":"b0569eed4ed585ab7098d9681414f74c7bcb93cb8758c8e40e02d17c1148e62a"}
Jul 23 13:46:52.779264 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:52.779225    2573 generic.go:356] "Generic (PLEG): container finished" podID="9458335b-4941-48d6-bcd7-b37005bd9aaf" containerID="b0569eed4ed585ab7098d9681414f74c7bcb93cb8758c8e40e02d17c1148e62a" exitCode=0
Jul 23 13:46:52.779661 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:52.779314    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c8b88fb69-2kgqt" event={"ID":"9458335b-4941-48d6-bcd7-b37005bd9aaf","Type":"ContainerDied","Data":"b0569eed4ed585ab7098d9681414f74c7bcb93cb8758c8e40e02d17c1148e62a"}
Jul 23 13:46:53.785342 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:53.785304    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c8b88fb69-2kgqt" event={"ID":"9458335b-4941-48d6-bcd7-b37005bd9aaf","Type":"ContainerStarted","Data":"b0eecd5f6c3af0f026fd79705ed808186ba5efe4bec4c6edf5dfdb8bfb4c9e44"}
Jul 23 13:46:53.785732 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:53.785411    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7c8b88fb69-2kgqt"
Jul 23 13:46:53.817073 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:53.816995    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7c8b88fb69-2kgqt" podStartSLOduration=2.273916936 podStartE2EDuration="6.816974937s" totalImagesPullingTime="3.449361424s" totalInitContainerRuntime="1.093696577s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:46:47 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:46:53.816122378 +0000 UTC m=+385.255623299" watchObservedRunningTime="2026-07-23 13:46:53.816974937 +0000 UTC m=+385.256475857"
Jul 23 13:46:58.514026 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:58.513983    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:46:58.692889 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:58.692851    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:46:58.796461 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:46:58.796424    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:47:04.792733 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:04.792693    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7c8b88fb69-2kgqt"
Jul 23 13:47:09.041040 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:09.040947    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:47:09.195232 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:09.195191    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:47:10.139670 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:10.139582    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-hh52w"]
Jul 23 13:47:10.149002 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:10.148981    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-hh52w"
Jul 23 13:47:10.153778 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:10.153757    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 23 13:47:10.153899 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:10.153810    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-djr99\""
Jul 23 13:47:10.160587 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:10.160564    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-hh52w"]
Jul 23 13:47:10.207752 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:10.207719    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-d57cbb598-7crbl"]
Jul 23 13:47:10.210857 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:10.210835    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-d57cbb598-7crbl"
Jul 23 13:47:10.212751 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:10.212721    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:47:10.216987 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:10.216965    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 23 13:47:10.217267 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:10.217248    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 23 13:47:10.229387 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:10.229353    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-d57cbb598-7crbl"]
Jul 23 13:47:10.281978 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:10.281934    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cb90ddc6-5b8b-4d8f-af34-c40097c767e1-cert\") pod \"odh-model-controller-7998c67dc4-hh52w\" (UID: \"cb90ddc6-5b8b-4d8f-af34-c40097c767e1\") " pod="opendatahub/odh-model-controller-7998c67dc4-hh52w"
Jul 23 13:47:10.282190 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:10.282064    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x59dz\" (UniqueName: \"kubernetes.io/projected/cb90ddc6-5b8b-4d8f-af34-c40097c767e1-kube-api-access-x59dz\") pod \"odh-model-controller-7998c67dc4-hh52w\" (UID: \"cb90ddc6-5b8b-4d8f-af34-c40097c767e1\") " pod="opendatahub/odh-model-controller-7998c67dc4-hh52w"
Jul 23 13:47:10.383343 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:10.383309    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmgt9\" (UniqueName: \"kubernetes.io/projected/5ecf33e2-d370-4307-9095-5b3d946eb74a-kube-api-access-rmgt9\") pod \"kube-auth-proxy-d57cbb598-7crbl\" (UID: \"5ecf33e2-d370-4307-9095-5b3d946eb74a\") " pod="openshift-ingress/kube-auth-proxy-d57cbb598-7crbl"
Jul 23 13:47:10.383510 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:10.383350    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x59dz\" (UniqueName: \"kubernetes.io/projected/cb90ddc6-5b8b-4d8f-af34-c40097c767e1-kube-api-access-x59dz\") pod \"odh-model-controller-7998c67dc4-hh52w\" (UID: \"cb90ddc6-5b8b-4d8f-af34-c40097c767e1\") " pod="opendatahub/odh-model-controller-7998c67dc4-hh52w"
Jul 23 13:47:10.383510 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:10.383384    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ecf33e2-d370-4307-9095-5b3d946eb74a-tls-certs\") pod \"kube-auth-proxy-d57cbb598-7crbl\" (UID: \"5ecf33e2-d370-4307-9095-5b3d946eb74a\") " pod="openshift-ingress/kube-auth-proxy-d57cbb598-7crbl"
Jul 23 13:47:10.383587 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:10.383520    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5ecf33e2-d370-4307-9095-5b3d946eb74a-tmp\") pod \"kube-auth-proxy-d57cbb598-7crbl\" (UID: \"5ecf33e2-d370-4307-9095-5b3d946eb74a\") " pod="openshift-ingress/kube-auth-proxy-d57cbb598-7crbl"
Jul 23 13:47:10.383587 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:10.383569    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cb90ddc6-5b8b-4d8f-af34-c40097c767e1-cert\") pod \"odh-model-controller-7998c67dc4-hh52w\" (UID: \"cb90ddc6-5b8b-4d8f-af34-c40097c767e1\") " pod="opendatahub/odh-model-controller-7998c67dc4-hh52w"
Jul 23 13:47:10.383681 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:47:10.383667    2573 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 23 13:47:10.383730 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:47:10.383721    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb90ddc6-5b8b-4d8f-af34-c40097c767e1-cert podName:cb90ddc6-5b8b-4d8f-af34-c40097c767e1 nodeName:}" failed. No retries permitted until 2026-07-23 13:47:10.883703386 +0000 UTC m=+402.323204293 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/cb90ddc6-5b8b-4d8f-af34-c40097c767e1-cert") pod "odh-model-controller-7998c67dc4-hh52w" (UID: "cb90ddc6-5b8b-4d8f-af34-c40097c767e1") : secret "odh-model-controller-webhook-cert" not found
Jul 23 13:47:10.389193 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:10.389165    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:47:10.395219 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:10.395164    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x59dz\" (UniqueName: \"kubernetes.io/projected/cb90ddc6-5b8b-4d8f-af34-c40097c767e1-kube-api-access-x59dz\") pod \"odh-model-controller-7998c67dc4-hh52w\" (UID: \"cb90ddc6-5b8b-4d8f-af34-c40097c767e1\") " pod="opendatahub/odh-model-controller-7998c67dc4-hh52w"
Jul 23 13:47:10.484731 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:10.484698    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmgt9\" (UniqueName: \"kubernetes.io/projected/5ecf33e2-d370-4307-9095-5b3d946eb74a-kube-api-access-rmgt9\") pod \"kube-auth-proxy-d57cbb598-7crbl\" (UID: \"5ecf33e2-d370-4307-9095-5b3d946eb74a\") " pod="openshift-ingress/kube-auth-proxy-d57cbb598-7crbl"
Jul 23 13:47:10.484731 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:10.484739    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ecf33e2-d370-4307-9095-5b3d946eb74a-tls-certs\") pod \"kube-auth-proxy-d57cbb598-7crbl\" (UID: \"5ecf33e2-d370-4307-9095-5b3d946eb74a\") " pod="openshift-ingress/kube-auth-proxy-d57cbb598-7crbl"
Jul 23 13:47:10.484943 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:10.484763    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5ecf33e2-d370-4307-9095-5b3d946eb74a-tmp\") pod \"kube-auth-proxy-d57cbb598-7crbl\" (UID: \"5ecf33e2-d370-4307-9095-5b3d946eb74a\") " pod="openshift-ingress/kube-auth-proxy-d57cbb598-7crbl"
Jul 23 13:47:10.487093 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:10.487064    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5ecf33e2-d370-4307-9095-5b3d946eb74a-tmp\") pod \"kube-auth-proxy-d57cbb598-7crbl\" (UID: \"5ecf33e2-d370-4307-9095-5b3d946eb74a\") " pod="openshift-ingress/kube-auth-proxy-d57cbb598-7crbl"
Jul 23 13:47:10.487234 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:10.487216    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ecf33e2-d370-4307-9095-5b3d946eb74a-tls-certs\") pod \"kube-auth-proxy-d57cbb598-7crbl\" (UID: \"5ecf33e2-d370-4307-9095-5b3d946eb74a\") " pod="openshift-ingress/kube-auth-proxy-d57cbb598-7crbl"
Jul 23 13:47:10.499496 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:10.499469    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmgt9\" (UniqueName: \"kubernetes.io/projected/5ecf33e2-d370-4307-9095-5b3d946eb74a-kube-api-access-rmgt9\") pod \"kube-auth-proxy-d57cbb598-7crbl\" (UID: \"5ecf33e2-d370-4307-9095-5b3d946eb74a\") " pod="openshift-ingress/kube-auth-proxy-d57cbb598-7crbl"
Jul 23 13:47:10.521125 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:10.521101    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-d57cbb598-7crbl"
Jul 23 13:47:10.527193 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:10.527160    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:47:10.658871 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:10.658847    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-d57cbb598-7crbl"]
Jul 23 13:47:10.660926 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:47:10.660895    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ecf33e2_d370_4307_9095_5b3d946eb74a.slice/crio-7d5595a783917f54affbe11bdcf3ec60bac6211b4aace7883848349d31fadd68 WatchSource:0}: Error finding container 7d5595a783917f54affbe11bdcf3ec60bac6211b4aace7883848349d31fadd68: Status 404 returned error can't find the container with id 7d5595a783917f54affbe11bdcf3ec60bac6211b4aace7883848349d31fadd68
Jul 23 13:47:10.865248 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:10.865205    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-d57cbb598-7crbl" event={"ID":"5ecf33e2-d370-4307-9095-5b3d946eb74a","Type":"ContainerStarted","Data":"7d5595a783917f54affbe11bdcf3ec60bac6211b4aace7883848349d31fadd68"}
Jul 23 13:47:10.886752 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:10.886706    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cb90ddc6-5b8b-4d8f-af34-c40097c767e1-cert\") pod \"odh-model-controller-7998c67dc4-hh52w\" (UID: \"cb90ddc6-5b8b-4d8f-af34-c40097c767e1\") " pod="opendatahub/odh-model-controller-7998c67dc4-hh52w"
Jul 23 13:47:10.889403 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:10.889375    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cb90ddc6-5b8b-4d8f-af34-c40097c767e1-cert\") pod \"odh-model-controller-7998c67dc4-hh52w\" (UID: \"cb90ddc6-5b8b-4d8f-af34-c40097c767e1\") " pod="opendatahub/odh-model-controller-7998c67dc4-hh52w"
Jul 23 13:47:11.059365 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:11.059325    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-hh52w"
Jul 23 13:47:11.068181 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:11.068155    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-srv9n"]
Jul 23 13:47:11.071334 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:11.071307    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:47:11.072101 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:11.071998    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-srv9n"
Jul 23 13:47:11.075423 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:11.075403    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-5j7qt\""
Jul 23 13:47:11.075578 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:11.075553    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 23 13:47:11.080614 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:11.080254    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-srv9n"]
Jul 23 13:47:11.167718 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:11.167686    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:47:11.190173 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:11.190134    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3b8e722-03e6-4690-b29a-96917c5350fc-tls-certs\") pod \"model-serving-api-54d89bd5fc-srv9n\" (UID: \"f3b8e722-03e6-4690-b29a-96917c5350fc\") " pod="opendatahub/model-serving-api-54d89bd5fc-srv9n"
Jul 23 13:47:11.190331 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:11.190217    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kh7zx\" (UniqueName: \"kubernetes.io/projected/f3b8e722-03e6-4690-b29a-96917c5350fc-kube-api-access-kh7zx\") pod \"model-serving-api-54d89bd5fc-srv9n\" (UID: \"f3b8e722-03e6-4690-b29a-96917c5350fc\") " pod="opendatahub/model-serving-api-54d89bd5fc-srv9n"
Jul 23 13:47:11.210298 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:11.210273    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-hh52w"]
Jul 23 13:47:11.213183 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:47:11.213156    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb90ddc6_5b8b_4d8f_af34_c40097c767e1.slice/crio-ca634fbbdfa166d8017475c5cf33ef8bdece1efd34b64c035748d90064645db8 WatchSource:0}: Error finding container ca634fbbdfa166d8017475c5cf33ef8bdece1efd34b64c035748d90064645db8: Status 404 returned error can't find the container with id ca634fbbdfa166d8017475c5cf33ef8bdece1efd34b64c035748d90064645db8
Jul 23 13:47:11.291048 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:11.290986    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3b8e722-03e6-4690-b29a-96917c5350fc-tls-certs\") pod \"model-serving-api-54d89bd5fc-srv9n\" (UID: \"f3b8e722-03e6-4690-b29a-96917c5350fc\") " pod="opendatahub/model-serving-api-54d89bd5fc-srv9n"
Jul 23 13:47:11.291240 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:11.291079    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kh7zx\" (UniqueName: \"kubernetes.io/projected/f3b8e722-03e6-4690-b29a-96917c5350fc-kube-api-access-kh7zx\") pod \"model-serving-api-54d89bd5fc-srv9n\" (UID: \"f3b8e722-03e6-4690-b29a-96917c5350fc\") " pod="opendatahub/model-serving-api-54d89bd5fc-srv9n"
Jul 23 13:47:11.294124 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:11.294098    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3b8e722-03e6-4690-b29a-96917c5350fc-tls-certs\") pod \"model-serving-api-54d89bd5fc-srv9n\" (UID: \"f3b8e722-03e6-4690-b29a-96917c5350fc\") " pod="opendatahub/model-serving-api-54d89bd5fc-srv9n"
Jul 23 13:47:11.297259 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:11.297231    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:47:11.308397 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:11.308367    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kh7zx\" (UniqueName: \"kubernetes.io/projected/f3b8e722-03e6-4690-b29a-96917c5350fc-kube-api-access-kh7zx\") pod \"model-serving-api-54d89bd5fc-srv9n\" (UID: \"f3b8e722-03e6-4690-b29a-96917c5350fc\") " pod="opendatahub/model-serving-api-54d89bd5fc-srv9n"
Jul 23 13:47:11.385388 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:11.385311    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-srv9n"
Jul 23 13:47:11.550877 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:11.550749    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-srv9n"]
Jul 23 13:47:11.553855 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:47:11.553821    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3b8e722_03e6_4690_b29a_96917c5350fc.slice/crio-18ef240d303954e65e324fc878417548b73c2c3ee0c002b5dc123b897aa5b480 WatchSource:0}: Error finding container 18ef240d303954e65e324fc878417548b73c2c3ee0c002b5dc123b897aa5b480: Status 404 returned error can't find the container with id 18ef240d303954e65e324fc878417548b73c2c3ee0c002b5dc123b897aa5b480
Jul 23 13:47:11.867841 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:11.867726    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:47:11.874686 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:11.874652    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-srv9n" event={"ID":"f3b8e722-03e6-4690-b29a-96917c5350fc","Type":"ContainerStarted","Data":"18ef240d303954e65e324fc878417548b73c2c3ee0c002b5dc123b897aa5b480"}
Jul 23 13:47:11.876244 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:11.876211    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-hh52w" event={"ID":"cb90ddc6-5b8b-4d8f-af34-c40097c767e1","Type":"ContainerStarted","Data":"ca634fbbdfa166d8017475c5cf33ef8bdece1efd34b64c035748d90064645db8"}
Jul 23 13:47:11.877081 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:11.877061    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-gjvkf"]
Jul 23 13:47:11.880782 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:11.880763    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-gjvkf"
Jul 23 13:47:11.883352 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:11.883327    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 23 13:47:11.883473 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:11.883400    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-r7gvl\""
Jul 23 13:47:11.883473 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:11.883336    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 23 13:47:11.883768 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:11.883743    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 23 13:47:11.883888 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:11.883767    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 23 13:47:11.895217 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:11.895189    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f07d0baa-6df9-470e-86ce-94ad0daf9d5b-istio-token\") pod \"istiod-openshift-gateway-7574459656-gjvkf\" (UID: \"f07d0baa-6df9-470e-86ce-94ad0daf9d5b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-gjvkf"
Jul 23 13:47:11.895344 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:11.895232    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f07d0baa-6df9-470e-86ce-94ad0daf9d5b-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-gjvkf\" (UID: \"f07d0baa-6df9-470e-86ce-94ad0daf9d5b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-gjvkf"
Jul 23 13:47:11.895344 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:11.895271    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f07d0baa-6df9-470e-86ce-94ad0daf9d5b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-gjvkf\" (UID: \"f07d0baa-6df9-470e-86ce-94ad0daf9d5b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-gjvkf"
Jul 23 13:47:11.895344 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:11.895298    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f07d0baa-6df9-470e-86ce-94ad0daf9d5b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-gjvkf\" (UID: \"f07d0baa-6df9-470e-86ce-94ad0daf9d5b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-gjvkf"
Jul 23 13:47:11.895505 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:11.895363    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f07d0baa-6df9-470e-86ce-94ad0daf9d5b-cacerts\") pod \"istiod-openshift-gateway-7574459656-gjvkf\" (UID: \"f07d0baa-6df9-470e-86ce-94ad0daf9d5b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-gjvkf"
Jul 23 13:47:11.895505 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:11.895385    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f07d0baa-6df9-470e-86ce-94ad0daf9d5b-local-certs\") pod \"istiod-openshift-gateway-7574459656-gjvkf\" (UID: \"f07d0baa-6df9-470e-86ce-94ad0daf9d5b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-gjvkf"
Jul 23 13:47:11.895505 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:11.895405    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fh98\" (UniqueName: \"kubernetes.io/projected/f07d0baa-6df9-470e-86ce-94ad0daf9d5b-kube-api-access-2fh98\") pod \"istiod-openshift-gateway-7574459656-gjvkf\" (UID: \"f07d0baa-6df9-470e-86ce-94ad0daf9d5b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-gjvkf"
Jul 23 13:47:11.900831 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:11.900808    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-gjvkf"]
Jul 23 13:47:11.970369 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:11.970263    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:47:11.996363 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:11.996310    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f07d0baa-6df9-470e-86ce-94ad0daf9d5b-cacerts\") pod \"istiod-openshift-gateway-7574459656-gjvkf\" (UID: \"f07d0baa-6df9-470e-86ce-94ad0daf9d5b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-gjvkf"
Jul 23 13:47:11.996363 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:11.996362    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f07d0baa-6df9-470e-86ce-94ad0daf9d5b-local-certs\") pod \"istiod-openshift-gateway-7574459656-gjvkf\" (UID: \"f07d0baa-6df9-470e-86ce-94ad0daf9d5b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-gjvkf"
Jul 23 13:47:11.996585 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:11.996394    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fh98\" (UniqueName: \"kubernetes.io/projected/f07d0baa-6df9-470e-86ce-94ad0daf9d5b-kube-api-access-2fh98\") pod \"istiod-openshift-gateway-7574459656-gjvkf\" (UID: \"f07d0baa-6df9-470e-86ce-94ad0daf9d5b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-gjvkf"
Jul 23 13:47:11.996585 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:11.996450    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f07d0baa-6df9-470e-86ce-94ad0daf9d5b-istio-token\") pod \"istiod-openshift-gateway-7574459656-gjvkf\" (UID: \"f07d0baa-6df9-470e-86ce-94ad0daf9d5b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-gjvkf"
Jul 23 13:47:11.996585 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:11.996477    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f07d0baa-6df9-470e-86ce-94ad0daf9d5b-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-gjvkf\" (UID: \"f07d0baa-6df9-470e-86ce-94ad0daf9d5b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-gjvkf"
Jul 23 13:47:11.996585 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:11.996513    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f07d0baa-6df9-470e-86ce-94ad0daf9d5b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-gjvkf\" (UID: \"f07d0baa-6df9-470e-86ce-94ad0daf9d5b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-gjvkf"
Jul 23 13:47:11.996585 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:11.996540    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f07d0baa-6df9-470e-86ce-94ad0daf9d5b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-gjvkf\" (UID: \"f07d0baa-6df9-470e-86ce-94ad0daf9d5b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-gjvkf"
Jul 23 13:47:11.997818 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:11.997792    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f07d0baa-6df9-470e-86ce-94ad0daf9d5b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-gjvkf\" (UID: \"f07d0baa-6df9-470e-86ce-94ad0daf9d5b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-gjvkf"
Jul 23 13:47:11.999651 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:11.999607    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f07d0baa-6df9-470e-86ce-94ad0daf9d5b-cacerts\") pod \"istiod-openshift-gateway-7574459656-gjvkf\" (UID: \"f07d0baa-6df9-470e-86ce-94ad0daf9d5b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-gjvkf"
Jul 23 13:47:12.000911 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:12.000850    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f07d0baa-6df9-470e-86ce-94ad0daf9d5b-local-certs\") pod \"istiod-openshift-gateway-7574459656-gjvkf\" (UID: \"f07d0baa-6df9-470e-86ce-94ad0daf9d5b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-gjvkf"
Jul 23 13:47:12.001398 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:12.001372    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f07d0baa-6df9-470e-86ce-94ad0daf9d5b-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-gjvkf\" (UID: \"f07d0baa-6df9-470e-86ce-94ad0daf9d5b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-gjvkf"
Jul 23 13:47:12.008211 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:12.008188    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f07d0baa-6df9-470e-86ce-94ad0daf9d5b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-gjvkf\" (UID: \"f07d0baa-6df9-470e-86ce-94ad0daf9d5b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-gjvkf"
Jul 23 13:47:12.010378 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:12.010336    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f07d0baa-6df9-470e-86ce-94ad0daf9d5b-istio-token\") pod \"istiod-openshift-gateway-7574459656-gjvkf\" (UID: \"f07d0baa-6df9-470e-86ce-94ad0daf9d5b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-gjvkf"
Jul 23 13:47:12.011119 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:12.011064    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fh98\" (UniqueName: \"kubernetes.io/projected/f07d0baa-6df9-470e-86ce-94ad0daf9d5b-kube-api-access-2fh98\") pod \"istiod-openshift-gateway-7574459656-gjvkf\" (UID: \"f07d0baa-6df9-470e-86ce-94ad0daf9d5b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-gjvkf"
Jul 23 13:47:12.193903 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:12.193810    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-gjvkf"
Jul 23 13:47:12.375488 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:12.375335    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-gjvkf"]
Jul 23 13:47:12.378949 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:47:12.378917    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf07d0baa_6df9_470e_86ce_94ad0daf9d5b.slice/crio-e24467446951900c1ba577acb5854d1a3c715d2b232fe3f239a4a83c7a4ac661 WatchSource:0}: Error finding container e24467446951900c1ba577acb5854d1a3c715d2b232fe3f239a4a83c7a4ac661: Status 404 returned error can't find the container with id e24467446951900c1ba577acb5854d1a3c715d2b232fe3f239a4a83c7a4ac661
Jul 23 13:47:12.885625 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:12.885586    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-gjvkf" event={"ID":"f07d0baa-6df9-470e-86ce-94ad0daf9d5b","Type":"ContainerStarted","Data":"e24467446951900c1ba577acb5854d1a3c715d2b232fe3f239a4a83c7a4ac661"}
Jul 23 13:47:13.011210 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:13.011164    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:47:16.266691 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:16.266648    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 13:47:16.266986 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:16.266724    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 13:47:16.913923 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:16.913879    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-srv9n" event={"ID":"f3b8e722-03e6-4690-b29a-96917c5350fc","Type":"ContainerStarted","Data":"0051be43f18aaa1d817fc68d4775179b81f2f868a9cfc379c6fd0d499f565fb1"}
Jul 23 13:47:16.914147 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:16.914027    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-srv9n"
Jul 23 13:47:16.915610 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:16.915585    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-gjvkf" event={"ID":"f07d0baa-6df9-470e-86ce-94ad0daf9d5b","Type":"ContainerStarted","Data":"98eae6bd8b4f1b8dd1d19e03a99e34786a8dcd14319620704e0b5e2fed7be013"}
Jul 23 13:47:16.915719 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:16.915630    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-gjvkf"
Jul 23 13:47:16.916986 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:16.916955    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-d57cbb598-7crbl" event={"ID":"5ecf33e2-d370-4307-9095-5b3d946eb74a","Type":"ContainerStarted","Data":"c3e8228ef3024d677ac6fcc36d7e03a87ecbe70afdc242e7e32260718091d6e5"}
Jul 23 13:47:16.918454 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:16.918421    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-hh52w" event={"ID":"cb90ddc6-5b8b-4d8f-af34-c40097c767e1","Type":"ContainerStarted","Data":"77e56babed60cff29805da2048f9b85f5df7fa68b5dcddb3455e2a3db662a708"}
Jul 23 13:47:16.918633 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:16.918619    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-hh52w"
Jul 23 13:47:16.936766 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:16.936715    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-srv9n" podStartSLOduration=1.292734903 podStartE2EDuration="5.936701318s" totalImagesPullingTime="4.643966415s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:47:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:47:16.935615096 +0000 UTC m=+408.375116015" watchObservedRunningTime="2026-07-23 13:47:16.936701318 +0000 UTC m=+408.376202237"
Jul 23 13:47:16.956161 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:16.955930    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-d57cbb598-7crbl" podStartSLOduration=2.287799775 podStartE2EDuration="6.955892611s" totalImagesPullingTime="4.668092836s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:47:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:47:16.955321043 +0000 UTC m=+408.394821966" watchObservedRunningTime="2026-07-23 13:47:16.955892611 +0000 UTC m=+408.395393531"
Jul 23 13:47:16.974248 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:16.974195    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-hh52w" podStartSLOduration=1.9782534040000002 podStartE2EDuration="6.974176711s" totalImagesPullingTime="4.995923307s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:47:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:47:16.973210935 +0000 UTC m=+408.412711855" watchObservedRunningTime="2026-07-23 13:47:16.974176711 +0000 UTC m=+408.413677632"
Jul 23 13:47:16.995726 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:16.995672    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-gjvkf" podStartSLOduration=2.111227824 podStartE2EDuration="5.995655146s" totalImagesPullingTime="3.884427322s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:47:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:47:16.995547038 +0000 UTC m=+408.435047957" watchObservedRunningTime="2026-07-23 13:47:16.995655146 +0000 UTC m=+408.435156064"
Jul 23 13:47:17.926352 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:17.926315    2573 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-gjvkf container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 23 13:47:17.926784 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:17.926374    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-gjvkf" podUID="f07d0baa-6df9-470e-86ce-94ad0daf9d5b" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 23 13:47:18.067256 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:18.067217    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:47:18.198680 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:18.198590    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:47:19.019558 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:19.019524    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qvc6t"]
Jul 23 13:47:19.023415 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:19.023391    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qvc6t"
Jul 23 13:47:19.026448 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:19.026431    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-592z6\""
Jul 23 13:47:19.049057 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:19.049022    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qvc6t"]
Jul 23 13:47:19.055305 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:19.055278    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f6fce891-07cf-4dc5-b579-ab9564cdc19c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qvc6t\" (UID: \"f6fce891-07cf-4dc5-b579-ab9564cdc19c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qvc6t"
Jul 23 13:47:19.055424 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:19.055341    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f6fce891-07cf-4dc5-b579-ab9564cdc19c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qvc6t\" (UID: \"f6fce891-07cf-4dc5-b579-ab9564cdc19c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qvc6t"
Jul 23 13:47:19.055424 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:19.055370    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f6fce891-07cf-4dc5-b579-ab9564cdc19c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qvc6t\" (UID: \"f6fce891-07cf-4dc5-b579-ab9564cdc19c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qvc6t"
Jul 23 13:47:19.055424 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:19.055414    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hkfn\" (UniqueName: \"kubernetes.io/projected/f6fce891-07cf-4dc5-b579-ab9564cdc19c-kube-api-access-8hkfn\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qvc6t\" (UID: \"f6fce891-07cf-4dc5-b579-ab9564cdc19c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qvc6t"
Jul 23 13:47:19.055548 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:19.055465    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6fce891-07cf-4dc5-b579-ab9564cdc19c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qvc6t\" (UID: \"f6fce891-07cf-4dc5-b579-ab9564cdc19c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qvc6t"
Jul 23 13:47:19.055548 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:19.055495    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6fce891-07cf-4dc5-b579-ab9564cdc19c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qvc6t\" (UID: \"f6fce891-07cf-4dc5-b579-ab9564cdc19c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qvc6t"
Jul 23 13:47:19.055548 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:19.055527    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6fce891-07cf-4dc5-b579-ab9564cdc19c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qvc6t\" (UID: \"f6fce891-07cf-4dc5-b579-ab9564cdc19c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qvc6t"
Jul 23 13:47:19.055651 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:19.055554    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6fce891-07cf-4dc5-b579-ab9564cdc19c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qvc6t\" (UID: \"f6fce891-07cf-4dc5-b579-ab9564cdc19c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qvc6t"
Jul 23 13:47:19.055691 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:19.055638    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f6fce891-07cf-4dc5-b579-ab9564cdc19c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qvc6t\" (UID: \"f6fce891-07cf-4dc5-b579-ab9564cdc19c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qvc6t"
Jul 23 13:47:19.072484 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:19.072446    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:47:19.156439 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:19.156399    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f6fce891-07cf-4dc5-b579-ab9564cdc19c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qvc6t\" (UID: \"f6fce891-07cf-4dc5-b579-ab9564cdc19c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qvc6t"
Jul 23 13:47:19.156439 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:19.156443    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f6fce891-07cf-4dc5-b579-ab9564cdc19c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qvc6t\" (UID: \"f6fce891-07cf-4dc5-b579-ab9564cdc19c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qvc6t"
Jul 23 13:47:19.156679 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:19.156488    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f6fce891-07cf-4dc5-b579-ab9564cdc19c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qvc6t\" (UID: \"f6fce891-07cf-4dc5-b579-ab9564cdc19c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qvc6t"
Jul 23 13:47:19.156679 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:19.156515    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f6fce891-07cf-4dc5-b579-ab9564cdc19c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qvc6t\" (UID: \"f6fce891-07cf-4dc5-b579-ab9564cdc19c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qvc6t"
Jul 23 13:47:19.156679 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:19.156560    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hkfn\" (UniqueName: \"kubernetes.io/projected/f6fce891-07cf-4dc5-b579-ab9564cdc19c-kube-api-access-8hkfn\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qvc6t\" (UID: \"f6fce891-07cf-4dc5-b579-ab9564cdc19c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qvc6t"
Jul 23 13:47:19.156823 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:19.156783    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6fce891-07cf-4dc5-b579-ab9564cdc19c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qvc6t\" (UID: \"f6fce891-07cf-4dc5-b579-ab9564cdc19c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qvc6t"
Jul 23 13:47:19.156823 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:19.156806    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f6fce891-07cf-4dc5-b579-ab9564cdc19c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qvc6t\" (UID: \"f6fce891-07cf-4dc5-b579-ab9564cdc19c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qvc6t"
Jul 23 13:47:19.156932 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:19.156834    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6fce891-07cf-4dc5-b579-ab9564cdc19c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qvc6t\" (UID: \"f6fce891-07cf-4dc5-b579-ab9564cdc19c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qvc6t"
Jul 23 13:47:19.156932 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:19.156875    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6fce891-07cf-4dc5-b579-ab9564cdc19c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qvc6t\" (UID: \"f6fce891-07cf-4dc5-b579-ab9564cdc19c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qvc6t"
Jul 23 13:47:19.156932 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:19.156903    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6fce891-07cf-4dc5-b579-ab9564cdc19c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qvc6t\" (UID: \"f6fce891-07cf-4dc5-b579-ab9564cdc19c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qvc6t"
Jul 23 13:47:19.157218 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:19.157199    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6fce891-07cf-4dc5-b579-ab9564cdc19c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qvc6t\" (UID: \"f6fce891-07cf-4dc5-b579-ab9564cdc19c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qvc6t"
Jul 23 13:47:19.157281 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:19.157235    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6fce891-07cf-4dc5-b579-ab9564cdc19c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qvc6t\" (UID: \"f6fce891-07cf-4dc5-b579-ab9564cdc19c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qvc6t"
Jul 23 13:47:19.157351 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:19.157330    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6fce891-07cf-4dc5-b579-ab9564cdc19c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qvc6t\" (UID: \"f6fce891-07cf-4dc5-b579-ab9564cdc19c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qvc6t"
Jul 23 13:47:19.157391 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:19.157352    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f6fce891-07cf-4dc5-b579-ab9564cdc19c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qvc6t\" (UID: \"f6fce891-07cf-4dc5-b579-ab9564cdc19c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qvc6t"
Jul 23 13:47:19.159304 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:19.159271    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f6fce891-07cf-4dc5-b579-ab9564cdc19c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qvc6t\" (UID: \"f6fce891-07cf-4dc5-b579-ab9564cdc19c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qvc6t"
Jul 23 13:47:19.159508 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:19.159492    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f6fce891-07cf-4dc5-b579-ab9564cdc19c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qvc6t\" (UID: \"f6fce891-07cf-4dc5-b579-ab9564cdc19c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qvc6t"
Jul 23 13:47:19.183659 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:19.183631    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hkfn\" (UniqueName: \"kubernetes.io/projected/f6fce891-07cf-4dc5-b579-ab9564cdc19c-kube-api-access-8hkfn\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qvc6t\" (UID: \"f6fce891-07cf-4dc5-b579-ab9564cdc19c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qvc6t"
Jul 23 13:47:19.221261 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:19.221227    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6fce891-07cf-4dc5-b579-ab9564cdc19c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qvc6t\" (UID: \"f6fce891-07cf-4dc5-b579-ab9564cdc19c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qvc6t"
Jul 23 13:47:19.333176 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:19.333146    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qvc6t"
Jul 23 13:47:19.442863 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:19.442825    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:47:19.486888 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:19.486861    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qvc6t"]
Jul 23 13:47:19.488364 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:47:19.488336    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6fce891_07cf_4dc5_b579_ab9564cdc19c.slice/crio-8a73840f618b71db56a112deb53b50303f6befd97497704eaf6649aab670916d WatchSource:0}: Error finding container 8a73840f618b71db56a112deb53b50303f6befd97497704eaf6649aab670916d: Status 404 returned error can't find the container with id 8a73840f618b71db56a112deb53b50303f6befd97497704eaf6649aab670916d
Jul 23 13:47:19.539957 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:19.539922    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:47:19.934202 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:19.934168    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qvc6t" event={"ID":"f6fce891-07cf-4dc5-b579-ab9564cdc19c","Type":"ContainerStarted","Data":"8a73840f618b71db56a112deb53b50303f6befd97497704eaf6649aab670916d"}
Jul 23 13:47:20.925432 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:20.925397    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-gjvkf"
Jul 23 13:47:21.175157 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:21.175104    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:47:21.300106 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:21.300070    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-n2f96"]
Jul 23 13:47:21.307479 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:21.307452    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-n2f96"
Jul 23 13:47:21.312078 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:21.312056    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 23 13:47:21.312393 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:21.312373    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-c95j6\""
Jul 23 13:47:21.330328 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:21.330304    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-n2f96"]
Jul 23 13:47:21.333074 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:21.332996    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-rtpbg"]
Jul 23 13:47:21.339812 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:21.339792    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rtpbg"
Jul 23 13:47:21.344053 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:21.344032    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-8bfx5\""
Jul 23 13:47:21.344414 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:21.344268    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 23 13:47:21.360029 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:21.359990    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-rtpbg"]
Jul 23 13:47:21.379687 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:21.379650    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dc9t6\" (UniqueName: \"kubernetes.io/projected/a9d6385e-405f-4573-81e9-bafc4c361c18-kube-api-access-dc9t6\") pod \"kserve-controller-manager-d6f4b65b8-n2f96\" (UID: \"a9d6385e-405f-4573-81e9-bafc4c361c18\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-n2f96"
Jul 23 13:47:21.379849 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:21.379718    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5m4cj\" (UniqueName: \"kubernetes.io/projected/5985ea7e-336b-45af-b8dc-7d6c9ee81d27-kube-api-access-5m4cj\") pod \"llmisvc-controller-manager-777c6bd7d5-rtpbg\" (UID: \"5985ea7e-336b-45af-b8dc-7d6c9ee81d27\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rtpbg"
Jul 23 13:47:21.379849 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:21.379761    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a9d6385e-405f-4573-81e9-bafc4c361c18-cert\") pod \"kserve-controller-manager-d6f4b65b8-n2f96\" (UID: \"a9d6385e-405f-4573-81e9-bafc4c361c18\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-n2f96"
Jul 23 13:47:21.379969 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:21.379860    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5985ea7e-336b-45af-b8dc-7d6c9ee81d27-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-rtpbg\" (UID: \"5985ea7e-336b-45af-b8dc-7d6c9ee81d27\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rtpbg"
Jul 23 13:47:21.408300 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:21.408267    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:47:21.480690 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:21.480637    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5985ea7e-336b-45af-b8dc-7d6c9ee81d27-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-rtpbg\" (UID: \"5985ea7e-336b-45af-b8dc-7d6c9ee81d27\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rtpbg"
Jul 23 13:47:21.480878 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:21.480738    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dc9t6\" (UniqueName: \"kubernetes.io/projected/a9d6385e-405f-4573-81e9-bafc4c361c18-kube-api-access-dc9t6\") pod \"kserve-controller-manager-d6f4b65b8-n2f96\" (UID: \"a9d6385e-405f-4573-81e9-bafc4c361c18\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-n2f96"
Jul 23 13:47:21.480878 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:21.480802    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5m4cj\" (UniqueName: \"kubernetes.io/projected/5985ea7e-336b-45af-b8dc-7d6c9ee81d27-kube-api-access-5m4cj\") pod \"llmisvc-controller-manager-777c6bd7d5-rtpbg\" (UID: \"5985ea7e-336b-45af-b8dc-7d6c9ee81d27\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rtpbg"
Jul 23 13:47:21.480878 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:21.480828    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a9d6385e-405f-4573-81e9-bafc4c361c18-cert\") pod \"kserve-controller-manager-d6f4b65b8-n2f96\" (UID: \"a9d6385e-405f-4573-81e9-bafc4c361c18\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-n2f96"
Jul 23 13:47:21.481073 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:47:21.480802    2573 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 23 13:47:21.481073 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:47:21.480971    2573 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 23 13:47:21.481073 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:47:21.480977    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5985ea7e-336b-45af-b8dc-7d6c9ee81d27-cert podName:5985ea7e-336b-45af-b8dc-7d6c9ee81d27 nodeName:}" failed. No retries permitted until 2026-07-23 13:47:21.98095471 +0000 UTC m=+413.420455621 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5985ea7e-336b-45af-b8dc-7d6c9ee81d27-cert") pod "llmisvc-controller-manager-777c6bd7d5-rtpbg" (UID: "5985ea7e-336b-45af-b8dc-7d6c9ee81d27") : secret "llmisvc-webhook-server-cert" not found
Jul 23 13:47:21.481073 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:47:21.481006    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9d6385e-405f-4573-81e9-bafc4c361c18-cert podName:a9d6385e-405f-4573-81e9-bafc4c361c18 nodeName:}" failed. No retries permitted until 2026-07-23 13:47:21.980995341 +0000 UTC m=+413.420496244 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a9d6385e-405f-4573-81e9-bafc4c361c18-cert") pod "kserve-controller-manager-d6f4b65b8-n2f96" (UID: "a9d6385e-405f-4573-81e9-bafc4c361c18") : secret "kserve-webhook-server-cert" not found
Jul 23 13:47:21.497922 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:21.497886    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dc9t6\" (UniqueName: \"kubernetes.io/projected/a9d6385e-405f-4573-81e9-bafc4c361c18-kube-api-access-dc9t6\") pod \"kserve-controller-manager-d6f4b65b8-n2f96\" (UID: \"a9d6385e-405f-4573-81e9-bafc4c361c18\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-n2f96"
Jul 23 13:47:21.498772 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:21.498745    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5m4cj\" (UniqueName: \"kubernetes.io/projected/5985ea7e-336b-45af-b8dc-7d6c9ee81d27-kube-api-access-5m4cj\") pod \"llmisvc-controller-manager-777c6bd7d5-rtpbg\" (UID: \"5985ea7e-336b-45af-b8dc-7d6c9ee81d27\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rtpbg"
Jul 23 13:47:21.786797 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:21.786707    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:47:21.940486 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:21.940453    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:47:21.987797 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:21.987763    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a9d6385e-405f-4573-81e9-bafc4c361c18-cert\") pod \"kserve-controller-manager-d6f4b65b8-n2f96\" (UID: \"a9d6385e-405f-4573-81e9-bafc4c361c18\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-n2f96"
Jul 23 13:47:21.987965 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:21.987813    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5985ea7e-336b-45af-b8dc-7d6c9ee81d27-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-rtpbg\" (UID: \"5985ea7e-336b-45af-b8dc-7d6c9ee81d27\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rtpbg"
Jul 23 13:47:21.991979 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:21.991952    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a9d6385e-405f-4573-81e9-bafc4c361c18-cert\") pod \"kserve-controller-manager-d6f4b65b8-n2f96\" (UID: \"a9d6385e-405f-4573-81e9-bafc4c361c18\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-n2f96"
Jul 23 13:47:21.992239 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:21.992220    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5985ea7e-336b-45af-b8dc-7d6c9ee81d27-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-rtpbg\" (UID: \"5985ea7e-336b-45af-b8dc-7d6c9ee81d27\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rtpbg"
Jul 23 13:47:22.172762 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:22.172731    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 13:47:22.172829 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:22.172799    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 13:47:22.172863 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:22.172832    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 13:47:22.220390 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:22.220364    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-n2f96"
Jul 23 13:47:22.255903 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:22.255872    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rtpbg"
Jul 23 13:47:22.387700 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:22.387095    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-n2f96"]
Jul 23 13:47:22.392142 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:47:22.392096    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9d6385e_405f_4573_81e9_bafc4c361c18.slice/crio-054c360bd9607f8d103b616f3e5d1f881013bbbb5fbb00a5064d3034bfdb5178 WatchSource:0}: Error finding container 054c360bd9607f8d103b616f3e5d1f881013bbbb5fbb00a5064d3034bfdb5178: Status 404 returned error can't find the container with id 054c360bd9607f8d103b616f3e5d1f881013bbbb5fbb00a5064d3034bfdb5178
Jul 23 13:47:22.430487 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:22.430353    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-rtpbg"]
Jul 23 13:47:22.432614 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:47:22.432585    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod5985ea7e_336b_45af_b8dc_7d6c9ee81d27.slice/crio-a9c7b3b26e9c97ac44d1078dc6ec2246fa21c703c27ee1fefec0f46648d44072 WatchSource:0}: Error finding container a9c7b3b26e9c97ac44d1078dc6ec2246fa21c703c27ee1fefec0f46648d44072: Status 404 returned error can't find the container with id a9c7b3b26e9c97ac44d1078dc6ec2246fa21c703c27ee1fefec0f46648d44072
Jul 23 13:47:22.525594 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:22.525564    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:47:22.623773 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:22.623733    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:47:22.723745 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:22.723662    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:47:22.951030 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:22.950982    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rtpbg" event={"ID":"5985ea7e-336b-45af-b8dc-7d6c9ee81d27","Type":"ContainerStarted","Data":"a9c7b3b26e9c97ac44d1078dc6ec2246fa21c703c27ee1fefec0f46648d44072"}
Jul 23 13:47:22.952314 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:22.952287    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-n2f96" event={"ID":"a9d6385e-405f-4573-81e9-bafc4c361c18","Type":"ContainerStarted","Data":"054c360bd9607f8d103b616f3e5d1f881013bbbb5fbb00a5064d3034bfdb5178"}
Jul 23 13:47:22.953717 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:22.953696    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qvc6t" event={"ID":"f6fce891-07cf-4dc5-b579-ab9564cdc19c","Type":"ContainerStarted","Data":"4a463cd4b70fe19cd45f3987a3101bfa76646050ba37a4e473106250bd53528e"}
Jul 23 13:47:23.333909 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:23.333824    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qvc6t"
Jul 23 13:47:23.339628 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:23.339594    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qvc6t"
Jul 23 13:47:23.353441 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:23.353382    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qvc6t" podStartSLOduration=2.671168133 podStartE2EDuration="5.353359867s" totalImagesPullingTime="2.682191734s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:47:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:47:22.988778561 +0000 UTC m=+414.428279480" watchObservedRunningTime="2026-07-23 13:47:23.353359867 +0000 UTC m=+414.792860788"
Jul 23 13:47:23.355204 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:23.355176    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-gjvkf"]
Jul 23 13:47:23.355533 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:23.355504    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-gjvkf" podUID="f07d0baa-6df9-470e-86ce-94ad0daf9d5b" containerName="discovery" containerID="cri-o://98eae6bd8b4f1b8dd1d19e03a99e34786a8dcd14319620704e0b5e2fed7be013" gracePeriod=30
Jul 23 13:47:23.733727 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:23.733703    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-gjvkf"
Jul 23 13:47:23.806162 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:23.805905    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f07d0baa-6df9-470e-86ce-94ad0daf9d5b-istio-token\") pod \"f07d0baa-6df9-470e-86ce-94ad0daf9d5b\" (UID: \"f07d0baa-6df9-470e-86ce-94ad0daf9d5b\") "
Jul 23 13:47:23.806340 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:23.806209    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2fh98\" (UniqueName: \"kubernetes.io/projected/f07d0baa-6df9-470e-86ce-94ad0daf9d5b-kube-api-access-2fh98\") pod \"f07d0baa-6df9-470e-86ce-94ad0daf9d5b\" (UID: \"f07d0baa-6df9-470e-86ce-94ad0daf9d5b\") "
Jul 23 13:47:23.806340 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:23.806273    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f07d0baa-6df9-470e-86ce-94ad0daf9d5b-cacerts\") pod \"f07d0baa-6df9-470e-86ce-94ad0daf9d5b\" (UID: \"f07d0baa-6df9-470e-86ce-94ad0daf9d5b\") "
Jul 23 13:47:23.806340 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:23.806302    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f07d0baa-6df9-470e-86ce-94ad0daf9d5b-istio-kubeconfig\") pod \"f07d0baa-6df9-470e-86ce-94ad0daf9d5b\" (UID: \"f07d0baa-6df9-470e-86ce-94ad0daf9d5b\") "
Jul 23 13:47:23.806340 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:23.806335    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f07d0baa-6df9-470e-86ce-94ad0daf9d5b-istio-csr-dns-cert\") pod \"f07d0baa-6df9-470e-86ce-94ad0daf9d5b\" (UID: \"f07d0baa-6df9-470e-86ce-94ad0daf9d5b\") "
Jul 23 13:47:23.806579 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:23.806370    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f07d0baa-6df9-470e-86ce-94ad0daf9d5b-local-certs\") pod \"f07d0baa-6df9-470e-86ce-94ad0daf9d5b\" (UID: \"f07d0baa-6df9-470e-86ce-94ad0daf9d5b\") "
Jul 23 13:47:23.806579 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:23.806457    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f07d0baa-6df9-470e-86ce-94ad0daf9d5b-istio-csr-ca-configmap\") pod \"f07d0baa-6df9-470e-86ce-94ad0daf9d5b\" (UID: \"f07d0baa-6df9-470e-86ce-94ad0daf9d5b\") "
Jul 23 13:47:23.807136 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:23.807100    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f07d0baa-6df9-470e-86ce-94ad0daf9d5b-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "f07d0baa-6df9-470e-86ce-94ad0daf9d5b" (UID: "f07d0baa-6df9-470e-86ce-94ad0daf9d5b"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 13:47:23.809674 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:23.809632    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f07d0baa-6df9-470e-86ce-94ad0daf9d5b-local-certs" (OuterVolumeSpecName: "local-certs") pod "f07d0baa-6df9-470e-86ce-94ad0daf9d5b" (UID: "f07d0baa-6df9-470e-86ce-94ad0daf9d5b"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 13:47:23.810123 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:23.810100    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f07d0baa-6df9-470e-86ce-94ad0daf9d5b-kube-api-access-2fh98" (OuterVolumeSpecName: "kube-api-access-2fh98") pod "f07d0baa-6df9-470e-86ce-94ad0daf9d5b" (UID: "f07d0baa-6df9-470e-86ce-94ad0daf9d5b"). InnerVolumeSpecName "kube-api-access-2fh98". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:47:23.810310 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:23.810289    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f07d0baa-6df9-470e-86ce-94ad0daf9d5b-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "f07d0baa-6df9-470e-86ce-94ad0daf9d5b" (UID: "f07d0baa-6df9-470e-86ce-94ad0daf9d5b"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 13:47:23.810397 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:23.810328    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f07d0baa-6df9-470e-86ce-94ad0daf9d5b-istio-token" (OuterVolumeSpecName: "istio-token") pod "f07d0baa-6df9-470e-86ce-94ad0daf9d5b" (UID: "f07d0baa-6df9-470e-86ce-94ad0daf9d5b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:47:23.811131 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:23.810994    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f07d0baa-6df9-470e-86ce-94ad0daf9d5b-cacerts" (OuterVolumeSpecName: "cacerts") pod "f07d0baa-6df9-470e-86ce-94ad0daf9d5b" (UID: "f07d0baa-6df9-470e-86ce-94ad0daf9d5b"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 13:47:23.812129 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:23.812067    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f07d0baa-6df9-470e-86ce-94ad0daf9d5b-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "f07d0baa-6df9-470e-86ce-94ad0daf9d5b" (UID: "f07d0baa-6df9-470e-86ce-94ad0daf9d5b"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 13:47:23.907990 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:23.907951    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2fh98\" (UniqueName: \"kubernetes.io/projected/f07d0baa-6df9-470e-86ce-94ad0daf9d5b-kube-api-access-2fh98\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 13:47:23.907990 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:23.907987    2573 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f07d0baa-6df9-470e-86ce-94ad0daf9d5b-cacerts\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 13:47:23.908264 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:23.908004    2573 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f07d0baa-6df9-470e-86ce-94ad0daf9d5b-istio-kubeconfig\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 13:47:23.908264 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:23.908034    2573 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f07d0baa-6df9-470e-86ce-94ad0daf9d5b-istio-csr-dns-cert\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 13:47:23.908264 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:23.908048    2573 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f07d0baa-6df9-470e-86ce-94ad0daf9d5b-local-certs\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 13:47:23.908264 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:23.908059    2573 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f07d0baa-6df9-470e-86ce-94ad0daf9d5b-istio-csr-ca-configmap\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 13:47:23.908264 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:23.908069    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f07d0baa-6df9-470e-86ce-94ad0daf9d5b-istio-token\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 13:47:23.963286 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:23.963198    2573 generic.go:356] "Generic (PLEG): container finished" podID="f07d0baa-6df9-470e-86ce-94ad0daf9d5b" containerID="98eae6bd8b4f1b8dd1d19e03a99e34786a8dcd14319620704e0b5e2fed7be013" exitCode=0
Jul 23 13:47:23.963286 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:23.963235    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-gjvkf" event={"ID":"f07d0baa-6df9-470e-86ce-94ad0daf9d5b","Type":"ContainerDied","Data":"98eae6bd8b4f1b8dd1d19e03a99e34786a8dcd14319620704e0b5e2fed7be013"}
Jul 23 13:47:23.963286 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:23.963283    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-gjvkf" event={"ID":"f07d0baa-6df9-470e-86ce-94ad0daf9d5b","Type":"ContainerDied","Data":"e24467446951900c1ba577acb5854d1a3c715d2b232fe3f239a4a83c7a4ac661"}
Jul 23 13:47:23.963788 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:23.963219    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-gjvkf"
Jul 23 13:47:23.963788 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:23.963311    2573 scope.go:117] "RemoveContainer" containerID="98eae6bd8b4f1b8dd1d19e03a99e34786a8dcd14319620704e0b5e2fed7be013"
Jul 23 13:47:23.963788 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:23.963770    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qvc6t"
Jul 23 13:47:23.965217 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:23.965198    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qvc6t"
Jul 23 13:47:24.029654 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:24.029588    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-gjvkf"]
Jul 23 13:47:24.030792 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:24.030767    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-gjvkf"]
Jul 23 13:47:24.146169 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:24.146140    2573 scope.go:117] "RemoveContainer" containerID="98eae6bd8b4f1b8dd1d19e03a99e34786a8dcd14319620704e0b5e2fed7be013"
Jul 23 13:47:24.146580 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:47:24.146546    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98eae6bd8b4f1b8dd1d19e03a99e34786a8dcd14319620704e0b5e2fed7be013\": container with ID starting with 98eae6bd8b4f1b8dd1d19e03a99e34786a8dcd14319620704e0b5e2fed7be013 not found: ID does not exist" containerID="98eae6bd8b4f1b8dd1d19e03a99e34786a8dcd14319620704e0b5e2fed7be013"
Jul 23 13:47:24.146699 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:24.146592    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98eae6bd8b4f1b8dd1d19e03a99e34786a8dcd14319620704e0b5e2fed7be013"} err="failed to get container status \"98eae6bd8b4f1b8dd1d19e03a99e34786a8dcd14319620704e0b5e2fed7be013\": rpc error: code = NotFound desc = could not find container \"98eae6bd8b4f1b8dd1d19e03a99e34786a8dcd14319620704e0b5e2fed7be013\": container with ID starting with 98eae6bd8b4f1b8dd1d19e03a99e34786a8dcd14319620704e0b5e2fed7be013 not found: ID does not exist"
Jul 23 13:47:25.072252 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:25.072223    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f07d0baa-6df9-470e-86ce-94ad0daf9d5b" path="/var/lib/kubelet/pods/f07d0baa-6df9-470e-86ce-94ad0daf9d5b/volumes"
Jul 23 13:47:25.975705 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:25.975672    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rtpbg" event={"ID":"5985ea7e-336b-45af-b8dc-7d6c9ee81d27","Type":"ContainerStarted","Data":"36615d51efed9294339e862ce5eb25a017d26ad2a9aca1ebe5165f33af8858e2"}
Jul 23 13:47:25.975943 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:25.975800    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rtpbg"
Jul 23 13:47:25.977352 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:25.977327    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-n2f96" event={"ID":"a9d6385e-405f-4573-81e9-bafc4c361c18","Type":"ContainerStarted","Data":"f1a976a9766b0615f3cd7f88d130cccf8e9f61fb2edadbe5e2067de9fb5773f1"}
Jul 23 13:47:25.977426 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:25.977375    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-n2f96"
Jul 23 13:47:25.998457 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:25.998415    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rtpbg" podStartSLOduration=1.917446193 podStartE2EDuration="4.998401821s" totalImagesPullingTime="3.080955628s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:47:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:47:25.997360395 +0000 UTC m=+417.436861315" watchObservedRunningTime="2026-07-23 13:47:25.998401821 +0000 UTC m=+417.437902718"
Jul 23 13:47:26.028705 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:26.028652    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-n2f96" podStartSLOduration=1.911080409 podStartE2EDuration="5.028633199s" totalImagesPullingTime="3.11755279s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:47:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:47:26.025279988 +0000 UTC m=+417.464780907" watchObservedRunningTime="2026-07-23 13:47:26.028633199 +0000 UTC m=+417.468134119"
Jul 23 13:47:27.926853 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:27.926822    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-hh52w"
Jul 23 13:47:27.930875 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:27.930850    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-srv9n"
Jul 23 13:47:38.259362 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:38.259326    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:47:38.343502 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:38.343467    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:47:40.105703 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:40.105671    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:47:40.165674 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:40.165640    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:47:51.274802 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:51.274713    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:47:51.335424 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:51.335391    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:47:56.984698 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:56.984670    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rtpbg"
Jul 23 13:47:56.987670 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:47:56.987649    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-n2f96"
Jul 23 13:48:10.688550 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:10.688510    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:48:10.756533 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:10.756496    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:48:10.817863 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:10.817830    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7klm9"]
Jul 23 13:48:10.818410 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:10.818391    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f07d0baa-6df9-470e-86ce-94ad0daf9d5b" containerName="discovery"
Jul 23 13:48:10.818470 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:10.818415    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="f07d0baa-6df9-470e-86ce-94ad0daf9d5b" containerName="discovery"
Jul 23 13:48:10.818538 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:10.818525    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="f07d0baa-6df9-470e-86ce-94ad0daf9d5b" containerName="discovery"
Jul 23 13:48:10.829389 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:10.829164    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7klm9"
Jul 23 13:48:10.831399 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:10.831365    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7klm9"]
Jul 23 13:48:10.832070 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:10.832050    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 23 13:48:10.832958 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:10.832893    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-sjlc6\""
Jul 23 13:48:10.833239 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:10.833202    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 23 13:48:10.865094 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:10.865057    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:48:10.908765 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:10.908713    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvlmn\" (UniqueName: \"kubernetes.io/projected/93748ecd-6123-4507-aa83-c5154681ef77-kube-api-access-fvlmn\") pod \"kuadrant-operator-catalog-7klm9\" (UID: \"93748ecd-6123-4507-aa83-c5154681ef77\") " pod="kuadrant-system/kuadrant-operator-catalog-7klm9"
Jul 23 13:48:11.009498 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:11.009368    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvlmn\" (UniqueName: \"kubernetes.io/projected/93748ecd-6123-4507-aa83-c5154681ef77-kube-api-access-fvlmn\") pod \"kuadrant-operator-catalog-7klm9\" (UID: \"93748ecd-6123-4507-aa83-c5154681ef77\") " pod="kuadrant-system/kuadrant-operator-catalog-7klm9"
Jul 23 13:48:11.017741 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:11.017712    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvlmn\" (UniqueName: \"kubernetes.io/projected/93748ecd-6123-4507-aa83-c5154681ef77-kube-api-access-fvlmn\") pod \"kuadrant-operator-catalog-7klm9\" (UID: \"93748ecd-6123-4507-aa83-c5154681ef77\") " pod="kuadrant-system/kuadrant-operator-catalog-7klm9"
Jul 23 13:48:11.141878 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:11.141844    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7klm9"
Jul 23 13:48:11.181850 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:11.181811    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7klm9"]
Jul 23 13:48:11.274528 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:11.274504    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7klm9"]
Jul 23 13:48:11.276427 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:48:11.276398    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93748ecd_6123_4507_aa83_c5154681ef77.slice/crio-1a9c1afdda4af0ca7b71856c989b93b08ca3451e0407f2d611f24d1d11ad1b4d WatchSource:0}: Error finding container 1a9c1afdda4af0ca7b71856c989b93b08ca3451e0407f2d611f24d1d11ad1b4d: Status 404 returned error can't find the container with id 1a9c1afdda4af0ca7b71856c989b93b08ca3451e0407f2d611f24d1d11ad1b4d
Jul 23 13:48:11.394121 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:11.394085    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-h622p"]
Jul 23 13:48:11.398855 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:11.398839    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-h622p"
Jul 23 13:48:11.407151 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:11.407128    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-h622p"]
Jul 23 13:48:11.412772 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:11.412749    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btp4l\" (UniqueName: \"kubernetes.io/projected/0023f842-0d3e-4134-8db2-643313868d95-kube-api-access-btp4l\") pod \"kuadrant-operator-catalog-h622p\" (UID: \"0023f842-0d3e-4134-8db2-643313868d95\") " pod="kuadrant-system/kuadrant-operator-catalog-h622p"
Jul 23 13:48:11.513558 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:11.513529    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btp4l\" (UniqueName: \"kubernetes.io/projected/0023f842-0d3e-4134-8db2-643313868d95-kube-api-access-btp4l\") pod \"kuadrant-operator-catalog-h622p\" (UID: \"0023f842-0d3e-4134-8db2-643313868d95\") " pod="kuadrant-system/kuadrant-operator-catalog-h622p"
Jul 23 13:48:11.522507 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:11.522486    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-btp4l\" (UniqueName: \"kubernetes.io/projected/0023f842-0d3e-4134-8db2-643313868d95-kube-api-access-btp4l\") pod \"kuadrant-operator-catalog-h622p\" (UID: \"0023f842-0d3e-4134-8db2-643313868d95\") " pod="kuadrant-system/kuadrant-operator-catalog-h622p"
Jul 23 13:48:11.709423 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:11.709382    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-h622p"
Jul 23 13:48:11.839623 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:11.839594    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-h622p"]
Jul 23 13:48:11.841415 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:48:11.841386    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0023f842_0d3e_4134_8db2_643313868d95.slice/crio-01a89c40393ed451b9816794c8459df1491b87fcf8a647f2997ca1a6a294625b WatchSource:0}: Error finding container 01a89c40393ed451b9816794c8459df1491b87fcf8a647f2997ca1a6a294625b: Status 404 returned error can't find the container with id 01a89c40393ed451b9816794c8459df1491b87fcf8a647f2997ca1a6a294625b
Jul 23 13:48:12.202064 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:12.202031    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7klm9" event={"ID":"93748ecd-6123-4507-aa83-c5154681ef77","Type":"ContainerStarted","Data":"1a9c1afdda4af0ca7b71856c989b93b08ca3451e0407f2d611f24d1d11ad1b4d"}
Jul 23 13:48:12.203340 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:12.203309    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-h622p" event={"ID":"0023f842-0d3e-4134-8db2-643313868d95","Type":"ContainerStarted","Data":"01a89c40393ed451b9816794c8459df1491b87fcf8a647f2997ca1a6a294625b"}
Jul 23 13:48:14.220356 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:14.220318    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-h622p" event={"ID":"0023f842-0d3e-4134-8db2-643313868d95","Type":"ContainerStarted","Data":"48bc08bdefcf40dd106069e292edbbf5b0f3a15742f30fd21f6bda6cb143e8b8"}
Jul 23 13:48:14.221788 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:14.221763    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7klm9" event={"ID":"93748ecd-6123-4507-aa83-c5154681ef77","Type":"ContainerStarted","Data":"82f08da3b8e2e609cc4c95d05c553fce229fa74ac273294f0d7451c036f5a78a"}
Jul 23 13:48:14.221903 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:14.221828    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-7klm9" podUID="93748ecd-6123-4507-aa83-c5154681ef77" containerName="registry-server" containerID="cri-o://82f08da3b8e2e609cc4c95d05c553fce229fa74ac273294f0d7451c036f5a78a" gracePeriod=2
Jul 23 13:48:14.235713 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:14.235664    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-h622p" podStartSLOduration=1.618103458 podStartE2EDuration="3.235647021s" totalImagesPullingTime="1.617543563s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:48:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:48:14.235592991 +0000 UTC m=+465.675093911" watchObservedRunningTime="2026-07-23 13:48:14.235647021 +0000 UTC m=+465.675147942"
Jul 23 13:48:14.251067 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:14.251027    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-7klm9" podStartSLOduration=2.069171239 podStartE2EDuration="4.250998038s" totalImagesPullingTime="2.181826799s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:48:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:48:14.250737378 +0000 UTC m=+465.690238310" watchObservedRunningTime="2026-07-23 13:48:14.250998038 +0000 UTC m=+465.690498957"
Jul 23 13:48:14.468117 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:14.468091    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7klm9"
Jul 23 13:48:14.535328 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:14.535247    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fvlmn\" (UniqueName: \"kubernetes.io/projected/93748ecd-6123-4507-aa83-c5154681ef77-kube-api-access-fvlmn\") pod \"93748ecd-6123-4507-aa83-c5154681ef77\" (UID: \"93748ecd-6123-4507-aa83-c5154681ef77\") "
Jul 23 13:48:14.537407 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:14.537379    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93748ecd-6123-4507-aa83-c5154681ef77-kube-api-access-fvlmn" (OuterVolumeSpecName: "kube-api-access-fvlmn") pod "93748ecd-6123-4507-aa83-c5154681ef77" (UID: "93748ecd-6123-4507-aa83-c5154681ef77"). InnerVolumeSpecName "kube-api-access-fvlmn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:48:14.636592 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:14.636555    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fvlmn\" (UniqueName: \"kubernetes.io/projected/93748ecd-6123-4507-aa83-c5154681ef77-kube-api-access-fvlmn\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 13:48:15.227574 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:15.227544    2573 generic.go:356] "Generic (PLEG): container finished" podID="93748ecd-6123-4507-aa83-c5154681ef77" containerID="82f08da3b8e2e609cc4c95d05c553fce229fa74ac273294f0d7451c036f5a78a" exitCode=0
Jul 23 13:48:15.227990 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:15.227583    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7klm9"
Jul 23 13:48:15.227990 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:15.227618    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7klm9" event={"ID":"93748ecd-6123-4507-aa83-c5154681ef77","Type":"ContainerDied","Data":"82f08da3b8e2e609cc4c95d05c553fce229fa74ac273294f0d7451c036f5a78a"}
Jul 23 13:48:15.227990 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:15.227653    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7klm9" event={"ID":"93748ecd-6123-4507-aa83-c5154681ef77","Type":"ContainerDied","Data":"1a9c1afdda4af0ca7b71856c989b93b08ca3451e0407f2d611f24d1d11ad1b4d"}
Jul 23 13:48:15.227990 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:15.227671    2573 scope.go:117] "RemoveContainer" containerID="82f08da3b8e2e609cc4c95d05c553fce229fa74ac273294f0d7451c036f5a78a"
Jul 23 13:48:15.236667 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:15.236651    2573 scope.go:117] "RemoveContainer" containerID="82f08da3b8e2e609cc4c95d05c553fce229fa74ac273294f0d7451c036f5a78a"
Jul 23 13:48:15.236933 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:48:15.236909    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82f08da3b8e2e609cc4c95d05c553fce229fa74ac273294f0d7451c036f5a78a\": container with ID starting with 82f08da3b8e2e609cc4c95d05c553fce229fa74ac273294f0d7451c036f5a78a not found: ID does not exist" containerID="82f08da3b8e2e609cc4c95d05c553fce229fa74ac273294f0d7451c036f5a78a"
Jul 23 13:48:15.236988 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:15.236936    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82f08da3b8e2e609cc4c95d05c553fce229fa74ac273294f0d7451c036f5a78a"} err="failed to get container status \"82f08da3b8e2e609cc4c95d05c553fce229fa74ac273294f0d7451c036f5a78a\": rpc error: code = NotFound desc = could not find container \"82f08da3b8e2e609cc4c95d05c553fce229fa74ac273294f0d7451c036f5a78a\": container with ID starting with 82f08da3b8e2e609cc4c95d05c553fce229fa74ac273294f0d7451c036f5a78a not found: ID does not exist"
Jul 23 13:48:15.244487 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:15.244467    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7klm9"]
Jul 23 13:48:15.250362 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:15.250342    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7klm9"]
Jul 23 13:48:17.068025 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:17.067977    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93748ecd-6123-4507-aa83-c5154681ef77" path="/var/lib/kubelet/pods/93748ecd-6123-4507-aa83-c5154681ef77/volumes"
Jul 23 13:48:21.709771 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:21.709728    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-h622p"
Jul 23 13:48:21.710217 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:21.709790    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-h622p"
Jul 23 13:48:21.732173 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:21.732146    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-h622p"
Jul 23 13:48:22.284984 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:22.284957    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-h622p"
Jul 23 13:48:26.223321 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:26.223286    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hqv2n"]
Jul 23 13:48:26.223692 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:26.223628    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93748ecd-6123-4507-aa83-c5154681ef77" containerName="registry-server"
Jul 23 13:48:26.223692 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:26.223638    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="93748ecd-6123-4507-aa83-c5154681ef77" containerName="registry-server"
Jul 23 13:48:26.223783 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:26.223697    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="93748ecd-6123-4507-aa83-c5154681ef77" containerName="registry-server"
Jul 23 13:48:26.227090 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:26.227075    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hqv2n"
Jul 23 13:48:26.229517 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:26.229496    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-vtgk7\""
Jul 23 13:48:26.235371 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:26.235351    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hqv2n"]
Jul 23 13:48:26.337184 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:26.337150    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vl5kl\" (UniqueName: \"kubernetes.io/projected/d68f5174-b1d8-4981-9ce6-4fbe03bfd166-kube-api-access-vl5kl\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hqv2n\" (UID: \"d68f5174-b1d8-4981-9ce6-4fbe03bfd166\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hqv2n"
Jul 23 13:48:26.337354 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:26.337213    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d68f5174-b1d8-4981-9ce6-4fbe03bfd166-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hqv2n\" (UID: \"d68f5174-b1d8-4981-9ce6-4fbe03bfd166\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hqv2n"
Jul 23 13:48:26.337354 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:26.337273    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d68f5174-b1d8-4981-9ce6-4fbe03bfd166-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hqv2n\" (UID: \"d68f5174-b1d8-4981-9ce6-4fbe03bfd166\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hqv2n"
Jul 23 13:48:26.438510 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:26.438468    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d68f5174-b1d8-4981-9ce6-4fbe03bfd166-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hqv2n\" (UID: \"d68f5174-b1d8-4981-9ce6-4fbe03bfd166\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hqv2n"
Jul 23 13:48:26.438680 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:26.438523    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d68f5174-b1d8-4981-9ce6-4fbe03bfd166-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hqv2n\" (UID: \"d68f5174-b1d8-4981-9ce6-4fbe03bfd166\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hqv2n"
Jul 23 13:48:26.438680 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:26.438546    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vl5kl\" (UniqueName: \"kubernetes.io/projected/d68f5174-b1d8-4981-9ce6-4fbe03bfd166-kube-api-access-vl5kl\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hqv2n\" (UID: \"d68f5174-b1d8-4981-9ce6-4fbe03bfd166\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hqv2n"
Jul 23 13:48:26.438883 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:26.438862    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d68f5174-b1d8-4981-9ce6-4fbe03bfd166-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hqv2n\" (UID: \"d68f5174-b1d8-4981-9ce6-4fbe03bfd166\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hqv2n"
Jul 23 13:48:26.438949 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:26.438898    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d68f5174-b1d8-4981-9ce6-4fbe03bfd166-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hqv2n\" (UID: \"d68f5174-b1d8-4981-9ce6-4fbe03bfd166\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hqv2n"
Jul 23 13:48:26.448161 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:26.448144    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vl5kl\" (UniqueName: \"kubernetes.io/projected/d68f5174-b1d8-4981-9ce6-4fbe03bfd166-kube-api-access-vl5kl\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hqv2n\" (UID: \"d68f5174-b1d8-4981-9ce6-4fbe03bfd166\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hqv2n"
Jul 23 13:48:26.536792 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:26.536764    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hqv2n"
Jul 23 13:48:26.683207 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:26.683182    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hqv2n"]
Jul 23 13:48:26.685263 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:48:26.685234    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd68f5174_b1d8_4981_9ce6_4fbe03bfd166.slice/crio-d041495d4c02ae2aff43f5ed7cc0e53d2512f850a8bc143ffa8fa04c8fa662c0 WatchSource:0}: Error finding container d041495d4c02ae2aff43f5ed7cc0e53d2512f850a8bc143ffa8fa04c8fa662c0: Status 404 returned error can't find the container with id d041495d4c02ae2aff43f5ed7cc0e53d2512f850a8bc143ffa8fa04c8fa662c0
Jul 23 13:48:27.016044 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:27.015945    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738nr2v"]
Jul 23 13:48:27.019494 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:27.019477    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738nr2v"
Jul 23 13:48:27.027958 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:27.027934    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738nr2v"]
Jul 23 13:48:27.144575 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:27.144538    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ddaa08e-a0cb-41fc-9f1a-f351204211c2-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738nr2v\" (UID: \"8ddaa08e-a0cb-41fc-9f1a-f351204211c2\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738nr2v"
Jul 23 13:48:27.144744 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:27.144583    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ddaa08e-a0cb-41fc-9f1a-f351204211c2-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738nr2v\" (UID: \"8ddaa08e-a0cb-41fc-9f1a-f351204211c2\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738nr2v"
Jul 23 13:48:27.144744 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:27.144625    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngdnb\" (UniqueName: \"kubernetes.io/projected/8ddaa08e-a0cb-41fc-9f1a-f351204211c2-kube-api-access-ngdnb\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738nr2v\" (UID: \"8ddaa08e-a0cb-41fc-9f1a-f351204211c2\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738nr2v"
Jul 23 13:48:27.245330 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:27.245297    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ddaa08e-a0cb-41fc-9f1a-f351204211c2-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738nr2v\" (UID: \"8ddaa08e-a0cb-41fc-9f1a-f351204211c2\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738nr2v"
Jul 23 13:48:27.245770 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:27.245343    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngdnb\" (UniqueName: \"kubernetes.io/projected/8ddaa08e-a0cb-41fc-9f1a-f351204211c2-kube-api-access-ngdnb\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738nr2v\" (UID: \"8ddaa08e-a0cb-41fc-9f1a-f351204211c2\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738nr2v"
Jul 23 13:48:27.245770 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:27.245394    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ddaa08e-a0cb-41fc-9f1a-f351204211c2-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738nr2v\" (UID: \"8ddaa08e-a0cb-41fc-9f1a-f351204211c2\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738nr2v"
Jul 23 13:48:27.245770 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:27.245675    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ddaa08e-a0cb-41fc-9f1a-f351204211c2-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738nr2v\" (UID: \"8ddaa08e-a0cb-41fc-9f1a-f351204211c2\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738nr2v"
Jul 23 13:48:27.245770 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:27.245697    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ddaa08e-a0cb-41fc-9f1a-f351204211c2-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738nr2v\" (UID: \"8ddaa08e-a0cb-41fc-9f1a-f351204211c2\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738nr2v"
Jul 23 13:48:27.255355 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:27.255330    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngdnb\" (UniqueName: \"kubernetes.io/projected/8ddaa08e-a0cb-41fc-9f1a-f351204211c2-kube-api-access-ngdnb\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738nr2v\" (UID: \"8ddaa08e-a0cb-41fc-9f1a-f351204211c2\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738nr2v"
Jul 23 13:48:27.287760 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:27.287732    2573 generic.go:356] "Generic (PLEG): container finished" podID="d68f5174-b1d8-4981-9ce6-4fbe03bfd166" containerID="8cd64246a7e061e670c4bb340832a48eba867bf89101a11c138436cc711e449e" exitCode=0
Jul 23 13:48:27.287905 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:27.287822    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hqv2n" event={"ID":"d68f5174-b1d8-4981-9ce6-4fbe03bfd166","Type":"ContainerDied","Data":"8cd64246a7e061e670c4bb340832a48eba867bf89101a11c138436cc711e449e"}
Jul 23 13:48:27.287905 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:27.287875    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hqv2n" event={"ID":"d68f5174-b1d8-4981-9ce6-4fbe03bfd166","Type":"ContainerStarted","Data":"d041495d4c02ae2aff43f5ed7cc0e53d2512f850a8bc143ffa8fa04c8fa662c0"}
Jul 23 13:48:27.329127 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:27.329099    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738nr2v"
Jul 23 13:48:27.464845 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:27.464823    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738nr2v"]
Jul 23 13:48:27.467125 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:48:27.467096    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ddaa08e_a0cb_41fc_9f1a_f351204211c2.slice/crio-5df6340094dae6c577d4d03be99a2d1aa54c0817c17bcd94ca68468c86239092 WatchSource:0}: Error finding container 5df6340094dae6c577d4d03be99a2d1aa54c0817c17bcd94ca68468c86239092: Status 404 returned error can't find the container with id 5df6340094dae6c577d4d03be99a2d1aa54c0817c17bcd94ca68468c86239092
Jul 23 13:48:27.616202 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:27.616164    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599cxcz"]
Jul 23 13:48:27.619742 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:27.619722    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599cxcz"
Jul 23 13:48:27.628631 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:27.628609    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599cxcz"]
Jul 23 13:48:27.749518 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:27.749482    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1afec109-7eb5-4c05-a752-39482aba94be-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599cxcz\" (UID: \"1afec109-7eb5-4c05-a752-39482aba94be\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599cxcz"
Jul 23 13:48:27.749697 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:27.749529    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfjn2\" (UniqueName: \"kubernetes.io/projected/1afec109-7eb5-4c05-a752-39482aba94be-kube-api-access-lfjn2\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599cxcz\" (UID: \"1afec109-7eb5-4c05-a752-39482aba94be\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599cxcz"
Jul 23 13:48:27.749697 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:27.749600    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1afec109-7eb5-4c05-a752-39482aba94be-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599cxcz\" (UID: \"1afec109-7eb5-4c05-a752-39482aba94be\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599cxcz"
Jul 23 13:48:27.850724 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:27.850650    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1afec109-7eb5-4c05-a752-39482aba94be-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599cxcz\" (UID: \"1afec109-7eb5-4c05-a752-39482aba94be\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599cxcz"
Jul 23 13:48:27.850863 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:27.850725    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1afec109-7eb5-4c05-a752-39482aba94be-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599cxcz\" (UID: \"1afec109-7eb5-4c05-a752-39482aba94be\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599cxcz"
Jul 23 13:48:27.850863 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:27.850759    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfjn2\" (UniqueName: \"kubernetes.io/projected/1afec109-7eb5-4c05-a752-39482aba94be-kube-api-access-lfjn2\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599cxcz\" (UID: \"1afec109-7eb5-4c05-a752-39482aba94be\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599cxcz"
Jul 23 13:48:27.851034 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:27.850991    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1afec109-7eb5-4c05-a752-39482aba94be-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599cxcz\" (UID: \"1afec109-7eb5-4c05-a752-39482aba94be\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599cxcz"
Jul 23 13:48:27.851085 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:27.851042    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1afec109-7eb5-4c05-a752-39482aba94be-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599cxcz\" (UID: \"1afec109-7eb5-4c05-a752-39482aba94be\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599cxcz"
Jul 23 13:48:27.859296 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:27.859265    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfjn2\" (UniqueName: \"kubernetes.io/projected/1afec109-7eb5-4c05-a752-39482aba94be-kube-api-access-lfjn2\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599cxcz\" (UID: \"1afec109-7eb5-4c05-a752-39482aba94be\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599cxcz"
Jul 23 13:48:27.928938 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:27.928908    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599cxcz"
Jul 23 13:48:28.018761 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:28.018730    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cphjv"]
Jul 23 13:48:28.023032 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:28.022992    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cphjv"
Jul 23 13:48:28.032940 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:28.032430    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cphjv"]
Jul 23 13:48:28.130859 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:28.130834    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599cxcz"]
Jul 23 13:48:28.132512 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:48:28.132486    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1afec109_7eb5_4c05_a752_39482aba94be.slice/crio-5b44af5b2f8b5d5f37eedc33dc985bd024a36d8855e42d7c660029cea8e654bf WatchSource:0}: Error finding container 5b44af5b2f8b5d5f37eedc33dc985bd024a36d8855e42d7c660029cea8e654bf: Status 404 returned error can't find the container with id 5b44af5b2f8b5d5f37eedc33dc985bd024a36d8855e42d7c660029cea8e654bf
Jul 23 13:48:28.152624 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:28.152590    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ht25s\" (UniqueName: \"kubernetes.io/projected/69e3cb8d-a9b0-4113-afa9-b66f5c7015ff-kube-api-access-ht25s\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cphjv\" (UID: \"69e3cb8d-a9b0-4113-afa9-b66f5c7015ff\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cphjv"
Jul 23 13:48:28.152710 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:28.152638    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/69e3cb8d-a9b0-4113-afa9-b66f5c7015ff-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cphjv\" (UID: \"69e3cb8d-a9b0-4113-afa9-b66f5c7015ff\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cphjv"
Jul 23 13:48:28.152710 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:28.152677    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/69e3cb8d-a9b0-4113-afa9-b66f5c7015ff-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cphjv\" (UID: \"69e3cb8d-a9b0-4113-afa9-b66f5c7015ff\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cphjv"
Jul 23 13:48:28.253234 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:28.253202    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ht25s\" (UniqueName: \"kubernetes.io/projected/69e3cb8d-a9b0-4113-afa9-b66f5c7015ff-kube-api-access-ht25s\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cphjv\" (UID: \"69e3cb8d-a9b0-4113-afa9-b66f5c7015ff\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cphjv"
Jul 23 13:48:28.253573 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:28.253240    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/69e3cb8d-a9b0-4113-afa9-b66f5c7015ff-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cphjv\" (UID: \"69e3cb8d-a9b0-4113-afa9-b66f5c7015ff\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cphjv"
Jul 23 13:48:28.253573 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:28.253448    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/69e3cb8d-a9b0-4113-afa9-b66f5c7015ff-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cphjv\" (UID: \"69e3cb8d-a9b0-4113-afa9-b66f5c7015ff\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cphjv"
Jul 23 13:48:28.253643 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:28.253594    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/69e3cb8d-a9b0-4113-afa9-b66f5c7015ff-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cphjv\" (UID: \"69e3cb8d-a9b0-4113-afa9-b66f5c7015ff\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cphjv"
Jul 23 13:48:28.253686 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:28.253667    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/69e3cb8d-a9b0-4113-afa9-b66f5c7015ff-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cphjv\" (UID: \"69e3cb8d-a9b0-4113-afa9-b66f5c7015ff\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cphjv"
Jul 23 13:48:28.261684 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:28.261662    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ht25s\" (UniqueName: \"kubernetes.io/projected/69e3cb8d-a9b0-4113-afa9-b66f5c7015ff-kube-api-access-ht25s\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cphjv\" (UID: \"69e3cb8d-a9b0-4113-afa9-b66f5c7015ff\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cphjv"
Jul 23 13:48:28.293622 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:28.293589    2573 generic.go:356] "Generic (PLEG): container finished" podID="1afec109-7eb5-4c05-a752-39482aba94be" containerID="ce87a6f87d079f5a46b08b09d1e960627182730e982a1a48d907ae527347a3e9" exitCode=0
Jul 23 13:48:28.293761 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:28.293691    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599cxcz" event={"ID":"1afec109-7eb5-4c05-a752-39482aba94be","Type":"ContainerDied","Data":"ce87a6f87d079f5a46b08b09d1e960627182730e982a1a48d907ae527347a3e9"}
Jul 23 13:48:28.293761 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:28.293753    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599cxcz" event={"ID":"1afec109-7eb5-4c05-a752-39482aba94be","Type":"ContainerStarted","Data":"5b44af5b2f8b5d5f37eedc33dc985bd024a36d8855e42d7c660029cea8e654bf"}
Jul 23 13:48:28.295564 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:28.295540    2573 generic.go:356] "Generic (PLEG): container finished" podID="d68f5174-b1d8-4981-9ce6-4fbe03bfd166" containerID="a112af3a2f641f9721f71b534d76876607870756a02780f6bb0e82ad4a78e769" exitCode=0
Jul 23 13:48:28.295678 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:28.295622    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hqv2n" event={"ID":"d68f5174-b1d8-4981-9ce6-4fbe03bfd166","Type":"ContainerDied","Data":"a112af3a2f641f9721f71b534d76876607870756a02780f6bb0e82ad4a78e769"}
Jul 23 13:48:28.297147 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:28.297129    2573 generic.go:356] "Generic (PLEG): container finished" podID="8ddaa08e-a0cb-41fc-9f1a-f351204211c2" containerID="88f03db387a7278770951f8a286fc0b4a8be658cbbf12598961daf719815015d" exitCode=0
Jul 23 13:48:28.297206 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:28.297174    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738nr2v" event={"ID":"8ddaa08e-a0cb-41fc-9f1a-f351204211c2","Type":"ContainerDied","Data":"88f03db387a7278770951f8a286fc0b4a8be658cbbf12598961daf719815015d"}
Jul 23 13:48:28.297243 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:28.297207    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738nr2v" event={"ID":"8ddaa08e-a0cb-41fc-9f1a-f351204211c2","Type":"ContainerStarted","Data":"5df6340094dae6c577d4d03be99a2d1aa54c0817c17bcd94ca68468c86239092"}
Jul 23 13:48:28.343727 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:28.343689    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cphjv"
Jul 23 13:48:28.485241 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:28.485216    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cphjv"]
Jul 23 13:48:28.490183 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:48:28.490152    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69e3cb8d_a9b0_4113_afa9_b66f5c7015ff.slice/crio-3abc550e46e2b7d2fda482d7d7d70c6c9f829676bfb2f63028e86ab28a672123 WatchSource:0}: Error finding container 3abc550e46e2b7d2fda482d7d7d70c6c9f829676bfb2f63028e86ab28a672123: Status 404 returned error can't find the container with id 3abc550e46e2b7d2fda482d7d7d70c6c9f829676bfb2f63028e86ab28a672123
Jul 23 13:48:29.303812 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:29.303782    2573 generic.go:356] "Generic (PLEG): container finished" podID="1afec109-7eb5-4c05-a752-39482aba94be" containerID="012fa942c0d598db62bee784653c0d76611c222493a25fdf23878ef4bc1f2ce6" exitCode=0
Jul 23 13:48:29.304216 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:29.303871    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599cxcz" event={"ID":"1afec109-7eb5-4c05-a752-39482aba94be","Type":"ContainerDied","Data":"012fa942c0d598db62bee784653c0d76611c222493a25fdf23878ef4bc1f2ce6"}
Jul 23 13:48:29.306111 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:29.306089    2573 generic.go:356] "Generic (PLEG): container finished" podID="d68f5174-b1d8-4981-9ce6-4fbe03bfd166" containerID="1f1e4c006e3cbde1fd24c6e1c60b48e406b44e5f33c7c40f16d76090bd090be2" exitCode=0
Jul 23 13:48:29.306209 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:29.306130    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hqv2n" event={"ID":"d68f5174-b1d8-4981-9ce6-4fbe03bfd166","Type":"ContainerDied","Data":"1f1e4c006e3cbde1fd24c6e1c60b48e406b44e5f33c7c40f16d76090bd090be2"}
Jul 23 13:48:29.307987 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:29.307966    2573 generic.go:356] "Generic (PLEG): container finished" podID="8ddaa08e-a0cb-41fc-9f1a-f351204211c2" containerID="e26d8e8624ddb978286b21161e3801f9b6eaa26bd7a7ec2e947d4d16d4127975" exitCode=0
Jul 23 13:48:29.308109 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:29.308048    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738nr2v" event={"ID":"8ddaa08e-a0cb-41fc-9f1a-f351204211c2","Type":"ContainerDied","Data":"e26d8e8624ddb978286b21161e3801f9b6eaa26bd7a7ec2e947d4d16d4127975"}
Jul 23 13:48:29.309643 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:29.309625    2573 generic.go:356] "Generic (PLEG): container finished" podID="69e3cb8d-a9b0-4113-afa9-b66f5c7015ff" containerID="65cd64c5ac33cada28d718939244ecde70f0592ad406092bcc465800aace619e" exitCode=0
Jul 23 13:48:29.309722 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:29.309700    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cphjv" event={"ID":"69e3cb8d-a9b0-4113-afa9-b66f5c7015ff","Type":"ContainerDied","Data":"65cd64c5ac33cada28d718939244ecde70f0592ad406092bcc465800aace619e"}
Jul 23 13:48:29.309777 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:29.309746    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cphjv" event={"ID":"69e3cb8d-a9b0-4113-afa9-b66f5c7015ff","Type":"ContainerStarted","Data":"3abc550e46e2b7d2fda482d7d7d70c6c9f829676bfb2f63028e86ab28a672123"}
Jul 23 13:48:30.317287 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:30.317254    2573 generic.go:356] "Generic (PLEG): container finished" podID="1afec109-7eb5-4c05-a752-39482aba94be" containerID="35a3ea54906bc30c313fa37d834c5dd58a53d222a690bfd12488fcee306bde76" exitCode=0
Jul 23 13:48:30.317740 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:30.317333    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599cxcz" event={"ID":"1afec109-7eb5-4c05-a752-39482aba94be","Type":"ContainerDied","Data":"35a3ea54906bc30c313fa37d834c5dd58a53d222a690bfd12488fcee306bde76"}
Jul 23 13:48:30.319510 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:30.319481    2573 generic.go:356] "Generic (PLEG): container finished" podID="8ddaa08e-a0cb-41fc-9f1a-f351204211c2" containerID="8c95381977fa16f74d9fa3c5a87cf37a13f35f72edc03fea9859a30b581e4e25" exitCode=0
Jul 23 13:48:30.319617 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:30.319559    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738nr2v" event={"ID":"8ddaa08e-a0cb-41fc-9f1a-f351204211c2","Type":"ContainerDied","Data":"8c95381977fa16f74d9fa3c5a87cf37a13f35f72edc03fea9859a30b581e4e25"}
Jul 23 13:48:30.321477 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:30.321448    2573 generic.go:356] "Generic (PLEG): container finished" podID="69e3cb8d-a9b0-4113-afa9-b66f5c7015ff" containerID="347350a0829b3667d8349fc696e1700cc9fd6b68e500324a21a9d2067650275c" exitCode=0
Jul 23 13:48:30.321565 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:30.321531    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cphjv" event={"ID":"69e3cb8d-a9b0-4113-afa9-b66f5c7015ff","Type":"ContainerDied","Data":"347350a0829b3667d8349fc696e1700cc9fd6b68e500324a21a9d2067650275c"}
Jul 23 13:48:30.464905 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:30.464877    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hqv2n"
Jul 23 13:48:30.573131 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:30.573061    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vl5kl\" (UniqueName: \"kubernetes.io/projected/d68f5174-b1d8-4981-9ce6-4fbe03bfd166-kube-api-access-vl5kl\") pod \"d68f5174-b1d8-4981-9ce6-4fbe03bfd166\" (UID: \"d68f5174-b1d8-4981-9ce6-4fbe03bfd166\") "
Jul 23 13:48:30.573131 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:30.573099    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d68f5174-b1d8-4981-9ce6-4fbe03bfd166-bundle\") pod \"d68f5174-b1d8-4981-9ce6-4fbe03bfd166\" (UID: \"d68f5174-b1d8-4981-9ce6-4fbe03bfd166\") "
Jul 23 13:48:30.573272 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:30.573156    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d68f5174-b1d8-4981-9ce6-4fbe03bfd166-util\") pod \"d68f5174-b1d8-4981-9ce6-4fbe03bfd166\" (UID: \"d68f5174-b1d8-4981-9ce6-4fbe03bfd166\") "
Jul 23 13:48:30.573690 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:30.573662    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d68f5174-b1d8-4981-9ce6-4fbe03bfd166-bundle" (OuterVolumeSpecName: "bundle") pod "d68f5174-b1d8-4981-9ce6-4fbe03bfd166" (UID: "d68f5174-b1d8-4981-9ce6-4fbe03bfd166"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 13:48:30.575277 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:30.575255    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d68f5174-b1d8-4981-9ce6-4fbe03bfd166-kube-api-access-vl5kl" (OuterVolumeSpecName: "kube-api-access-vl5kl") pod "d68f5174-b1d8-4981-9ce6-4fbe03bfd166" (UID: "d68f5174-b1d8-4981-9ce6-4fbe03bfd166"). InnerVolumeSpecName "kube-api-access-vl5kl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:48:30.578813 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:30.578794    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d68f5174-b1d8-4981-9ce6-4fbe03bfd166-util" (OuterVolumeSpecName: "util") pod "d68f5174-b1d8-4981-9ce6-4fbe03bfd166" (UID: "d68f5174-b1d8-4981-9ce6-4fbe03bfd166"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 13:48:30.673768 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:30.673734    2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d68f5174-b1d8-4981-9ce6-4fbe03bfd166-util\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 13:48:30.673768 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:30.673763    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vl5kl\" (UniqueName: \"kubernetes.io/projected/d68f5174-b1d8-4981-9ce6-4fbe03bfd166-kube-api-access-vl5kl\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 13:48:30.673768 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:30.673775    2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d68f5174-b1d8-4981-9ce6-4fbe03bfd166-bundle\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 13:48:31.329094 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:31.328995    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hqv2n"
Jul 23 13:48:31.329094 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:31.329051    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hqv2n" event={"ID":"d68f5174-b1d8-4981-9ce6-4fbe03bfd166","Type":"ContainerDied","Data":"d041495d4c02ae2aff43f5ed7cc0e53d2512f850a8bc143ffa8fa04c8fa662c0"}
Jul 23 13:48:31.329547 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:31.329101    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d041495d4c02ae2aff43f5ed7cc0e53d2512f850a8bc143ffa8fa04c8fa662c0"
Jul 23 13:48:31.331250 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:31.331221    2573 generic.go:356] "Generic (PLEG): container finished" podID="69e3cb8d-a9b0-4113-afa9-b66f5c7015ff" containerID="8e3d432870627979dc1d85e6f695698cd8233409041b98ace4d8a28a7cea1996" exitCode=0
Jul 23 13:48:31.331397 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:31.331365    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cphjv" event={"ID":"69e3cb8d-a9b0-4113-afa9-b66f5c7015ff","Type":"ContainerDied","Data":"8e3d432870627979dc1d85e6f695698cd8233409041b98ace4d8a28a7cea1996"}
Jul 23 13:48:31.482627 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:31.482607    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738nr2v"
Jul 23 13:48:31.484670 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:31.484653    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599cxcz"
Jul 23 13:48:31.581953 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:31.581877    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ddaa08e-a0cb-41fc-9f1a-f351204211c2-bundle\") pod \"8ddaa08e-a0cb-41fc-9f1a-f351204211c2\" (UID: \"8ddaa08e-a0cb-41fc-9f1a-f351204211c2\") "
Jul 23 13:48:31.581953 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:31.581911    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1afec109-7eb5-4c05-a752-39482aba94be-util\") pod \"1afec109-7eb5-4c05-a752-39482aba94be\" (UID: \"1afec109-7eb5-4c05-a752-39482aba94be\") "
Jul 23 13:48:31.581953 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:31.581941    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ngdnb\" (UniqueName: \"kubernetes.io/projected/8ddaa08e-a0cb-41fc-9f1a-f351204211c2-kube-api-access-ngdnb\") pod \"8ddaa08e-a0cb-41fc-9f1a-f351204211c2\" (UID: \"8ddaa08e-a0cb-41fc-9f1a-f351204211c2\") "
Jul 23 13:48:31.582263 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:31.581980    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1afec109-7eb5-4c05-a752-39482aba94be-bundle\") pod \"1afec109-7eb5-4c05-a752-39482aba94be\" (UID: \"1afec109-7eb5-4c05-a752-39482aba94be\") "
Jul 23 13:48:31.582263 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:31.582038    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ddaa08e-a0cb-41fc-9f1a-f351204211c2-util\") pod \"8ddaa08e-a0cb-41fc-9f1a-f351204211c2\" (UID: \"8ddaa08e-a0cb-41fc-9f1a-f351204211c2\") "
Jul 23 13:48:31.582263 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:31.582140    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lfjn2\" (UniqueName: \"kubernetes.io/projected/1afec109-7eb5-4c05-a752-39482aba94be-kube-api-access-lfjn2\") pod \"1afec109-7eb5-4c05-a752-39482aba94be\" (UID: \"1afec109-7eb5-4c05-a752-39482aba94be\") "
Jul 23 13:48:31.582537 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:31.582506    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1afec109-7eb5-4c05-a752-39482aba94be-bundle" (OuterVolumeSpecName: "bundle") pod "1afec109-7eb5-4c05-a752-39482aba94be" (UID: "1afec109-7eb5-4c05-a752-39482aba94be"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 13:48:31.582697 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:31.582669    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ddaa08e-a0cb-41fc-9f1a-f351204211c2-bundle" (OuterVolumeSpecName: "bundle") pod "8ddaa08e-a0cb-41fc-9f1a-f351204211c2" (UID: "8ddaa08e-a0cb-41fc-9f1a-f351204211c2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 13:48:31.584133 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:31.584101    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ddaa08e-a0cb-41fc-9f1a-f351204211c2-kube-api-access-ngdnb" (OuterVolumeSpecName: "kube-api-access-ngdnb") pod "8ddaa08e-a0cb-41fc-9f1a-f351204211c2" (UID: "8ddaa08e-a0cb-41fc-9f1a-f351204211c2"). InnerVolumeSpecName "kube-api-access-ngdnb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:48:31.584236 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:31.584185    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1afec109-7eb5-4c05-a752-39482aba94be-kube-api-access-lfjn2" (OuterVolumeSpecName: "kube-api-access-lfjn2") pod "1afec109-7eb5-4c05-a752-39482aba94be" (UID: "1afec109-7eb5-4c05-a752-39482aba94be"). InnerVolumeSpecName "kube-api-access-lfjn2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:48:31.587807 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:31.587787    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ddaa08e-a0cb-41fc-9f1a-f351204211c2-util" (OuterVolumeSpecName: "util") pod "8ddaa08e-a0cb-41fc-9f1a-f351204211c2" (UID: "8ddaa08e-a0cb-41fc-9f1a-f351204211c2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 13:48:31.589865 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:31.589844    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1afec109-7eb5-4c05-a752-39482aba94be-util" (OuterVolumeSpecName: "util") pod "1afec109-7eb5-4c05-a752-39482aba94be" (UID: "1afec109-7eb5-4c05-a752-39482aba94be"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 13:48:31.683218 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:31.683188    2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ddaa08e-a0cb-41fc-9f1a-f351204211c2-bundle\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 13:48:31.683218 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:31.683215    2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1afec109-7eb5-4c05-a752-39482aba94be-util\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 13:48:31.683397 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:31.683224    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ngdnb\" (UniqueName: \"kubernetes.io/projected/8ddaa08e-a0cb-41fc-9f1a-f351204211c2-kube-api-access-ngdnb\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 13:48:31.683397 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:31.683236    2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1afec109-7eb5-4c05-a752-39482aba94be-bundle\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 13:48:31.683397 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:31.683244    2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ddaa08e-a0cb-41fc-9f1a-f351204211c2-util\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 13:48:31.683397 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:31.683251    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lfjn2\" (UniqueName: \"kubernetes.io/projected/1afec109-7eb5-4c05-a752-39482aba94be-kube-api-access-lfjn2\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 13:48:32.338449 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:32.338421    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599cxcz"
Jul 23 13:48:32.338867 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:32.338450    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599cxcz" event={"ID":"1afec109-7eb5-4c05-a752-39482aba94be","Type":"ContainerDied","Data":"5b44af5b2f8b5d5f37eedc33dc985bd024a36d8855e42d7c660029cea8e654bf"}
Jul 23 13:48:32.338867 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:32.338499    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5b44af5b2f8b5d5f37eedc33dc985bd024a36d8855e42d7c660029cea8e654bf"
Jul 23 13:48:32.340464 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:32.340437    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738nr2v"
Jul 23 13:48:32.340464 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:32.340441    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738nr2v" event={"ID":"8ddaa08e-a0cb-41fc-9f1a-f351204211c2","Type":"ContainerDied","Data":"5df6340094dae6c577d4d03be99a2d1aa54c0817c17bcd94ca68468c86239092"}
Jul 23 13:48:32.340590 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:32.340483    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5df6340094dae6c577d4d03be99a2d1aa54c0817c17bcd94ca68468c86239092"
Jul 23 13:48:32.472341 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:32.472319    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cphjv"
Jul 23 13:48:32.591983 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:32.591905    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/69e3cb8d-a9b0-4113-afa9-b66f5c7015ff-bundle\") pod \"69e3cb8d-a9b0-4113-afa9-b66f5c7015ff\" (UID: \"69e3cb8d-a9b0-4113-afa9-b66f5c7015ff\") "
Jul 23 13:48:32.591983 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:32.591936    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/69e3cb8d-a9b0-4113-afa9-b66f5c7015ff-util\") pod \"69e3cb8d-a9b0-4113-afa9-b66f5c7015ff\" (UID: \"69e3cb8d-a9b0-4113-afa9-b66f5c7015ff\") "
Jul 23 13:48:32.592172 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:32.592037    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ht25s\" (UniqueName: \"kubernetes.io/projected/69e3cb8d-a9b0-4113-afa9-b66f5c7015ff-kube-api-access-ht25s\") pod \"69e3cb8d-a9b0-4113-afa9-b66f5c7015ff\" (UID: \"69e3cb8d-a9b0-4113-afa9-b66f5c7015ff\") "
Jul 23 13:48:32.592447 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:32.592411    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69e3cb8d-a9b0-4113-afa9-b66f5c7015ff-bundle" (OuterVolumeSpecName: "bundle") pod "69e3cb8d-a9b0-4113-afa9-b66f5c7015ff" (UID: "69e3cb8d-a9b0-4113-afa9-b66f5c7015ff"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 13:48:32.594091 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:32.594065    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69e3cb8d-a9b0-4113-afa9-b66f5c7015ff-kube-api-access-ht25s" (OuterVolumeSpecName: "kube-api-access-ht25s") pod "69e3cb8d-a9b0-4113-afa9-b66f5c7015ff" (UID: "69e3cb8d-a9b0-4113-afa9-b66f5c7015ff"). InnerVolumeSpecName "kube-api-access-ht25s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:48:32.597414 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:32.597391    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69e3cb8d-a9b0-4113-afa9-b66f5c7015ff-util" (OuterVolumeSpecName: "util") pod "69e3cb8d-a9b0-4113-afa9-b66f5c7015ff" (UID: "69e3cb8d-a9b0-4113-afa9-b66f5c7015ff"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 13:48:32.692959 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:32.692930    2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/69e3cb8d-a9b0-4113-afa9-b66f5c7015ff-bundle\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 13:48:32.692959 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:32.692953    2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/69e3cb8d-a9b0-4113-afa9-b66f5c7015ff-util\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 13:48:32.692959 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:32.692963    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ht25s\" (UniqueName: \"kubernetes.io/projected/69e3cb8d-a9b0-4113-afa9-b66f5c7015ff-kube-api-access-ht25s\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 13:48:33.347876 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:33.347794    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cphjv"
Jul 23 13:48:33.347876 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:33.347804    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cphjv" event={"ID":"69e3cb8d-a9b0-4113-afa9-b66f5c7015ff","Type":"ContainerDied","Data":"3abc550e46e2b7d2fda482d7d7d70c6c9f829676bfb2f63028e86ab28a672123"}
Jul 23 13:48:33.347876 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:33.347849    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3abc550e46e2b7d2fda482d7d7d70c6c9f829676bfb2f63028e86ab28a672123"
Jul 23 13:48:38.556947 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:38.556894    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:48:38.662557 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:38.662523    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:48:38.763821 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:38.763757    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:48:39.249651 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:39.249603    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:48:39.353532 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:39.353481    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:48:40.267711 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:40.267675    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:48:42.786910 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:42.786871    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:48:42.933753 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:42.933715    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dpg8x"]
Jul 23 13:48:42.934123 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:42.934109    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d68f5174-b1d8-4981-9ce6-4fbe03bfd166" containerName="extract"
Jul 23 13:48:42.934171 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:42.934124    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d68f5174-b1d8-4981-9ce6-4fbe03bfd166" containerName="extract"
Jul 23 13:48:42.934171 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:42.934133    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69e3cb8d-a9b0-4113-afa9-b66f5c7015ff" containerName="util"
Jul 23 13:48:42.934171 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:42.934139    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="69e3cb8d-a9b0-4113-afa9-b66f5c7015ff" containerName="util"
Jul 23 13:48:42.934171 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:42.934149    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1afec109-7eb5-4c05-a752-39482aba94be" containerName="pull"
Jul 23 13:48:42.934171 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:42.934155    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="1afec109-7eb5-4c05-a752-39482aba94be" containerName="pull"
Jul 23 13:48:42.934171 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:42.934161    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1afec109-7eb5-4c05-a752-39482aba94be" containerName="extract"
Jul 23 13:48:42.934171 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:42.934166    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="1afec109-7eb5-4c05-a752-39482aba94be" containerName="extract"
Jul 23 13:48:42.934171 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:42.934172    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69e3cb8d-a9b0-4113-afa9-b66f5c7015ff" containerName="pull"
Jul 23 13:48:42.934665 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:42.934177    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="69e3cb8d-a9b0-4113-afa9-b66f5c7015ff" containerName="pull"
Jul 23 13:48:42.934665 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:42.934183    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69e3cb8d-a9b0-4113-afa9-b66f5c7015ff" containerName="extract"
Jul 23 13:48:42.934665 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:42.934188    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="69e3cb8d-a9b0-4113-afa9-b66f5c7015ff" containerName="extract"
Jul 23 13:48:42.934665 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:42.934197    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d68f5174-b1d8-4981-9ce6-4fbe03bfd166" containerName="util"
Jul 23 13:48:42.934665 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:42.934202    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d68f5174-b1d8-4981-9ce6-4fbe03bfd166" containerName="util"
Jul 23 13:48:42.934665 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:42.934209    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ddaa08e-a0cb-41fc-9f1a-f351204211c2" containerName="util"
Jul 23 13:48:42.934665 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:42.934215    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ddaa08e-a0cb-41fc-9f1a-f351204211c2" containerName="util"
Jul 23 13:48:42.934665 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:42.934219    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ddaa08e-a0cb-41fc-9f1a-f351204211c2" containerName="pull"
Jul 23 13:48:42.934665 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:42.934224    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ddaa08e-a0cb-41fc-9f1a-f351204211c2" containerName="pull"
Jul 23 13:48:42.934665 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:42.934230    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1afec109-7eb5-4c05-a752-39482aba94be" containerName="util"
Jul 23 13:48:42.934665 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:42.934234    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="1afec109-7eb5-4c05-a752-39482aba94be" containerName="util"
Jul 23 13:48:42.934665 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:42.934241    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d68f5174-b1d8-4981-9ce6-4fbe03bfd166" containerName="pull"
Jul 23 13:48:42.934665 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:42.934248    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d68f5174-b1d8-4981-9ce6-4fbe03bfd166" containerName="pull"
Jul 23 13:48:42.934665 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:42.934255    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ddaa08e-a0cb-41fc-9f1a-f351204211c2" containerName="extract"
Jul 23 13:48:42.934665 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:42.934260    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ddaa08e-a0cb-41fc-9f1a-f351204211c2" containerName="extract"
Jul 23 13:48:42.934665 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:42.934315    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="d68f5174-b1d8-4981-9ce6-4fbe03bfd166" containerName="extract"
Jul 23 13:48:42.934665 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:42.934322    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ddaa08e-a0cb-41fc-9f1a-f351204211c2" containerName="extract"
Jul 23 13:48:42.934665 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:42.934329    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="1afec109-7eb5-4c05-a752-39482aba94be" containerName="extract"
Jul 23 13:48:42.934665 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:42.934335    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="69e3cb8d-a9b0-4113-afa9-b66f5c7015ff" containerName="extract"
Jul 23 13:48:42.937796 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:42.937779    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dpg8x"
Jul 23 13:48:42.940531 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:42.940510    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-6gfv6\""
Jul 23 13:48:42.948124 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:42.948102    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dpg8x"]
Jul 23 13:48:43.079957 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:43.079873    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5qr2\" (UniqueName: \"kubernetes.io/projected/6b7eea36-e806-41d9-966d-ca5135322230-kube-api-access-n5qr2\") pod \"limitador-operator-controller-manager-859d7b78bd-dpg8x\" (UID: \"6b7eea36-e806-41d9-966d-ca5135322230\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dpg8x"
Jul 23 13:48:43.180458 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:43.180408    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5qr2\" (UniqueName: \"kubernetes.io/projected/6b7eea36-e806-41d9-966d-ca5135322230-kube-api-access-n5qr2\") pod \"limitador-operator-controller-manager-859d7b78bd-dpg8x\" (UID: \"6b7eea36-e806-41d9-966d-ca5135322230\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dpg8x"
Jul 23 13:48:43.190990 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:43.190957    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5qr2\" (UniqueName: \"kubernetes.io/projected/6b7eea36-e806-41d9-966d-ca5135322230-kube-api-access-n5qr2\") pod \"limitador-operator-controller-manager-859d7b78bd-dpg8x\" (UID: \"6b7eea36-e806-41d9-966d-ca5135322230\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dpg8x"
Jul 23 13:48:43.248750 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:43.248706    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dpg8x"
Jul 23 13:48:43.396887 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:43.396857    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dpg8x"]
Jul 23 13:48:43.400418 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:48:43.400393    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b7eea36_e806_41d9_966d_ca5135322230.slice/crio-13492fc7719d6d35cdc580b3f7cef0cbef2e2b7ce2458b82de1cff98e7fbe4a4 WatchSource:0}: Error finding container 13492fc7719d6d35cdc580b3f7cef0cbef2e2b7ce2458b82de1cff98e7fbe4a4: Status 404 returned error can't find the container with id 13492fc7719d6d35cdc580b3f7cef0cbef2e2b7ce2458b82de1cff98e7fbe4a4
Jul 23 13:48:43.899097 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:43.899057    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:48:44.413104 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:44.413065    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dpg8x" event={"ID":"6b7eea36-e806-41d9-966d-ca5135322230","Type":"ContainerStarted","Data":"13492fc7719d6d35cdc580b3f7cef0cbef2e2b7ce2458b82de1cff98e7fbe4a4"}
Jul 23 13:48:45.420157 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:45.420117    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dpg8x" event={"ID":"6b7eea36-e806-41d9-966d-ca5135322230","Type":"ContainerStarted","Data":"9d19dbe65794cebce39f0e33afaacf8282ae9b2c42a3932f6826fcf49aa6d10a"}
Jul 23 13:48:45.420559 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:45.420196    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dpg8x"
Jul 23 13:48:45.455249 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:45.455202    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dpg8x" podStartSLOduration=2.083569163 podStartE2EDuration="3.455187672s" totalImagesPullingTime="1.371618509s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:48:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:48:45.451482634 +0000 UTC m=+496.890983550" watchObservedRunningTime="2026-07-23 13:48:45.455187672 +0000 UTC m=+496.894688591"
Jul 23 13:48:48.109701 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:48.109662    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-57tm8"]
Jul 23 13:48:48.116153 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:48.116128    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-57tm8"
Jul 23 13:48:48.118551 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:48.118524    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-p79b2\""
Jul 23 13:48:48.129945 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:48.129919    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-57tm8"]
Jul 23 13:48:48.225289 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:48.225256    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4f0b691a-43ae-402b-a5f5-b2b86597c54c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-57tm8\" (UID: \"4f0b691a-43ae-402b-a5f5-b2b86597c54c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-57tm8"
Jul 23 13:48:48.225462 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:48.225354    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqw27\" (UniqueName: \"kubernetes.io/projected/4f0b691a-43ae-402b-a5f5-b2b86597c54c-kube-api-access-mqw27\") pod \"kuadrant-operator-controller-manager-8684c9ff49-57tm8\" (UID: \"4f0b691a-43ae-402b-a5f5-b2b86597c54c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-57tm8"
Jul 23 13:48:48.326727 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:48.326688    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4f0b691a-43ae-402b-a5f5-b2b86597c54c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-57tm8\" (UID: \"4f0b691a-43ae-402b-a5f5-b2b86597c54c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-57tm8"
Jul 23 13:48:48.326902 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:48.326748    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqw27\" (UniqueName: \"kubernetes.io/projected/4f0b691a-43ae-402b-a5f5-b2b86597c54c-kube-api-access-mqw27\") pod \"kuadrant-operator-controller-manager-8684c9ff49-57tm8\" (UID: \"4f0b691a-43ae-402b-a5f5-b2b86597c54c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-57tm8"
Jul 23 13:48:48.327106 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:48.327085    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4f0b691a-43ae-402b-a5f5-b2b86597c54c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-57tm8\" (UID: \"4f0b691a-43ae-402b-a5f5-b2b86597c54c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-57tm8"
Jul 23 13:48:48.335084 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:48.335063    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqw27\" (UniqueName: \"kubernetes.io/projected/4f0b691a-43ae-402b-a5f5-b2b86597c54c-kube-api-access-mqw27\") pod \"kuadrant-operator-controller-manager-8684c9ff49-57tm8\" (UID: \"4f0b691a-43ae-402b-a5f5-b2b86597c54c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-57tm8"
Jul 23 13:48:48.426511 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:48.426402    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-57tm8"
Jul 23 13:48:48.576622 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:48.576597    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-57tm8"]
Jul 23 13:48:48.578402 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:48:48.578380    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f0b691a_43ae_402b_a5f5_b2b86597c54c.slice/crio-592cce09019ac321871524bebe78dc07de110d4a6548c07d8d1fa1b24e888b33 WatchSource:0}: Error finding container 592cce09019ac321871524bebe78dc07de110d4a6548c07d8d1fa1b24e888b33: Status 404 returned error can't find the container with id 592cce09019ac321871524bebe78dc07de110d4a6548c07d8d1fa1b24e888b33
Jul 23 13:48:48.657232 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:48.657201    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:48:49.145758 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:49.145709    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:48:49.328766 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:49.328725    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:48:49.444946 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:49.444864    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-57tm8" event={"ID":"4f0b691a-43ae-402b-a5f5-b2b86597c54c","Type":"ContainerStarted","Data":"592cce09019ac321871524bebe78dc07de110d4a6548c07d8d1fa1b24e888b33"}
Jul 23 13:48:49.461463 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:49.461403    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:48:49.567368 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:49.567322    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:48:49.674877 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:49.674833    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:48:50.985434 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:50.985383    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:48:52.256368 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:52.256332    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-5ll4q"]
Jul 23 13:48:52.260518 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:52.260495    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5ll4q"
Jul 23 13:48:52.263367 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:52.263341    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-65bhm\""
Jul 23 13:48:52.270092 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:52.270068    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-5ll4q"]
Jul 23 13:48:52.364158 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:52.364124    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2n5j\" (UniqueName: \"kubernetes.io/projected/d406dd9b-f3d9-40cf-b62c-fb81351ad874-kube-api-access-s2n5j\") pod \"authorino-operator-75cc8d5cb7-5ll4q\" (UID: \"d406dd9b-f3d9-40cf-b62c-fb81351ad874\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-5ll4q"
Jul 23 13:48:52.465576 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:52.465537    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2n5j\" (UniqueName: \"kubernetes.io/projected/d406dd9b-f3d9-40cf-b62c-fb81351ad874-kube-api-access-s2n5j\") pod \"authorino-operator-75cc8d5cb7-5ll4q\" (UID: \"d406dd9b-f3d9-40cf-b62c-fb81351ad874\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-5ll4q"
Jul 23 13:48:52.478889 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:52.478848    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2n5j\" (UniqueName: \"kubernetes.io/projected/d406dd9b-f3d9-40cf-b62c-fb81351ad874-kube-api-access-s2n5j\") pod \"authorino-operator-75cc8d5cb7-5ll4q\" (UID: \"d406dd9b-f3d9-40cf-b62c-fb81351ad874\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-5ll4q"
Jul 23 13:48:52.575941 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:52.575897    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5ll4q"
Jul 23 13:48:53.307789 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:53.307754    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:48:53.326341 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:53.326317    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-5ll4q"]
Jul 23 13:48:53.327782 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:48:53.327755    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd406dd9b_f3d9_40cf_b62c_fb81351ad874.slice/crio-8b351848a8c6b15afd772bfeb5c7b1a2341f5fb9250f97785204e76f9f3ffc23 WatchSource:0}: Error finding container 8b351848a8c6b15afd772bfeb5c7b1a2341f5fb9250f97785204e76f9f3ffc23: Status 404 returned error can't find the container with id 8b351848a8c6b15afd772bfeb5c7b1a2341f5fb9250f97785204e76f9f3ffc23
Jul 23 13:48:53.469830 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:53.469714    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-57tm8" event={"ID":"4f0b691a-43ae-402b-a5f5-b2b86597c54c","Type":"ContainerStarted","Data":"8edcfbab7f9086f80ab0fd32c1f1bbff82444a929bfd961e9a15f5da3f0573b2"}
Jul 23 13:48:53.469830 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:53.469803    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-57tm8"
Jul 23 13:48:53.470993 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:53.470964    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5ll4q" event={"ID":"d406dd9b-f3d9-40cf-b62c-fb81351ad874","Type":"ContainerStarted","Data":"8b351848a8c6b15afd772bfeb5c7b1a2341f5fb9250f97785204e76f9f3ffc23"}
Jul 23 13:48:53.508893 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:53.508848    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-57tm8" podStartSLOduration=0.851079086 podStartE2EDuration="5.50883323s" totalImagesPullingTime="4.657754144s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:48:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:48:53.508299826 +0000 UTC m=+504.947800745" watchObservedRunningTime="2026-07-23 13:48:53.50883323 +0000 UTC m=+504.948334148"
Jul 23 13:48:53.599467 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:53.599437    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:48:53.703862 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:53.703827    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:48:55.536649 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:55.536609    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:48:56.274208 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:56.274171    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:48:56.428690 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:56.428663    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dpg8x"
Jul 23 13:48:56.491129 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:56.491096    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5ll4q" event={"ID":"d406dd9b-f3d9-40cf-b62c-fb81351ad874","Type":"ContainerStarted","Data":"21b75e1afea7d6d64135e639264d979c60b50f5c0f4816567800091fd8595b7f"}
Jul 23 13:48:56.491300 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:56.491264    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5ll4q"
Jul 23 13:48:56.512662 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:56.512613    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5ll4q" podStartSLOduration=2.167261782 podStartE2EDuration="4.512598529s" totalImagesPullingTime="2.345336747s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:48:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:48:56.50979619 +0000 UTC m=+507.949297109" watchObservedRunningTime="2026-07-23 13:48:56.512598529 +0000 UTC m=+507.952099447"
Jul 23 13:48:56.978363 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:56.978322    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:48:57.370492 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:57.370460    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:48:57.498357 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:48:57.498319    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:49:00.669546 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:00.669506    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:49:00.749622 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:00.749584    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:49:04.480464 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:04.480431    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-57tm8"
Jul 23 13:49:06.455547 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:06.455508    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-57tm8"]
Jul 23 13:49:06.456067 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:06.455748    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-57tm8" podUID="4f0b691a-43ae-402b-a5f5-b2b86597c54c" containerName="manager" containerID="cri-o://8edcfbab7f9086f80ab0fd32c1f1bbff82444a929bfd961e9a15f5da3f0573b2" gracePeriod=2
Jul 23 13:49:06.463505 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:06.463477    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-57tm8"]
Jul 23 13:49:06.498573 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:06.498536    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qx4gf"]
Jul 23 13:49:06.499147 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:06.499127    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f0b691a-43ae-402b-a5f5-b2b86597c54c" containerName="manager"
Jul 23 13:49:06.499201 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:06.499151    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f0b691a-43ae-402b-a5f5-b2b86597c54c" containerName="manager"
Jul 23 13:49:06.499298 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:06.499285    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f0b691a-43ae-402b-a5f5-b2b86597c54c" containerName="manager"
Jul 23 13:49:06.502856 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:06.502837    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qx4gf"
Jul 23 13:49:06.522325 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:06.522295    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dpg8x"]
Jul 23 13:49:06.522534 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:06.522509    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dpg8x" podUID="6b7eea36-e806-41d9-966d-ca5135322230" containerName="manager" containerID="cri-o://9d19dbe65794cebce39f0e33afaacf8282ae9b2c42a3932f6826fcf49aa6d10a" gracePeriod=2
Jul 23 13:49:06.525284 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:06.525255    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qx4gf"]
Jul 23 13:49:06.546477 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:06.546454    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dpg8x"]
Jul 23 13:49:06.576484 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:49:06.576432    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-57tm8\" is forbidden: User \"system:node:ip-10-0-140-103.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-103.ec2.internal' and this object" podUID="4f0b691a-43ae-402b-a5f5-b2b86597c54c" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-57tm8"
Jul 23 13:49:06.579182 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:49:06.578973    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-dpg8x\" is forbidden: User \"system:node:ip-10-0-140-103.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-103.ec2.internal' and this object" podUID="6b7eea36-e806-41d9-966d-ca5135322230" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dpg8x"
Jul 23 13:49:06.581552 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:49:06.581518    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-57tm8\" is forbidden: User \"system:node:ip-10-0-140-103.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-103.ec2.internal' and this object" podUID="4f0b691a-43ae-402b-a5f5-b2b86597c54c" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-57tm8"
Jul 23 13:49:06.585107 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:06.585085    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhbcf\" (UniqueName: \"kubernetes.io/projected/44c2f1a7-ed8a-43b3-9977-47285484bc3d-kube-api-access-mhbcf\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qx4gf\" (UID: \"44c2f1a7-ed8a-43b3-9977-47285484bc3d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qx4gf"
Jul 23 13:49:06.585207 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:06.585136    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/44c2f1a7-ed8a-43b3-9977-47285484bc3d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qx4gf\" (UID: \"44c2f1a7-ed8a-43b3-9977-47285484bc3d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qx4gf"
Jul 23 13:49:06.587761 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:06.587742    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lx4ls"]
Jul 23 13:49:06.588433 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:06.588373    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b7eea36-e806-41d9-966d-ca5135322230" containerName="manager"
Jul 23 13:49:06.588488 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:06.588438    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b7eea36-e806-41d9-966d-ca5135322230" containerName="manager"
Jul 23 13:49:06.588577 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:06.588565    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b7eea36-e806-41d9-966d-ca5135322230" containerName="manager"
Jul 23 13:49:06.595050 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:06.592895    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lx4ls"
Jul 23 13:49:06.599312 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:49:06.599272    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-dpg8x\" is forbidden: User \"system:node:ip-10-0-140-103.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-103.ec2.internal' and this object" podUID="6b7eea36-e806-41d9-966d-ca5135322230" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dpg8x"
Jul 23 13:49:06.606198 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:49:06.606155    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-57tm8\" is forbidden: User \"system:node:ip-10-0-140-103.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-103.ec2.internal' and this object" podUID="4f0b691a-43ae-402b-a5f5-b2b86597c54c" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-57tm8"
Jul 23 13:49:06.608756 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:06.608731    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lx4ls"]
Jul 23 13:49:06.685937 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:06.685897    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhbcf\" (UniqueName: \"kubernetes.io/projected/44c2f1a7-ed8a-43b3-9977-47285484bc3d-kube-api-access-mhbcf\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qx4gf\" (UID: \"44c2f1a7-ed8a-43b3-9977-47285484bc3d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qx4gf"
Jul 23 13:49:06.686152 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:06.685980    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/44c2f1a7-ed8a-43b3-9977-47285484bc3d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qx4gf\" (UID: \"44c2f1a7-ed8a-43b3-9977-47285484bc3d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qx4gf"
Jul 23 13:49:06.686152 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:06.686059    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhwdt\" (UniqueName: \"kubernetes.io/projected/cd507235-42bf-4368-b5f5-0b61242ba155-kube-api-access-qhwdt\") pod \"limitador-operator-controller-manager-859d7b78bd-lx4ls\" (UID: \"cd507235-42bf-4368-b5f5-0b61242ba155\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lx4ls"
Jul 23 13:49:06.686504 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:06.686478    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/44c2f1a7-ed8a-43b3-9977-47285484bc3d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qx4gf\" (UID: \"44c2f1a7-ed8a-43b3-9977-47285484bc3d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qx4gf"
Jul 23 13:49:06.706595 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:06.706524    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhbcf\" (UniqueName: \"kubernetes.io/projected/44c2f1a7-ed8a-43b3-9977-47285484bc3d-kube-api-access-mhbcf\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qx4gf\" (UID: \"44c2f1a7-ed8a-43b3-9977-47285484bc3d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qx4gf"
Jul 23 13:49:06.771992 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:06.771955    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-57tm8"
Jul 23 13:49:06.774734 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:06.774714    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dpg8x"
Jul 23 13:49:06.776467 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:49:06.776438    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-dpg8x\" is forbidden: User \"system:node:ip-10-0-140-103.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-103.ec2.internal' and this object" podUID="6b7eea36-e806-41d9-966d-ca5135322230" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dpg8x"
Jul 23 13:49:06.778716 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:49:06.778693    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-57tm8\" is forbidden: User \"system:node:ip-10-0-140-103.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-103.ec2.internal' and this object" podUID="4f0b691a-43ae-402b-a5f5-b2b86597c54c" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-57tm8"
Jul 23 13:49:06.780856 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:49:06.780837    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-57tm8\" is forbidden: User \"system:node:ip-10-0-140-103.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-103.ec2.internal' and this object" podUID="4f0b691a-43ae-402b-a5f5-b2b86597c54c" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-57tm8"
Jul 23 13:49:06.782898 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:49:06.782874    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-dpg8x\" is forbidden: User \"system:node:ip-10-0-140-103.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-103.ec2.internal' and this object" podUID="6b7eea36-e806-41d9-966d-ca5135322230" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dpg8x"
Jul 23 13:49:06.786316 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:06.786296    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n5qr2\" (UniqueName: \"kubernetes.io/projected/6b7eea36-e806-41d9-966d-ca5135322230-kube-api-access-n5qr2\") pod \"6b7eea36-e806-41d9-966d-ca5135322230\" (UID: \"6b7eea36-e806-41d9-966d-ca5135322230\") "
Jul 23 13:49:06.786394 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:06.786331    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mqw27\" (UniqueName: \"kubernetes.io/projected/4f0b691a-43ae-402b-a5f5-b2b86597c54c-kube-api-access-mqw27\") pod \"4f0b691a-43ae-402b-a5f5-b2b86597c54c\" (UID: \"4f0b691a-43ae-402b-a5f5-b2b86597c54c\") "
Jul 23 13:49:06.786394 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:06.786390    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4f0b691a-43ae-402b-a5f5-b2b86597c54c-extensions-socket-volume\") pod \"4f0b691a-43ae-402b-a5f5-b2b86597c54c\" (UID: \"4f0b691a-43ae-402b-a5f5-b2b86597c54c\") "
Jul 23 13:49:06.786504 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:06.786485    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhwdt\" (UniqueName: \"kubernetes.io/projected/cd507235-42bf-4368-b5f5-0b61242ba155-kube-api-access-qhwdt\") pod \"limitador-operator-controller-manager-859d7b78bd-lx4ls\" (UID: \"cd507235-42bf-4368-b5f5-0b61242ba155\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lx4ls"
Jul 23 13:49:06.786884 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:06.786859    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f0b691a-43ae-402b-a5f5-b2b86597c54c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "4f0b691a-43ae-402b-a5f5-b2b86597c54c" (UID: "4f0b691a-43ae-402b-a5f5-b2b86597c54c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 13:49:06.788232 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:06.788212    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b7eea36-e806-41d9-966d-ca5135322230-kube-api-access-n5qr2" (OuterVolumeSpecName: "kube-api-access-n5qr2") pod "6b7eea36-e806-41d9-966d-ca5135322230" (UID: "6b7eea36-e806-41d9-966d-ca5135322230"). InnerVolumeSpecName "kube-api-access-n5qr2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:49:06.788284 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:06.788271    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f0b691a-43ae-402b-a5f5-b2b86597c54c-kube-api-access-mqw27" (OuterVolumeSpecName: "kube-api-access-mqw27") pod "4f0b691a-43ae-402b-a5f5-b2b86597c54c" (UID: "4f0b691a-43ae-402b-a5f5-b2b86597c54c"). InnerVolumeSpecName "kube-api-access-mqw27". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:49:06.800698 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:06.800675    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhwdt\" (UniqueName: \"kubernetes.io/projected/cd507235-42bf-4368-b5f5-0b61242ba155-kube-api-access-qhwdt\") pod \"limitador-operator-controller-manager-859d7b78bd-lx4ls\" (UID: \"cd507235-42bf-4368-b5f5-0b61242ba155\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lx4ls"
Jul 23 13:49:06.884238 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:06.884206    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qx4gf"
Jul 23 13:49:06.886999 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:06.886974    2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4f0b691a-43ae-402b-a5f5-b2b86597c54c-extensions-socket-volume\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 13:49:06.886999 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:06.886998    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n5qr2\" (UniqueName: \"kubernetes.io/projected/6b7eea36-e806-41d9-966d-ca5135322230-kube-api-access-n5qr2\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 13:49:06.887154 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:06.887007    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mqw27\" (UniqueName: \"kubernetes.io/projected/4f0b691a-43ae-402b-a5f5-b2b86597c54c-kube-api-access-mqw27\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 13:49:06.907358 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:06.907326    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lx4ls"
Jul 23 13:49:07.043539 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:07.043515    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qx4gf"]
Jul 23 13:49:07.045749 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:49:07.045722    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44c2f1a7_ed8a_43b3_9977_47285484bc3d.slice/crio-971948a15b6006e12f4d31e14a6ec8a3ea3916b23839fe32b5608d6cbee606ec WatchSource:0}: Error finding container 971948a15b6006e12f4d31e14a6ec8a3ea3916b23839fe32b5608d6cbee606ec: Status 404 returned error can't find the container with id 971948a15b6006e12f4d31e14a6ec8a3ea3916b23839fe32b5608d6cbee606ec
Jul 23 13:49:07.067404 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:49:07.067378    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd507235_42bf_4368_b5f5_0b61242ba155.slice/crio-11ed863444b3763c4d9f107ab7c064eab4c54a079c207df328870d2e13978001 WatchSource:0}: Error finding container 11ed863444b3763c4d9f107ab7c064eab4c54a079c207df328870d2e13978001: Status 404 returned error can't find the container with id 11ed863444b3763c4d9f107ab7c064eab4c54a079c207df328870d2e13978001
Jul 23 13:49:07.069802 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:07.069778    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f0b691a-43ae-402b-a5f5-b2b86597c54c" path="/var/lib/kubelet/pods/4f0b691a-43ae-402b-a5f5-b2b86597c54c/volumes"
Jul 23 13:49:07.070219 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:07.070199    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b7eea36-e806-41d9-966d-ca5135322230" path="/var/lib/kubelet/pods/6b7eea36-e806-41d9-966d-ca5135322230/volumes"
Jul 23 13:49:07.070594 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:07.070575    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lx4ls"]
Jul 23 13:49:07.499028 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:07.498975    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5ll4q"
Jul 23 13:49:07.552294 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:07.552258    2573 generic.go:356] "Generic (PLEG): container finished" podID="4f0b691a-43ae-402b-a5f5-b2b86597c54c" containerID="8edcfbab7f9086f80ab0fd32c1f1bbff82444a929bfd961e9a15f5da3f0573b2" exitCode=0
Jul 23 13:49:07.552479 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:07.552301    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-57tm8"
Jul 23 13:49:07.552479 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:07.552359    2573 scope.go:117] "RemoveContainer" containerID="8edcfbab7f9086f80ab0fd32c1f1bbff82444a929bfd961e9a15f5da3f0573b2"
Jul 23 13:49:07.553891 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:07.553870    2573 generic.go:356] "Generic (PLEG): container finished" podID="6b7eea36-e806-41d9-966d-ca5135322230" containerID="9d19dbe65794cebce39f0e33afaacf8282ae9b2c42a3932f6826fcf49aa6d10a" exitCode=0
Jul 23 13:49:07.553948 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:07.553917    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dpg8x"
Jul 23 13:49:07.556045 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:07.556001    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qx4gf" event={"ID":"44c2f1a7-ed8a-43b3-9977-47285484bc3d","Type":"ContainerStarted","Data":"a4b8380943f8828ab7c65777872d35ec2f3f6bc814c5461a0722224074c6ad5c"}
Jul 23 13:49:07.556186 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:07.556073    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qx4gf" event={"ID":"44c2f1a7-ed8a-43b3-9977-47285484bc3d","Type":"ContainerStarted","Data":"971948a15b6006e12f4d31e14a6ec8a3ea3916b23839fe32b5608d6cbee606ec"}
Jul 23 13:49:07.556186 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:07.556113    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qx4gf"
Jul 23 13:49:07.558356 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:07.558332    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lx4ls" event={"ID":"cd507235-42bf-4368-b5f5-0b61242ba155","Type":"ContainerStarted","Data":"7630ef3b69ac7a1e0e276cb80e106cb1678323466146b5f08c37da6027ad591e"}
Jul 23 13:49:07.558465 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:07.558379    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lx4ls" event={"ID":"cd507235-42bf-4368-b5f5-0b61242ba155","Type":"ContainerStarted","Data":"11ed863444b3763c4d9f107ab7c064eab4c54a079c207df328870d2e13978001"}
Jul 23 13:49:07.558465 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:07.558406    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lx4ls"
Jul 23 13:49:07.563279 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:07.563264    2573 scope.go:117] "RemoveContainer" containerID="8edcfbab7f9086f80ab0fd32c1f1bbff82444a929bfd961e9a15f5da3f0573b2"
Jul 23 13:49:07.563501 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:49:07.563484    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8edcfbab7f9086f80ab0fd32c1f1bbff82444a929bfd961e9a15f5da3f0573b2\": container with ID starting with 8edcfbab7f9086f80ab0fd32c1f1bbff82444a929bfd961e9a15f5da3f0573b2 not found: ID does not exist" containerID="8edcfbab7f9086f80ab0fd32c1f1bbff82444a929bfd961e9a15f5da3f0573b2"
Jul 23 13:49:07.563553 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:07.563507    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8edcfbab7f9086f80ab0fd32c1f1bbff82444a929bfd961e9a15f5da3f0573b2"} err="failed to get container status \"8edcfbab7f9086f80ab0fd32c1f1bbff82444a929bfd961e9a15f5da3f0573b2\": rpc error: code = NotFound desc = could not find container \"8edcfbab7f9086f80ab0fd32c1f1bbff82444a929bfd961e9a15f5da3f0573b2\": container with ID starting with 8edcfbab7f9086f80ab0fd32c1f1bbff82444a929bfd961e9a15f5da3f0573b2 not found: ID does not exist"
Jul 23 13:49:07.563553 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:07.563522    2573 scope.go:117] "RemoveContainer" containerID="9d19dbe65794cebce39f0e33afaacf8282ae9b2c42a3932f6826fcf49aa6d10a"
Jul 23 13:49:07.571292 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:07.571275    2573 scope.go:117] "RemoveContainer" containerID="9d19dbe65794cebce39f0e33afaacf8282ae9b2c42a3932f6826fcf49aa6d10a"
Jul 23 13:49:07.571572 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:49:07.571547    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d19dbe65794cebce39f0e33afaacf8282ae9b2c42a3932f6826fcf49aa6d10a\": container with ID starting with 9d19dbe65794cebce39f0e33afaacf8282ae9b2c42a3932f6826fcf49aa6d10a not found: ID does not exist" containerID="9d19dbe65794cebce39f0e33afaacf8282ae9b2c42a3932f6826fcf49aa6d10a"
Jul 23 13:49:07.571654 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:07.571579    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d19dbe65794cebce39f0e33afaacf8282ae9b2c42a3932f6826fcf49aa6d10a"} err="failed to get container status \"9d19dbe65794cebce39f0e33afaacf8282ae9b2c42a3932f6826fcf49aa6d10a\": rpc error: code = NotFound desc = could not find container \"9d19dbe65794cebce39f0e33afaacf8282ae9b2c42a3932f6826fcf49aa6d10a\": container with ID starting with 9d19dbe65794cebce39f0e33afaacf8282ae9b2c42a3932f6826fcf49aa6d10a not found: ID does not exist"
Jul 23 13:49:07.582228 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:07.582189    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qx4gf" podStartSLOduration=1.5821768349999998 podStartE2EDuration="1.582176835s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:49:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:49:07.581203727 +0000 UTC m=+519.020704647" watchObservedRunningTime="2026-07-23 13:49:07.582176835 +0000 UTC m=+519.021677753"
Jul 23 13:49:07.605468 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:07.605427    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lx4ls" podStartSLOduration=1.605414001 podStartE2EDuration="1.605414001s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:49:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:49:07.603617511 +0000 UTC m=+519.043118432" watchObservedRunningTime="2026-07-23 13:49:07.605414001 +0000 UTC m=+519.044914919"
Jul 23 13:49:09.080419 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:09.080382    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:49:09.186005 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:09.185963    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:49:11.569120 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:11.569077    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:49:11.667684 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:11.667653    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:49:15.894879 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:15.894846    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:49:15.988463 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:15.988424    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:49:18.567397 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:18.567362    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lx4ls"
Jul 23 13:49:18.567783 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:18.567513    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qx4gf"
Jul 23 13:49:18.883748 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:18.883641    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:49:18.986817 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:18.986749    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:49:22.800186 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:22.800102    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qx4gf"]
Jul 23 13:49:22.800582 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:22.800346    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qx4gf" podUID="44c2f1a7-ed8a-43b3-9977-47285484bc3d" containerName="manager" containerID="cri-o://a4b8380943f8828ab7c65777872d35ec2f3f6bc814c5461a0722224074c6ad5c" gracePeriod=10
Jul 23 13:49:23.051357 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:23.051298    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qx4gf"
Jul 23 13:49:23.118089 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:23.118053    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mhbcf\" (UniqueName: \"kubernetes.io/projected/44c2f1a7-ed8a-43b3-9977-47285484bc3d-kube-api-access-mhbcf\") pod \"44c2f1a7-ed8a-43b3-9977-47285484bc3d\" (UID: \"44c2f1a7-ed8a-43b3-9977-47285484bc3d\") "
Jul 23 13:49:23.118244 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:23.118119    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/44c2f1a7-ed8a-43b3-9977-47285484bc3d-extensions-socket-volume\") pod \"44c2f1a7-ed8a-43b3-9977-47285484bc3d\" (UID: \"44c2f1a7-ed8a-43b3-9977-47285484bc3d\") "
Jul 23 13:49:23.118513 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:23.118480    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44c2f1a7-ed8a-43b3-9977-47285484bc3d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "44c2f1a7-ed8a-43b3-9977-47285484bc3d" (UID: "44c2f1a7-ed8a-43b3-9977-47285484bc3d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 13:49:23.120115 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:23.120097    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44c2f1a7-ed8a-43b3-9977-47285484bc3d-kube-api-access-mhbcf" (OuterVolumeSpecName: "kube-api-access-mhbcf") pod "44c2f1a7-ed8a-43b3-9977-47285484bc3d" (UID: "44c2f1a7-ed8a-43b3-9977-47285484bc3d"). InnerVolumeSpecName "kube-api-access-mhbcf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:49:23.219525 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:23.219489    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mhbcf\" (UniqueName: \"kubernetes.io/projected/44c2f1a7-ed8a-43b3-9977-47285484bc3d-kube-api-access-mhbcf\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 13:49:23.219525 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:23.219518    2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/44c2f1a7-ed8a-43b3-9977-47285484bc3d-extensions-socket-volume\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 13:49:23.647631 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:23.647600    2573 generic.go:356] "Generic (PLEG): container finished" podID="44c2f1a7-ed8a-43b3-9977-47285484bc3d" containerID="a4b8380943f8828ab7c65777872d35ec2f3f6bc814c5461a0722224074c6ad5c" exitCode=0
Jul 23 13:49:23.647823 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:23.647643    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qx4gf"
Jul 23 13:49:23.647823 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:23.647692    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qx4gf" event={"ID":"44c2f1a7-ed8a-43b3-9977-47285484bc3d","Type":"ContainerDied","Data":"a4b8380943f8828ab7c65777872d35ec2f3f6bc814c5461a0722224074c6ad5c"}
Jul 23 13:49:23.647823 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:23.647744    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qx4gf" event={"ID":"44c2f1a7-ed8a-43b3-9977-47285484bc3d","Type":"ContainerDied","Data":"971948a15b6006e12f4d31e14a6ec8a3ea3916b23839fe32b5608d6cbee606ec"}
Jul 23 13:49:23.647823 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:23.647768    2573 scope.go:117] "RemoveContainer" containerID="a4b8380943f8828ab7c65777872d35ec2f3f6bc814c5461a0722224074c6ad5c"
Jul 23 13:49:23.657085 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:23.657066    2573 scope.go:117] "RemoveContainer" containerID="a4b8380943f8828ab7c65777872d35ec2f3f6bc814c5461a0722224074c6ad5c"
Jul 23 13:49:23.657333 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:49:23.657315    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4b8380943f8828ab7c65777872d35ec2f3f6bc814c5461a0722224074c6ad5c\": container with ID starting with a4b8380943f8828ab7c65777872d35ec2f3f6bc814c5461a0722224074c6ad5c not found: ID does not exist" containerID="a4b8380943f8828ab7c65777872d35ec2f3f6bc814c5461a0722224074c6ad5c"
Jul 23 13:49:23.657384 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:23.657342    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4b8380943f8828ab7c65777872d35ec2f3f6bc814c5461a0722224074c6ad5c"} err="failed to get container status \"a4b8380943f8828ab7c65777872d35ec2f3f6bc814c5461a0722224074c6ad5c\": rpc error: code = NotFound desc = could not find container \"a4b8380943f8828ab7c65777872d35ec2f3f6bc814c5461a0722224074c6ad5c\": container with ID starting with a4b8380943f8828ab7c65777872d35ec2f3f6bc814c5461a0722224074c6ad5c not found: ID does not exist"
Jul 23 13:49:23.672130 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:23.672107    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qx4gf"]
Jul 23 13:49:23.678489 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:23.678470    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qx4gf"]
Jul 23 13:49:25.068081 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:25.068049    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44c2f1a7-ed8a-43b3-9977-47285484bc3d" path="/var/lib/kubelet/pods/44c2f1a7-ed8a-43b3-9977-47285484bc3d/volumes"
Jul 23 13:49:28.084873 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:28.084828    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:49:28.185197 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:28.185159    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:49:30.582173 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:30.582135    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:49:30.679461 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:30.679427    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:49:37.691727 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:37.691689    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:49:37.853182 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:37.853148    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:49:37.953804 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:37.953706    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:49:39.223788 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:39.223752    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zd65t"]
Jul 23 13:49:39.224326 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:39.224310    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44c2f1a7-ed8a-43b3-9977-47285484bc3d" containerName="manager"
Jul 23 13:49:39.224383 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:39.224330    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="44c2f1a7-ed8a-43b3-9977-47285484bc3d" containerName="manager"
Jul 23 13:49:39.224441 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:39.224430    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="44c2f1a7-ed8a-43b3-9977-47285484bc3d" containerName="manager"
Jul 23 13:49:39.231474 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:39.231453    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zd65t"
Jul 23 13:49:39.234071 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:39.234049    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-ct64t\""
Jul 23 13:49:39.245576 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:39.242599    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zd65t"]
Jul 23 13:49:39.248708 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:39.248665    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:49:39.352777 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:39.352736    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/384f08a3-63c6-4f6e-8848-247f6f59c6b9-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-zd65t\" (UID: \"384f08a3-63c6-4f6e-8848-247f6f59c6b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zd65t"
Jul 23 13:49:39.352777 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:39.352782    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/384f08a3-63c6-4f6e-8848-247f6f59c6b9-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-zd65t\" (UID: \"384f08a3-63c6-4f6e-8848-247f6f59c6b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zd65t"
Jul 23 13:49:39.353077 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:39.352800    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/384f08a3-63c6-4f6e-8848-247f6f59c6b9-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-zd65t\" (UID: \"384f08a3-63c6-4f6e-8848-247f6f59c6b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zd65t"
Jul 23 13:49:39.353077 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:39.352864    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/384f08a3-63c6-4f6e-8848-247f6f59c6b9-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-zd65t\" (UID: \"384f08a3-63c6-4f6e-8848-247f6f59c6b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zd65t"
Jul 23 13:49:39.353077 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:39.352933    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/384f08a3-63c6-4f6e-8848-247f6f59c6b9-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-zd65t\" (UID: \"384f08a3-63c6-4f6e-8848-247f6f59c6b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zd65t"
Jul 23 13:49:39.353077 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:39.352997    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/384f08a3-63c6-4f6e-8848-247f6f59c6b9-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-zd65t\" (UID: \"384f08a3-63c6-4f6e-8848-247f6f59c6b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zd65t"
Jul 23 13:49:39.353077 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:39.353053    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/384f08a3-63c6-4f6e-8848-247f6f59c6b9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-zd65t\" (UID: \"384f08a3-63c6-4f6e-8848-247f6f59c6b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zd65t"
Jul 23 13:49:39.353361 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:39.353110    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c82zp\" (UniqueName: \"kubernetes.io/projected/384f08a3-63c6-4f6e-8848-247f6f59c6b9-kube-api-access-c82zp\") pod \"maas-default-gateway-openshift-default-56654dcf7-zd65t\" (UID: \"384f08a3-63c6-4f6e-8848-247f6f59c6b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zd65t"
Jul 23 13:49:39.353361 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:39.353129    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/384f08a3-63c6-4f6e-8848-247f6f59c6b9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-zd65t\" (UID: \"384f08a3-63c6-4f6e-8848-247f6f59c6b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zd65t"
Jul 23 13:49:39.453893 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:39.453854    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/384f08a3-63c6-4f6e-8848-247f6f59c6b9-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-zd65t\" (UID: \"384f08a3-63c6-4f6e-8848-247f6f59c6b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zd65t"
Jul 23 13:49:39.454090 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:39.453910    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/384f08a3-63c6-4f6e-8848-247f6f59c6b9-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-zd65t\" (UID: \"384f08a3-63c6-4f6e-8848-247f6f59c6b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zd65t"
Jul 23 13:49:39.454090 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:39.454036    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/384f08a3-63c6-4f6e-8848-247f6f59c6b9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-zd65t\" (UID: \"384f08a3-63c6-4f6e-8848-247f6f59c6b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zd65t"
Jul 23 13:49:39.454213 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:39.454114    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c82zp\" (UniqueName: \"kubernetes.io/projected/384f08a3-63c6-4f6e-8848-247f6f59c6b9-kube-api-access-c82zp\") pod \"maas-default-gateway-openshift-default-56654dcf7-zd65t\" (UID: \"384f08a3-63c6-4f6e-8848-247f6f59c6b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zd65t"
Jul 23 13:49:39.454213 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:39.454148    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/384f08a3-63c6-4f6e-8848-247f6f59c6b9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-zd65t\" (UID: \"384f08a3-63c6-4f6e-8848-247f6f59c6b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zd65t"
Jul 23 13:49:39.454213 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:39.454179    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/384f08a3-63c6-4f6e-8848-247f6f59c6b9-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-zd65t\" (UID: \"384f08a3-63c6-4f6e-8848-247f6f59c6b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zd65t"
Jul 23 13:49:39.454358 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:39.454216    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/384f08a3-63c6-4f6e-8848-247f6f59c6b9-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-zd65t\" (UID: \"384f08a3-63c6-4f6e-8848-247f6f59c6b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zd65t"
Jul 23 13:49:39.454409 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:39.454370    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/384f08a3-63c6-4f6e-8848-247f6f59c6b9-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-zd65t\" (UID: \"384f08a3-63c6-4f6e-8848-247f6f59c6b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zd65t"
Jul 23 13:49:39.454466 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:39.454398    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/384f08a3-63c6-4f6e-8848-247f6f59c6b9-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-zd65t\" (UID: \"384f08a3-63c6-4f6e-8848-247f6f59c6b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zd65t"
Jul 23 13:49:39.454466 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:39.454412    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/384f08a3-63c6-4f6e-8848-247f6f59c6b9-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-zd65t\" (UID: \"384f08a3-63c6-4f6e-8848-247f6f59c6b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zd65t"
Jul 23 13:49:39.454558 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:39.454503    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/384f08a3-63c6-4f6e-8848-247f6f59c6b9-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-zd65t\" (UID: \"384f08a3-63c6-4f6e-8848-247f6f59c6b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zd65t"
Jul 23 13:49:39.454703 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:39.454671    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/384f08a3-63c6-4f6e-8848-247f6f59c6b9-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-zd65t\" (UID: \"384f08a3-63c6-4f6e-8848-247f6f59c6b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zd65t"
Jul 23 13:49:39.454841 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:39.454730    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/384f08a3-63c6-4f6e-8848-247f6f59c6b9-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-zd65t\" (UID: \"384f08a3-63c6-4f6e-8848-247f6f59c6b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zd65t"
Jul 23 13:49:39.454949 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:39.454923    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/384f08a3-63c6-4f6e-8848-247f6f59c6b9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-zd65t\" (UID: \"384f08a3-63c6-4f6e-8848-247f6f59c6b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zd65t"
Jul 23 13:49:39.456366 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:39.456341    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/384f08a3-63c6-4f6e-8848-247f6f59c6b9-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-zd65t\" (UID: \"384f08a3-63c6-4f6e-8848-247f6f59c6b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zd65t"
Jul 23 13:49:39.456452 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:39.456433    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/384f08a3-63c6-4f6e-8848-247f6f59c6b9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-zd65t\" (UID: \"384f08a3-63c6-4f6e-8848-247f6f59c6b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zd65t"
Jul 23 13:49:39.462045 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:39.461997    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c82zp\" (UniqueName: \"kubernetes.io/projected/384f08a3-63c6-4f6e-8848-247f6f59c6b9-kube-api-access-c82zp\") pod \"maas-default-gateway-openshift-default-56654dcf7-zd65t\" (UID: \"384f08a3-63c6-4f6e-8848-247f6f59c6b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zd65t"
Jul 23 13:49:39.462492 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:39.462467    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/384f08a3-63c6-4f6e-8848-247f6f59c6b9-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-zd65t\" (UID: \"384f08a3-63c6-4f6e-8848-247f6f59c6b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zd65t"
Jul 23 13:49:39.479337 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:39.479263    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:49:39.547964 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:39.547928    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zd65t"
Jul 23 13:49:39.702754 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:39.702722    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zd65t"]
Jul 23 13:49:39.706070 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:49:39.706043    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod384f08a3_63c6_4f6e_8848_247f6f59c6b9.slice/crio-334bb3af6ff0579c09cfd48af6cfda047bca0e579fdb55fc74cb518301416bcd WatchSource:0}: Error finding container 334bb3af6ff0579c09cfd48af6cfda047bca0e579fdb55fc74cb518301416bcd: Status 404 returned error can't find the container with id 334bb3af6ff0579c09cfd48af6cfda047bca0e579fdb55fc74cb518301416bcd
Jul 23 13:49:39.708537 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:39.708504    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 13:49:39.708629 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:39.708573    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 13:49:39.708629 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:39.708604    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 13:49:39.735565 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:39.735507    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zd65t" event={"ID":"384f08a3-63c6-4f6e-8848-247f6f59c6b9","Type":"ContainerStarted","Data":"334bb3af6ff0579c09cfd48af6cfda047bca0e579fdb55fc74cb518301416bcd"}
Jul 23 13:49:40.742910 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:40.742877    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zd65t" event={"ID":"384f08a3-63c6-4f6e-8848-247f6f59c6b9","Type":"ContainerStarted","Data":"4923d99a6a1a341f29c51d8baaf655f0073db68f2a371990d194bbf268afa2c4"}
Jul 23 13:49:40.769390 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:40.769338    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zd65t" podStartSLOduration=1.769321959 podStartE2EDuration="1.769321959s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:49:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:49:40.766643629 +0000 UTC m=+552.206144550" watchObservedRunningTime="2026-07-23 13:49:40.769321959 +0000 UTC m=+552.208822878"
Jul 23 13:49:41.548484 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:41.548448    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zd65t"
Jul 23 13:49:41.553827 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:41.553801    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zd65t"
Jul 23 13:49:41.748573 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:41.748547    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zd65t"
Jul 23 13:49:41.749788 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:41.749767    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zd65t"
Jul 23 13:49:41.833388 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:41.833314    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-h6dq4"]
Jul 23 13:49:41.836971 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:41.836950    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-h6dq4"
Jul 23 13:49:41.840700 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:41.840676    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 23 13:49:41.841055 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:41.841002    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-vtgk7\""
Jul 23 13:49:41.845882 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:41.845861    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-h6dq4"]
Jul 23 13:49:41.906625 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:41.906580    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:49:41.927827 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:41.927794    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-h6dq4"]
Jul 23 13:49:41.977928 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:41.977898    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ccf77118-fe67-44ff-85da-64b237afd7a7-config-file\") pod \"limitador-limitador-64c94fd64f-h6dq4\" (UID: \"ccf77118-fe67-44ff-85da-64b237afd7a7\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-h6dq4"
Jul 23 13:49:41.978086 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:41.977946    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hz7t7\" (UniqueName: \"kubernetes.io/projected/ccf77118-fe67-44ff-85da-64b237afd7a7-kube-api-access-hz7t7\") pod \"limitador-limitador-64c94fd64f-h6dq4\" (UID: \"ccf77118-fe67-44ff-85da-64b237afd7a7\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-h6dq4"
Jul 23 13:49:42.005233 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:42.005200    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:49:42.079333 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:42.079288    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ccf77118-fe67-44ff-85da-64b237afd7a7-config-file\") pod \"limitador-limitador-64c94fd64f-h6dq4\" (UID: \"ccf77118-fe67-44ff-85da-64b237afd7a7\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-h6dq4"
Jul 23 13:49:42.079333 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:42.079353    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hz7t7\" (UniqueName: \"kubernetes.io/projected/ccf77118-fe67-44ff-85da-64b237afd7a7-kube-api-access-hz7t7\") pod \"limitador-limitador-64c94fd64f-h6dq4\" (UID: \"ccf77118-fe67-44ff-85da-64b237afd7a7\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-h6dq4"
Jul 23 13:49:42.079910 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:42.079889    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ccf77118-fe67-44ff-85da-64b237afd7a7-config-file\") pod \"limitador-limitador-64c94fd64f-h6dq4\" (UID: \"ccf77118-fe67-44ff-85da-64b237afd7a7\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-h6dq4"
Jul 23 13:49:42.087695 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:42.087638    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hz7t7\" (UniqueName: \"kubernetes.io/projected/ccf77118-fe67-44ff-85da-64b237afd7a7-kube-api-access-hz7t7\") pod \"limitador-limitador-64c94fd64f-h6dq4\" (UID: \"ccf77118-fe67-44ff-85da-64b237afd7a7\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-h6dq4"
Jul 23 13:49:42.149108 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:42.149074    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-h6dq4"
Jul 23 13:49:42.286786 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:42.286757    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-h6dq4"]
Jul 23 13:49:42.289771 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:49:42.289731    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccf77118_fe67_44ff_85da_64b237afd7a7.slice/crio-86edffedc97af234570418b8e421badbf563129b5e16fcab8f04ba6ad321b594 WatchSource:0}: Error finding container 86edffedc97af234570418b8e421badbf563129b5e16fcab8f04ba6ad321b594: Status 404 returned error can't find the container with id 86edffedc97af234570418b8e421badbf563129b5e16fcab8f04ba6ad321b594
Jul 23 13:49:42.647991 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:42.647955    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-vxw8d"]
Jul 23 13:49:42.652693 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:42.652674    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-vxw8d"
Jul 23 13:49:42.654999 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:42.654979    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-n5d87\""
Jul 23 13:49:42.660826 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:42.660805    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-vxw8d"]
Jul 23 13:49:42.676972 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:42.676945    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:49:42.755443 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:42.755408    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-h6dq4" event={"ID":"ccf77118-fe67-44ff-85da-64b237afd7a7","Type":"ContainerStarted","Data":"86edffedc97af234570418b8e421badbf563129b5e16fcab8f04ba6ad321b594"}
Jul 23 13:49:42.756823 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:42.756799    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:49:42.785186 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:42.785155    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gl4ws\" (UniqueName: \"kubernetes.io/projected/a9c4ac32-d1d8-47cb-8a70-8e63164ee4cb-kube-api-access-gl4ws\") pod \"authorino-58cd955675-vxw8d\" (UID: \"a9c4ac32-d1d8-47cb-8a70-8e63164ee4cb\") " pod="kuadrant-system/authorino-58cd955675-vxw8d"
Jul 23 13:49:42.886437 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:42.886402    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gl4ws\" (UniqueName: \"kubernetes.io/projected/a9c4ac32-d1d8-47cb-8a70-8e63164ee4cb-kube-api-access-gl4ws\") pod \"authorino-58cd955675-vxw8d\" (UID: \"a9c4ac32-d1d8-47cb-8a70-8e63164ee4cb\") " pod="kuadrant-system/authorino-58cd955675-vxw8d"
Jul 23 13:49:42.895101 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:42.895073    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gl4ws\" (UniqueName: \"kubernetes.io/projected/a9c4ac32-d1d8-47cb-8a70-8e63164ee4cb-kube-api-access-gl4ws\") pod \"authorino-58cd955675-vxw8d\" (UID: \"a9c4ac32-d1d8-47cb-8a70-8e63164ee4cb\") " pod="kuadrant-system/authorino-58cd955675-vxw8d"
Jul 23 13:49:42.962735 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:42.962652    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-vxw8d"
Jul 23 13:49:43.105187 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:43.105152    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-vxw8d"]
Jul 23 13:49:43.107071 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:49:43.107037    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda9c4ac32_d1d8_47cb_8a70_8e63164ee4cb.slice/crio-6c060efb9690bec5e879b1eaa8b96368fe6984aeb4def54270cb9a578858149d WatchSource:0}: Error finding container 6c060efb9690bec5e879b1eaa8b96368fe6984aeb4def54270cb9a578858149d: Status 404 returned error can't find the container with id 6c060efb9690bec5e879b1eaa8b96368fe6984aeb4def54270cb9a578858149d
Jul 23 13:49:43.764412 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:43.764369    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-vxw8d" event={"ID":"a9c4ac32-d1d8-47cb-8a70-8e63164ee4cb","Type":"ContainerStarted","Data":"6c060efb9690bec5e879b1eaa8b96368fe6984aeb4def54270cb9a578858149d"}
Jul 23 13:49:47.450862 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:47.450827    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-vxw8d"]
Jul 23 13:49:47.791447 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:47.791413    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-h6dq4" event={"ID":"ccf77118-fe67-44ff-85da-64b237afd7a7","Type":"ContainerStarted","Data":"2b7bf2fe1987286e2f7b28d5da8423ac8e5e772c0262e60c2acaf2d939c89714"}
Jul 23 13:49:47.791636 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:47.791540    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-h6dq4"
Jul 23 13:49:47.793175 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:47.793143    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-vxw8d" event={"ID":"a9c4ac32-d1d8-47cb-8a70-8e63164ee4cb","Type":"ContainerStarted","Data":"fb31e9951813395362753834fdd4f09c8e8efc04af88254ca5b81dec9b8aa126"}
Jul 23 13:49:47.809433 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:47.809390    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-h6dq4" podStartSLOduration=2.129564616 podStartE2EDuration="6.809376719s" totalImagesPullingTime="4.679812103s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:49:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:49:47.807277617 +0000 UTC m=+559.246778546" watchObservedRunningTime="2026-07-23 13:49:47.809376719 +0000 UTC m=+559.248877638"
Jul 23 13:49:47.827223 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:47.827186    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-vxw8d" podStartSLOduration=1.9566307840000001 podStartE2EDuration="5.827172927s" totalImagesPullingTime="3.870542143s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:49:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:49:47.826312754 +0000 UTC m=+559.265813674" watchObservedRunningTime="2026-07-23 13:49:47.827172927 +0000 UTC m=+559.266673845"
Jul 23 13:49:48.804661 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:48.804595    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-vxw8d" podUID="a9c4ac32-d1d8-47cb-8a70-8e63164ee4cb" containerName="authorino" containerID="cri-o://fb31e9951813395362753834fdd4f09c8e8efc04af88254ca5b81dec9b8aa126" gracePeriod=30
Jul 23 13:49:49.053314 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:49.053289    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-vxw8d"
Jul 23 13:49:49.147973 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:49.147887    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gl4ws\" (UniqueName: \"kubernetes.io/projected/a9c4ac32-d1d8-47cb-8a70-8e63164ee4cb-kube-api-access-gl4ws\") pod \"a9c4ac32-d1d8-47cb-8a70-8e63164ee4cb\" (UID: \"a9c4ac32-d1d8-47cb-8a70-8e63164ee4cb\") "
Jul 23 13:49:49.149934 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:49.149907    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9c4ac32-d1d8-47cb-8a70-8e63164ee4cb-kube-api-access-gl4ws" (OuterVolumeSpecName: "kube-api-access-gl4ws") pod "a9c4ac32-d1d8-47cb-8a70-8e63164ee4cb" (UID: "a9c4ac32-d1d8-47cb-8a70-8e63164ee4cb"). InnerVolumeSpecName "kube-api-access-gl4ws". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:49:49.248737 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:49.248699    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gl4ws\" (UniqueName: \"kubernetes.io/projected/a9c4ac32-d1d8-47cb-8a70-8e63164ee4cb-kube-api-access-gl4ws\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 13:49:49.810680 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:49.810643    2573 generic.go:356] "Generic (PLEG): container finished" podID="a9c4ac32-d1d8-47cb-8a70-8e63164ee4cb" containerID="fb31e9951813395362753834fdd4f09c8e8efc04af88254ca5b81dec9b8aa126" exitCode=0
Jul 23 13:49:49.810680 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:49.810681    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-vxw8d"
Jul 23 13:49:49.811250 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:49.810730    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-vxw8d" event={"ID":"a9c4ac32-d1d8-47cb-8a70-8e63164ee4cb","Type":"ContainerDied","Data":"fb31e9951813395362753834fdd4f09c8e8efc04af88254ca5b81dec9b8aa126"}
Jul 23 13:49:49.811250 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:49.810772    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-vxw8d" event={"ID":"a9c4ac32-d1d8-47cb-8a70-8e63164ee4cb","Type":"ContainerDied","Data":"6c060efb9690bec5e879b1eaa8b96368fe6984aeb4def54270cb9a578858149d"}
Jul 23 13:49:49.811250 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:49.810789    2573 scope.go:117] "RemoveContainer" containerID="fb31e9951813395362753834fdd4f09c8e8efc04af88254ca5b81dec9b8aa126"
Jul 23 13:49:49.819825 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:49.819805    2573 scope.go:117] "RemoveContainer" containerID="fb31e9951813395362753834fdd4f09c8e8efc04af88254ca5b81dec9b8aa126"
Jul 23 13:49:49.820091 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:49:49.820065    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb31e9951813395362753834fdd4f09c8e8efc04af88254ca5b81dec9b8aa126\": container with ID starting with fb31e9951813395362753834fdd4f09c8e8efc04af88254ca5b81dec9b8aa126 not found: ID does not exist" containerID="fb31e9951813395362753834fdd4f09c8e8efc04af88254ca5b81dec9b8aa126"
Jul 23 13:49:49.820169 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:49.820094    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb31e9951813395362753834fdd4f09c8e8efc04af88254ca5b81dec9b8aa126"} err="failed to get container status \"fb31e9951813395362753834fdd4f09c8e8efc04af88254ca5b81dec9b8aa126\": rpc error: code = NotFound desc = could not find container \"fb31e9951813395362753834fdd4f09c8e8efc04af88254ca5b81dec9b8aa126\": container with ID starting with fb31e9951813395362753834fdd4f09c8e8efc04af88254ca5b81dec9b8aa126 not found: ID does not exist"
Jul 23 13:49:49.836050 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:49.836007    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-vxw8d"]
Jul 23 13:49:49.838272 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:49.838252    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-vxw8d"]
Jul 23 13:49:51.068352 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:51.068310    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9c4ac32-d1d8-47cb-8a70-8e63164ee4cb" path="/var/lib/kubelet/pods/a9c4ac32-d1d8-47cb-8a70-8e63164ee4cb/volumes"
Jul 23 13:49:58.454844 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:58.454805    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-h6dq4"]
Jul 23 13:49:58.455341 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:58.455029    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-h6dq4" podUID="ccf77118-fe67-44ff-85da-64b237afd7a7" containerName="limitador" containerID="cri-o://2b7bf2fe1987286e2f7b28d5da8423ac8e5e772c0262e60c2acaf2d939c89714" gracePeriod=30
Jul 23 13:49:58.455769 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:58.455749    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-h6dq4"
Jul 23 13:49:59.021885 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:59.021826    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-h6dq4"
Jul 23 13:49:59.134130 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:59.134094    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hz7t7\" (UniqueName: \"kubernetes.io/projected/ccf77118-fe67-44ff-85da-64b237afd7a7-kube-api-access-hz7t7\") pod \"ccf77118-fe67-44ff-85da-64b237afd7a7\" (UID: \"ccf77118-fe67-44ff-85da-64b237afd7a7\") "
Jul 23 13:49:59.134299 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:59.134203    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ccf77118-fe67-44ff-85da-64b237afd7a7-config-file\") pod \"ccf77118-fe67-44ff-85da-64b237afd7a7\" (UID: \"ccf77118-fe67-44ff-85da-64b237afd7a7\") "
Jul 23 13:49:59.134576 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:59.134546    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ccf77118-fe67-44ff-85da-64b237afd7a7-config-file" (OuterVolumeSpecName: "config-file") pod "ccf77118-fe67-44ff-85da-64b237afd7a7" (UID: "ccf77118-fe67-44ff-85da-64b237afd7a7"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 13:49:59.136611 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:59.136586    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ccf77118-fe67-44ff-85da-64b237afd7a7-kube-api-access-hz7t7" (OuterVolumeSpecName: "kube-api-access-hz7t7") pod "ccf77118-fe67-44ff-85da-64b237afd7a7" (UID: "ccf77118-fe67-44ff-85da-64b237afd7a7"). InnerVolumeSpecName "kube-api-access-hz7t7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:49:59.235080 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:59.235047    2573 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ccf77118-fe67-44ff-85da-64b237afd7a7-config-file\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 13:49:59.235080 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:59.235073    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hz7t7\" (UniqueName: \"kubernetes.io/projected/ccf77118-fe67-44ff-85da-64b237afd7a7-kube-api-access-hz7t7\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 13:49:59.864179 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:59.864139    2573 generic.go:356] "Generic (PLEG): container finished" podID="ccf77118-fe67-44ff-85da-64b237afd7a7" containerID="2b7bf2fe1987286e2f7b28d5da8423ac8e5e772c0262e60c2acaf2d939c89714" exitCode=0
Jul 23 13:49:59.864179 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:59.864184    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-h6dq4"
Jul 23 13:49:59.864719 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:59.864226    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-h6dq4" event={"ID":"ccf77118-fe67-44ff-85da-64b237afd7a7","Type":"ContainerDied","Data":"2b7bf2fe1987286e2f7b28d5da8423ac8e5e772c0262e60c2acaf2d939c89714"}
Jul 23 13:49:59.864719 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:59.864292    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-h6dq4" event={"ID":"ccf77118-fe67-44ff-85da-64b237afd7a7","Type":"ContainerDied","Data":"86edffedc97af234570418b8e421badbf563129b5e16fcab8f04ba6ad321b594"}
Jul 23 13:49:59.864719 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:59.864326    2573 scope.go:117] "RemoveContainer" containerID="2b7bf2fe1987286e2f7b28d5da8423ac8e5e772c0262e60c2acaf2d939c89714"
Jul 23 13:49:59.873954 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:59.873936    2573 scope.go:117] "RemoveContainer" containerID="2b7bf2fe1987286e2f7b28d5da8423ac8e5e772c0262e60c2acaf2d939c89714"
Jul 23 13:49:59.874225 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:49:59.874204    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b7bf2fe1987286e2f7b28d5da8423ac8e5e772c0262e60c2acaf2d939c89714\": container with ID starting with 2b7bf2fe1987286e2f7b28d5da8423ac8e5e772c0262e60c2acaf2d939c89714 not found: ID does not exist" containerID="2b7bf2fe1987286e2f7b28d5da8423ac8e5e772c0262e60c2acaf2d939c89714"
Jul 23 13:49:59.874506 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:59.874231    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b7bf2fe1987286e2f7b28d5da8423ac8e5e772c0262e60c2acaf2d939c89714"} err="failed to get container status \"2b7bf2fe1987286e2f7b28d5da8423ac8e5e772c0262e60c2acaf2d939c89714\": rpc error: code = NotFound desc = could not find container \"2b7bf2fe1987286e2f7b28d5da8423ac8e5e772c0262e60c2acaf2d939c89714\": container with ID starting with 2b7bf2fe1987286e2f7b28d5da8423ac8e5e772c0262e60c2acaf2d939c89714 not found: ID does not exist"
Jul 23 13:49:59.890370 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:59.890347    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-h6dq4"]
Jul 23 13:49:59.894722 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:49:59.894702    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-h6dq4"]
Jul 23 13:50:01.067690 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:01.067654    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ccf77118-fe67-44ff-85da-64b237afd7a7" path="/var/lib/kubelet/pods/ccf77118-fe67-44ff-85da-64b237afd7a7/volumes"
Jul 23 13:50:03.148639 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:03.148608    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:50:03.316300 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:03.316268    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:50:03.705959 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:03.705922    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-tnqsr"]
Jul 23 13:50:03.706355 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:03.706340    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ccf77118-fe67-44ff-85da-64b237afd7a7" containerName="limitador"
Jul 23 13:50:03.706404 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:03.706358    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="ccf77118-fe67-44ff-85da-64b237afd7a7" containerName="limitador"
Jul 23 13:50:03.706404 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:03.706378    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9c4ac32-d1d8-47cb-8a70-8e63164ee4cb" containerName="authorino"
Jul 23 13:50:03.706404 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:03.706385    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9c4ac32-d1d8-47cb-8a70-8e63164ee4cb" containerName="authorino"
Jul 23 13:50:03.706498 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:03.706448    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9c4ac32-d1d8-47cb-8a70-8e63164ee4cb" containerName="authorino"
Jul 23 13:50:03.706498 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:03.706458    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="ccf77118-fe67-44ff-85da-64b237afd7a7" containerName="limitador"
Jul 23 13:50:03.710619 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:03.710599    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tnqsr"
Jul 23 13:50:03.715522 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:03.715500    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 23 13:50:03.716046 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:03.716029    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-rb2ht\""
Jul 23 13:50:03.716559 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:03.716531    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 23 13:50:03.716559 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:03.716531    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 23 13:50:03.733124 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:03.733098    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-tnqsr"]
Jul 23 13:50:03.751929 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:03.751895    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:50:03.771919 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:03.771891    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjkvd\" (UniqueName: \"kubernetes.io/projected/22f399c2-de75-432b-99b6-258927c812fe-kube-api-access-pjkvd\") pod \"postgres-69fb4594cf-tnqsr\" (UID: \"22f399c2-de75-432b-99b6-258927c812fe\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-tnqsr"
Jul 23 13:50:03.772061 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:03.771938    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/22f399c2-de75-432b-99b6-258927c812fe-data\") pod \"postgres-69fb4594cf-tnqsr\" (UID: \"22f399c2-de75-432b-99b6-258927c812fe\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-tnqsr"
Jul 23 13:50:03.872690 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:03.872653    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjkvd\" (UniqueName: \"kubernetes.io/projected/22f399c2-de75-432b-99b6-258927c812fe-kube-api-access-pjkvd\") pod \"postgres-69fb4594cf-tnqsr\" (UID: \"22f399c2-de75-432b-99b6-258927c812fe\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-tnqsr"
Jul 23 13:50:03.872891 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:03.872704    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/22f399c2-de75-432b-99b6-258927c812fe-data\") pod \"postgres-69fb4594cf-tnqsr\" (UID: \"22f399c2-de75-432b-99b6-258927c812fe\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-tnqsr"
Jul 23 13:50:03.873078 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:03.873058    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/22f399c2-de75-432b-99b6-258927c812fe-data\") pod \"postgres-69fb4594cf-tnqsr\" (UID: \"22f399c2-de75-432b-99b6-258927c812fe\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-tnqsr"
Jul 23 13:50:03.883735 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:03.883710    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjkvd\" (UniqueName: \"kubernetes.io/projected/22f399c2-de75-432b-99b6-258927c812fe-kube-api-access-pjkvd\") pod \"postgres-69fb4594cf-tnqsr\" (UID: \"22f399c2-de75-432b-99b6-258927c812fe\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-tnqsr"
Jul 23 13:50:04.021404 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:04.021292    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tnqsr"
Jul 23 13:50:04.157690 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:04.157664    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-tnqsr"]
Jul 23 13:50:04.158769 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:50:04.158744    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22f399c2_de75_432b_99b6_258927c812fe.slice/crio-42ca768db390e5eef04e48d7f2242b1329b4dff5174d65b11c3d1786ab506865 WatchSource:0}: Error finding container 42ca768db390e5eef04e48d7f2242b1329b4dff5174d65b11c3d1786ab506865: Status 404 returned error can't find the container with id 42ca768db390e5eef04e48d7f2242b1329b4dff5174d65b11c3d1786ab506865
Jul 23 13:50:04.897911 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:04.897871    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tnqsr" event={"ID":"22f399c2-de75-432b-99b6-258927c812fe","Type":"ContainerStarted","Data":"42ca768db390e5eef04e48d7f2242b1329b4dff5174d65b11c3d1786ab506865"}
Jul 23 13:50:06.332706 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:06.332666    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:50:09.928185 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:09.928147    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tnqsr" event={"ID":"22f399c2-de75-432b-99b6-258927c812fe","Type":"ContainerStarted","Data":"5b3cdfadf72c2594a370744f8ef707719a65b76a5521343d31d46af76a27751d"}
Jul 23 13:50:09.928616 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:09.928291    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tnqsr"
Jul 23 13:50:09.947155 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:09.947110    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tnqsr" podStartSLOduration=2.164453852 podStartE2EDuration="6.947095018s" totalImagesPullingTime="4.782641166s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:50:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:50:09.94564036 +0000 UTC m=+581.385141281" watchObservedRunningTime="2026-07-23 13:50:09.947095018 +0000 UTC m=+581.386595970"
Jul 23 13:50:15.964448 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:15.964413    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tnqsr"
Jul 23 13:50:16.303119 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:16.303082    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:50:16.403463 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:16.403402    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:50:16.550680 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:16.550645    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6r2m4"]
Jul 23 13:50:16.557232 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:16.557166    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-6r2m4"
Jul 23 13:50:16.560314 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:16.560283    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-n5d87\""
Jul 23 13:50:16.561812 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:16.561788    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6r2m4"]
Jul 23 13:50:16.588078 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:16.588051    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fp9vl\" (UniqueName: \"kubernetes.io/projected/0db5b872-c887-4039-97d8-8c0d2100db53-kube-api-access-fp9vl\") pod \"authorino-5d4b67c446-6r2m4\" (UID: \"0db5b872-c887-4039-97d8-8c0d2100db53\") " pod="kuadrant-system/authorino-5d4b67c446-6r2m4"
Jul 23 13:50:16.689409 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:16.689364    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fp9vl\" (UniqueName: \"kubernetes.io/projected/0db5b872-c887-4039-97d8-8c0d2100db53-kube-api-access-fp9vl\") pod \"authorino-5d4b67c446-6r2m4\" (UID: \"0db5b872-c887-4039-97d8-8c0d2100db53\") " pod="kuadrant-system/authorino-5d4b67c446-6r2m4"
Jul 23 13:50:16.698845 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:16.698808    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fp9vl\" (UniqueName: \"kubernetes.io/projected/0db5b872-c887-4039-97d8-8c0d2100db53-kube-api-access-fp9vl\") pod \"authorino-5d4b67c446-6r2m4\" (UID: \"0db5b872-c887-4039-97d8-8c0d2100db53\") " pod="kuadrant-system/authorino-5d4b67c446-6r2m4"
Jul 23 13:50:16.757826 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:16.757794    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6r2m4"]
Jul 23 13:50:16.758087 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:16.758072    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-6r2m4"
Jul 23 13:50:16.782969 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:16.782942    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76877994-9jdgz"]
Jul 23 13:50:16.788365 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:16.788345    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-9jdgz"
Jul 23 13:50:16.791064 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:16.791044    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 23 13:50:16.793651 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:16.793631    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76877994-9jdgz"]
Jul 23 13:50:16.831443 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:16.831413    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-9jdgz"]
Jul 23 13:50:16.831693 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:50:16.831673    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-db7l9 tls-cert], unattached volumes=[], failed to process volumes=[kube-api-access-db7l9 tls-cert]: context canceled" pod="kuadrant-system/authorino-76877994-9jdgz" podUID="bda96d23-f6de-4ded-830a-f660a9bd3624"
Jul 23 13:50:16.858373 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:16.858342    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-774cd78d5c-8dv77"]
Jul 23 13:50:16.862273 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:16.862248    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-774cd78d5c-8dv77"
Jul 23 13:50:16.871324 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:16.871298    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-774cd78d5c-8dv77"]
Jul 23 13:50:16.891780 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:16.891741    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvbtn\" (UniqueName: \"kubernetes.io/projected/cd5b06e0-7dd8-4a48-92b0-0309cdcbf337-kube-api-access-tvbtn\") pod \"authorino-774cd78d5c-8dv77\" (UID: \"cd5b06e0-7dd8-4a48-92b0-0309cdcbf337\") " pod="kuadrant-system/authorino-774cd78d5c-8dv77"
Jul 23 13:50:16.891915 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:16.891784    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bda96d23-f6de-4ded-830a-f660a9bd3624-tls-cert\") pod \"authorino-76877994-9jdgz\" (UID: \"bda96d23-f6de-4ded-830a-f660a9bd3624\") " pod="kuadrant-system/authorino-76877994-9jdgz"
Jul 23 13:50:16.891915 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:16.891831    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-db7l9\" (UniqueName: \"kubernetes.io/projected/bda96d23-f6de-4ded-830a-f660a9bd3624-kube-api-access-db7l9\") pod \"authorino-76877994-9jdgz\" (UID: \"bda96d23-f6de-4ded-830a-f660a9bd3624\") " pod="kuadrant-system/authorino-76877994-9jdgz"
Jul 23 13:50:16.892029 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:16.891920    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cd5b06e0-7dd8-4a48-92b0-0309cdcbf337-tls-cert\") pod \"authorino-774cd78d5c-8dv77\" (UID: \"cd5b06e0-7dd8-4a48-92b0-0309cdcbf337\") " pod="kuadrant-system/authorino-774cd78d5c-8dv77"
Jul 23 13:50:16.899150 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:16.899127    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6r2m4"]
Jul 23 13:50:16.901145 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:50:16.901121    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0db5b872_c887_4039_97d8_8c0d2100db53.slice/crio-d70795f51b84dcf398605075b7858121b45f11ec96d7d2b7dd7c26f63f4da7e0 WatchSource:0}: Error finding container d70795f51b84dcf398605075b7858121b45f11ec96d7d2b7dd7c26f63f4da7e0: Status 404 returned error can't find the container with id d70795f51b84dcf398605075b7858121b45f11ec96d7d2b7dd7c26f63f4da7e0
Jul 23 13:50:16.972897 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:16.972862    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-6r2m4" event={"ID":"0db5b872-c887-4039-97d8-8c0d2100db53","Type":"ContainerStarted","Data":"d70795f51b84dcf398605075b7858121b45f11ec96d7d2b7dd7c26f63f4da7e0"}
Jul 23 13:50:16.973305 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:16.972906    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-9jdgz"
Jul 23 13:50:16.980628 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:16.980610    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-9jdgz"
Jul 23 13:50:16.992358 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:16.992334    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cd5b06e0-7dd8-4a48-92b0-0309cdcbf337-tls-cert\") pod \"authorino-774cd78d5c-8dv77\" (UID: \"cd5b06e0-7dd8-4a48-92b0-0309cdcbf337\") " pod="kuadrant-system/authorino-774cd78d5c-8dv77"
Jul 23 13:50:16.992463 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:16.992389    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvbtn\" (UniqueName: \"kubernetes.io/projected/cd5b06e0-7dd8-4a48-92b0-0309cdcbf337-kube-api-access-tvbtn\") pod \"authorino-774cd78d5c-8dv77\" (UID: \"cd5b06e0-7dd8-4a48-92b0-0309cdcbf337\") " pod="kuadrant-system/authorino-774cd78d5c-8dv77"
Jul 23 13:50:16.992463 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:16.992410    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bda96d23-f6de-4ded-830a-f660a9bd3624-tls-cert\") pod \"authorino-76877994-9jdgz\" (UID: \"bda96d23-f6de-4ded-830a-f660a9bd3624\") " pod="kuadrant-system/authorino-76877994-9jdgz"
Jul 23 13:50:16.992463 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:16.992426    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-db7l9\" (UniqueName: \"kubernetes.io/projected/bda96d23-f6de-4ded-830a-f660a9bd3624-kube-api-access-db7l9\") pod \"authorino-76877994-9jdgz\" (UID: \"bda96d23-f6de-4ded-830a-f660a9bd3624\") " pod="kuadrant-system/authorino-76877994-9jdgz"
Jul 23 13:50:16.994660 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:16.994638    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bda96d23-f6de-4ded-830a-f660a9bd3624-tls-cert\") pod \"authorino-76877994-9jdgz\" (UID: \"bda96d23-f6de-4ded-830a-f660a9bd3624\") " pod="kuadrant-system/authorino-76877994-9jdgz"
Jul 23 13:50:16.994747 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:16.994679    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cd5b06e0-7dd8-4a48-92b0-0309cdcbf337-tls-cert\") pod \"authorino-774cd78d5c-8dv77\" (UID: \"cd5b06e0-7dd8-4a48-92b0-0309cdcbf337\") " pod="kuadrant-system/authorino-774cd78d5c-8dv77"
Jul 23 13:50:16.999840 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:16.999811    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvbtn\" (UniqueName: \"kubernetes.io/projected/cd5b06e0-7dd8-4a48-92b0-0309cdcbf337-kube-api-access-tvbtn\") pod \"authorino-774cd78d5c-8dv77\" (UID: \"cd5b06e0-7dd8-4a48-92b0-0309cdcbf337\") " pod="kuadrant-system/authorino-774cd78d5c-8dv77"
Jul 23 13:50:16.999982 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:16.999962    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-db7l9\" (UniqueName: \"kubernetes.io/projected/bda96d23-f6de-4ded-830a-f660a9bd3624-kube-api-access-db7l9\") pod \"authorino-76877994-9jdgz\" (UID: \"bda96d23-f6de-4ded-830a-f660a9bd3624\") " pod="kuadrant-system/authorino-76877994-9jdgz"
Jul 23 13:50:17.093374 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:17.093305    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bda96d23-f6de-4ded-830a-f660a9bd3624-tls-cert\") pod \"bda96d23-f6de-4ded-830a-f660a9bd3624\" (UID: \"bda96d23-f6de-4ded-830a-f660a9bd3624\") "
Jul 23 13:50:17.093374 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:17.093360    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-db7l9\" (UniqueName: \"kubernetes.io/projected/bda96d23-f6de-4ded-830a-f660a9bd3624-kube-api-access-db7l9\") pod \"bda96d23-f6de-4ded-830a-f660a9bd3624\" (UID: \"bda96d23-f6de-4ded-830a-f660a9bd3624\") "
Jul 23 13:50:17.095953 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:17.095927    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bda96d23-f6de-4ded-830a-f660a9bd3624-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "bda96d23-f6de-4ded-830a-f660a9bd3624" (UID: "bda96d23-f6de-4ded-830a-f660a9bd3624"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 13:50:17.096087 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:17.095954    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bda96d23-f6de-4ded-830a-f660a9bd3624-kube-api-access-db7l9" (OuterVolumeSpecName: "kube-api-access-db7l9") pod "bda96d23-f6de-4ded-830a-f660a9bd3624" (UID: "bda96d23-f6de-4ded-830a-f660a9bd3624"). InnerVolumeSpecName "kube-api-access-db7l9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:50:17.175280 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:17.175248    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-774cd78d5c-8dv77"
Jul 23 13:50:17.195152 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:17.195127    2573 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bda96d23-f6de-4ded-830a-f660a9bd3624-tls-cert\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 13:50:17.195243 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:17.195158    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-db7l9\" (UniqueName: \"kubernetes.io/projected/bda96d23-f6de-4ded-830a-f660a9bd3624-kube-api-access-db7l9\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 13:50:17.330453 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:17.330429    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-774cd78d5c-8dv77"]
Jul 23 13:50:17.331484 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:50:17.331417    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcd5b06e0_7dd8_4a48_92b0_0309cdcbf337.slice/crio-2d892dcf2390cedd3933830b8fdbcbd63d1283bc0b68bbc2bc26469157d97836 WatchSource:0}: Error finding container 2d892dcf2390cedd3933830b8fdbcbd63d1283bc0b68bbc2bc26469157d97836: Status 404 returned error can't find the container with id 2d892dcf2390cedd3933830b8fdbcbd63d1283bc0b68bbc2bc26469157d97836
Jul 23 13:50:17.980543 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:17.980457    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-774cd78d5c-8dv77" event={"ID":"cd5b06e0-7dd8-4a48-92b0-0309cdcbf337","Type":"ContainerStarted","Data":"c3b65835cf7027c2cf19f715f584afc1558850346a4dd16988ee1e1f91092ddc"}
Jul 23 13:50:17.980543 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:17.980504    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-774cd78d5c-8dv77" event={"ID":"cd5b06e0-7dd8-4a48-92b0-0309cdcbf337","Type":"ContainerStarted","Data":"2d892dcf2390cedd3933830b8fdbcbd63d1283bc0b68bbc2bc26469157d97836"}
Jul 23 13:50:17.982005 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:17.981976    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-6r2m4" event={"ID":"0db5b872-c887-4039-97d8-8c0d2100db53","Type":"ContainerStarted","Data":"8c285906dd364575965c0953c2bcc740eec0fbe81620b4ad3be22636163483a6"}
Jul 23 13:50:17.982005 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:17.981998    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-9jdgz"
Jul 23 13:50:17.982153 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:17.982033    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-6r2m4" podUID="0db5b872-c887-4039-97d8-8c0d2100db53" containerName="authorino" containerID="cri-o://8c285906dd364575965c0953c2bcc740eec0fbe81620b4ad3be22636163483a6" gracePeriod=30
Jul 23 13:50:17.996668 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:17.996629    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-774cd78d5c-8dv77" podStartSLOduration=1.4585753000000001 podStartE2EDuration="1.996614455s" totalImagesPullingTime="538.039155ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:50:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:50:17.996479599 +0000 UTC m=+589.435980519" watchObservedRunningTime="2026-07-23 13:50:17.996614455 +0000 UTC m=+589.436115374"
Jul 23 13:50:18.022190 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:18.022153    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-9jdgz"]
Jul 23 13:50:18.032327 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:18.032108    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-76877994-9jdgz"]
Jul 23 13:50:18.056301 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:18.056238    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-6r2m4" podStartSLOduration=1.694219984 podStartE2EDuration="2.056220933s" totalImagesPullingTime="362.000949ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:50:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:50:18.053548028 +0000 UTC m=+589.493048954" watchObservedRunningTime="2026-07-23 13:50:18.056220933 +0000 UTC m=+589.495721887"
Jul 23 13:50:18.257439 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:18.257362    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-6r2m4"
Jul 23 13:50:18.305683 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:18.305651    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fp9vl\" (UniqueName: \"kubernetes.io/projected/0db5b872-c887-4039-97d8-8c0d2100db53-kube-api-access-fp9vl\") pod \"0db5b872-c887-4039-97d8-8c0d2100db53\" (UID: \"0db5b872-c887-4039-97d8-8c0d2100db53\") "
Jul 23 13:50:18.307643 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:18.307619    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0db5b872-c887-4039-97d8-8c0d2100db53-kube-api-access-fp9vl" (OuterVolumeSpecName: "kube-api-access-fp9vl") pod "0db5b872-c887-4039-97d8-8c0d2100db53" (UID: "0db5b872-c887-4039-97d8-8c0d2100db53"). InnerVolumeSpecName "kube-api-access-fp9vl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:50:18.407137 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:18.407106    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fp9vl\" (UniqueName: \"kubernetes.io/projected/0db5b872-c887-4039-97d8-8c0d2100db53-kube-api-access-fp9vl\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 13:50:18.989839 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:18.989751    2573 generic.go:356] "Generic (PLEG): container finished" podID="0db5b872-c887-4039-97d8-8c0d2100db53" containerID="8c285906dd364575965c0953c2bcc740eec0fbe81620b4ad3be22636163483a6" exitCode=0
Jul 23 13:50:18.989839 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:18.989796    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-6r2m4"
Jul 23 13:50:18.990340 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:18.989840    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-6r2m4" event={"ID":"0db5b872-c887-4039-97d8-8c0d2100db53","Type":"ContainerDied","Data":"8c285906dd364575965c0953c2bcc740eec0fbe81620b4ad3be22636163483a6"}
Jul 23 13:50:18.990340 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:18.989884    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-6r2m4" event={"ID":"0db5b872-c887-4039-97d8-8c0d2100db53","Type":"ContainerDied","Data":"d70795f51b84dcf398605075b7858121b45f11ec96d7d2b7dd7c26f63f4da7e0"}
Jul 23 13:50:18.990340 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:18.989902    2573 scope.go:117] "RemoveContainer" containerID="8c285906dd364575965c0953c2bcc740eec0fbe81620b4ad3be22636163483a6"
Jul 23 13:50:18.998770 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:18.998753    2573 scope.go:117] "RemoveContainer" containerID="8c285906dd364575965c0953c2bcc740eec0fbe81620b4ad3be22636163483a6"
Jul 23 13:50:18.999068 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:50:18.999048    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c285906dd364575965c0953c2bcc740eec0fbe81620b4ad3be22636163483a6\": container with ID starting with 8c285906dd364575965c0953c2bcc740eec0fbe81620b4ad3be22636163483a6 not found: ID does not exist" containerID="8c285906dd364575965c0953c2bcc740eec0fbe81620b4ad3be22636163483a6"
Jul 23 13:50:18.999129 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:18.999076    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c285906dd364575965c0953c2bcc740eec0fbe81620b4ad3be22636163483a6"} err="failed to get container status \"8c285906dd364575965c0953c2bcc740eec0fbe81620b4ad3be22636163483a6\": rpc error: code = NotFound desc = could not find container \"8c285906dd364575965c0953c2bcc740eec0fbe81620b4ad3be22636163483a6\": container with ID starting with 8c285906dd364575965c0953c2bcc740eec0fbe81620b4ad3be22636163483a6 not found: ID does not exist"
Jul 23 13:50:19.013488 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:19.013454    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6r2m4"]
Jul 23 13:50:19.016794 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:19.016771    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6r2m4"]
Jul 23 13:50:19.068571 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:19.068532    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0db5b872-c887-4039-97d8-8c0d2100db53" path="/var/lib/kubelet/pods/0db5b872-c887-4039-97d8-8c0d2100db53/volumes"
Jul 23 13:50:19.068981 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:19.068959    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bda96d23-f6de-4ded-830a-f660a9bd3624" path="/var/lib/kubelet/pods/bda96d23-f6de-4ded-830a-f660a9bd3624/volumes"
Jul 23 13:50:22.882363 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:22.882328    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-564487fdc4-ndjc7"]
Jul 23 13:50:22.882904 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:22.882883    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0db5b872-c887-4039-97d8-8c0d2100db53" containerName="authorino"
Jul 23 13:50:22.882982 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:22.882907    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="0db5b872-c887-4039-97d8-8c0d2100db53" containerName="authorino"
Jul 23 13:50:22.883068 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:22.883003    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="0db5b872-c887-4039-97d8-8c0d2100db53" containerName="authorino"
Jul 23 13:50:22.986439 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:22.986404    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:50:23.100502 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:23.100457    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:50:23.116686 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:23.116657    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-564487fdc4-ndjc7"]
Jul 23 13:50:23.116831 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:23.116754    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-564487fdc4-ndjc7"
Jul 23 13:50:23.120287 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:23.120251    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 23 13:50:23.120431 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:23.120404    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 23 13:50:23.120513 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:23.120405    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-fq92w\""
Jul 23 13:50:23.124026 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:23.123997    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-c95bb4b5c-ft9bm"]
Jul 23 13:50:23.146751 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:23.146682    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-c95bb4b5c-ft9bm"]
Jul 23 13:50:23.146872 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:23.146780    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c95bb4b5c-ft9bm"
Jul 23 13:50:23.245987 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:23.245943    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jw65n\" (UniqueName: \"kubernetes.io/projected/966a7353-7206-4eeb-8717-ea16a33768d4-kube-api-access-jw65n\") pod \"maas-controller-c95bb4b5c-ft9bm\" (UID: \"966a7353-7206-4eeb-8717-ea16a33768d4\") " pod="opendatahub/maas-controller-c95bb4b5c-ft9bm"
Jul 23 13:50:23.246205 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:23.246002    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/966a7353-7206-4eeb-8717-ea16a33768d4-webhook-cert\") pod \"maas-controller-c95bb4b5c-ft9bm\" (UID: \"966a7353-7206-4eeb-8717-ea16a33768d4\") " pod="opendatahub/maas-controller-c95bb4b5c-ft9bm"
Jul 23 13:50:23.246205 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:23.246086    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4a5e957d-359e-47f4-9f18-cf731cd1137a-webhook-cert\") pod \"maas-controller-564487fdc4-ndjc7\" (UID: \"4a5e957d-359e-47f4-9f18-cf731cd1137a\") " pod="opendatahub/maas-controller-564487fdc4-ndjc7"
Jul 23 13:50:23.246205 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:23.246137    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9glc\" (UniqueName: \"kubernetes.io/projected/4a5e957d-359e-47f4-9f18-cf731cd1137a-kube-api-access-l9glc\") pod \"maas-controller-564487fdc4-ndjc7\" (UID: \"4a5e957d-359e-47f4-9f18-cf731cd1137a\") " pod="opendatahub/maas-controller-564487fdc4-ndjc7"
Jul 23 13:50:23.326415 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:23.326377    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:50:23.346724 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:23.346687    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jw65n\" (UniqueName: \"kubernetes.io/projected/966a7353-7206-4eeb-8717-ea16a33768d4-kube-api-access-jw65n\") pod \"maas-controller-c95bb4b5c-ft9bm\" (UID: \"966a7353-7206-4eeb-8717-ea16a33768d4\") " pod="opendatahub/maas-controller-c95bb4b5c-ft9bm"
Jul 23 13:50:23.346915 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:23.346734    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/966a7353-7206-4eeb-8717-ea16a33768d4-webhook-cert\") pod \"maas-controller-c95bb4b5c-ft9bm\" (UID: \"966a7353-7206-4eeb-8717-ea16a33768d4\") " pod="opendatahub/maas-controller-c95bb4b5c-ft9bm"
Jul 23 13:50:23.346915 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:23.346779    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4a5e957d-359e-47f4-9f18-cf731cd1137a-webhook-cert\") pod \"maas-controller-564487fdc4-ndjc7\" (UID: \"4a5e957d-359e-47f4-9f18-cf731cd1137a\") " pod="opendatahub/maas-controller-564487fdc4-ndjc7"
Jul 23 13:50:23.346915 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:23.346805    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9glc\" (UniqueName: \"kubernetes.io/projected/4a5e957d-359e-47f4-9f18-cf731cd1137a-kube-api-access-l9glc\") pod \"maas-controller-564487fdc4-ndjc7\" (UID: \"4a5e957d-359e-47f4-9f18-cf731cd1137a\") " pod="opendatahub/maas-controller-564487fdc4-ndjc7"
Jul 23 13:50:23.349265 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:23.349241    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/966a7353-7206-4eeb-8717-ea16a33768d4-webhook-cert\") pod \"maas-controller-c95bb4b5c-ft9bm\" (UID: \"966a7353-7206-4eeb-8717-ea16a33768d4\") " pod="opendatahub/maas-controller-c95bb4b5c-ft9bm"
Jul 23 13:50:23.349394 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:23.349372    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4a5e957d-359e-47f4-9f18-cf731cd1137a-webhook-cert\") pod \"maas-controller-564487fdc4-ndjc7\" (UID: \"4a5e957d-359e-47f4-9f18-cf731cd1137a\") " pod="opendatahub/maas-controller-564487fdc4-ndjc7"
Jul 23 13:50:23.356143 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:23.356123    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jw65n\" (UniqueName: \"kubernetes.io/projected/966a7353-7206-4eeb-8717-ea16a33768d4-kube-api-access-jw65n\") pod \"maas-controller-c95bb4b5c-ft9bm\" (UID: \"966a7353-7206-4eeb-8717-ea16a33768d4\") " pod="opendatahub/maas-controller-c95bb4b5c-ft9bm"
Jul 23 13:50:23.356234 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:23.356157    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9glc\" (UniqueName: \"kubernetes.io/projected/4a5e957d-359e-47f4-9f18-cf731cd1137a-kube-api-access-l9glc\") pod \"maas-controller-564487fdc4-ndjc7\" (UID: \"4a5e957d-359e-47f4-9f18-cf731cd1137a\") " pod="opendatahub/maas-controller-564487fdc4-ndjc7"
Jul 23 13:50:23.428625 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:23.428533    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-564487fdc4-ndjc7"
Jul 23 13:50:23.457199 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:23.457166    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c95bb4b5c-ft9bm"
Jul 23 13:50:23.580345 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:23.580311    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-564487fdc4-ndjc7"]
Jul 23 13:50:23.582611 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:50:23.582563    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a5e957d_359e_47f4_9f18_cf731cd1137a.slice/crio-cfadf42db047a667f8810ea493c53228a46f9bc1bc201e45ecc375a4cb9bc213 WatchSource:0}: Error finding container cfadf42db047a667f8810ea493c53228a46f9bc1bc201e45ecc375a4cb9bc213: Status 404 returned error can't find the container with id cfadf42db047a667f8810ea493c53228a46f9bc1bc201e45ecc375a4cb9bc213
Jul 23 13:50:23.614321 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:23.614295    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-c95bb4b5c-ft9bm"]
Jul 23 13:50:23.616107 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:50:23.616081    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod966a7353_7206_4eeb_8717_ea16a33768d4.slice/crio-fd9acaccd305c44fb0c0cd65b07c265b2175fe4373f481a884bce816597d7a58 WatchSource:0}: Error finding container fd9acaccd305c44fb0c0cd65b07c265b2175fe4373f481a884bce816597d7a58: Status 404 returned error can't find the container with id fd9acaccd305c44fb0c0cd65b07c265b2175fe4373f481a884bce816597d7a58
Jul 23 13:50:24.018237 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:24.018199    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c95bb4b5c-ft9bm" event={"ID":"966a7353-7206-4eeb-8717-ea16a33768d4","Type":"ContainerStarted","Data":"fd9acaccd305c44fb0c0cd65b07c265b2175fe4373f481a884bce816597d7a58"}
Jul 23 13:50:24.019361 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:24.019342    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-564487fdc4-ndjc7" event={"ID":"4a5e957d-359e-47f4-9f18-cf731cd1137a","Type":"ContainerStarted","Data":"cfadf42db047a667f8810ea493c53228a46f9bc1bc201e45ecc375a4cb9bc213"}
Jul 23 13:50:26.351616 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:26.351578    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:50:26.463098 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:26.462997    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:50:27.045753 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:27.045705    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-564487fdc4-ndjc7" event={"ID":"4a5e957d-359e-47f4-9f18-cf731cd1137a","Type":"ContainerStarted","Data":"93979bb589cb57fd55aedccf6fa5125f1ee58818cf6a6c1d4a217123975ae215"}
Jul 23 13:50:27.046062 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:27.046038    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-564487fdc4-ndjc7"
Jul 23 13:50:27.047348 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:27.047317    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c95bb4b5c-ft9bm" event={"ID":"966a7353-7206-4eeb-8717-ea16a33768d4","Type":"ContainerStarted","Data":"61dc6532c6329d22212352ecaedc2acbe4198f6fa4511f750dc70bf90c16bfaa"}
Jul 23 13:50:27.047462 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:27.047366    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-c95bb4b5c-ft9bm"
Jul 23 13:50:27.068644 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:27.068600    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-564487fdc4-ndjc7" podStartSLOduration=2.46504077 podStartE2EDuration="5.068576959s" totalImagesPullingTime="2.603536189s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:50:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:50:27.067439183 +0000 UTC m=+598.506940104" watchObservedRunningTime="2026-07-23 13:50:27.068576959 +0000 UTC m=+598.508077877"
Jul 23 13:50:27.089235 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:27.089188    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-c95bb4b5c-ft9bm" podStartSLOduration=1.5296133790000002 podStartE2EDuration="4.089173674s" totalImagesPullingTime="2.559560295s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:50:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:50:27.086825304 +0000 UTC m=+598.526326223" watchObservedRunningTime="2026-07-23 13:50:27.089173674 +0000 UTC m=+598.528674592"
Jul 23 13:50:28.979129 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:28.979101    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-vh5dp_2d624703-978f-48c2-b02d-9af8fd337236/console-operator/1.log"
Jul 23 13:50:28.979610 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:28.979100    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-vh5dp_2d624703-978f-48c2-b02d-9af8fd337236/console-operator/1.log"
Jul 23 13:50:38.055633 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:38.055600    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-c95bb4b5c-ft9bm"
Jul 23 13:50:38.058000 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:38.055679    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-564487fdc4-ndjc7"
Jul 23 13:50:38.129424 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:38.129388    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-564487fdc4-ndjc7"]
Jul 23 13:50:38.129668 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:38.129621    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-564487fdc4-ndjc7" podUID="4a5e957d-359e-47f4-9f18-cf731cd1137a" containerName="manager" containerID="cri-o://93979bb589cb57fd55aedccf6fa5125f1ee58818cf6a6c1d4a217123975ae215" gracePeriod=30
Jul 23 13:50:38.386445 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:38.386421    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-564487fdc4-ndjc7"
Jul 23 13:50:38.484347 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:38.484316    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4a5e957d-359e-47f4-9f18-cf731cd1137a-webhook-cert\") pod \"4a5e957d-359e-47f4-9f18-cf731cd1137a\" (UID: \"4a5e957d-359e-47f4-9f18-cf731cd1137a\") "
Jul 23 13:50:38.484528 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:38.484406    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l9glc\" (UniqueName: \"kubernetes.io/projected/4a5e957d-359e-47f4-9f18-cf731cd1137a-kube-api-access-l9glc\") pod \"4a5e957d-359e-47f4-9f18-cf731cd1137a\" (UID: \"4a5e957d-359e-47f4-9f18-cf731cd1137a\") "
Jul 23 13:50:38.486462 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:38.486428    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a5e957d-359e-47f4-9f18-cf731cd1137a-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "4a5e957d-359e-47f4-9f18-cf731cd1137a" (UID: "4a5e957d-359e-47f4-9f18-cf731cd1137a"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 13:50:38.486574 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:38.486517    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a5e957d-359e-47f4-9f18-cf731cd1137a-kube-api-access-l9glc" (OuterVolumeSpecName: "kube-api-access-l9glc") pod "4a5e957d-359e-47f4-9f18-cf731cd1137a" (UID: "4a5e957d-359e-47f4-9f18-cf731cd1137a"). InnerVolumeSpecName "kube-api-access-l9glc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:50:38.585362 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:38.585325    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l9glc\" (UniqueName: \"kubernetes.io/projected/4a5e957d-359e-47f4-9f18-cf731cd1137a-kube-api-access-l9glc\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 13:50:38.585362 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:38.585361    2573 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4a5e957d-359e-47f4-9f18-cf731cd1137a-webhook-cert\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 13:50:39.113787 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:39.113751    2573 generic.go:356] "Generic (PLEG): container finished" podID="4a5e957d-359e-47f4-9f18-cf731cd1137a" containerID="93979bb589cb57fd55aedccf6fa5125f1ee58818cf6a6c1d4a217123975ae215" exitCode=0
Jul 23 13:50:39.114228 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:39.113794    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-564487fdc4-ndjc7"
Jul 23 13:50:39.114228 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:39.113813    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-564487fdc4-ndjc7" event={"ID":"4a5e957d-359e-47f4-9f18-cf731cd1137a","Type":"ContainerDied","Data":"93979bb589cb57fd55aedccf6fa5125f1ee58818cf6a6c1d4a217123975ae215"}
Jul 23 13:50:39.114228 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:39.113864    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-564487fdc4-ndjc7" event={"ID":"4a5e957d-359e-47f4-9f18-cf731cd1137a","Type":"ContainerDied","Data":"cfadf42db047a667f8810ea493c53228a46f9bc1bc201e45ecc375a4cb9bc213"}
Jul 23 13:50:39.114228 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:39.113894    2573 scope.go:117] "RemoveContainer" containerID="93979bb589cb57fd55aedccf6fa5125f1ee58818cf6a6c1d4a217123975ae215"
Jul 23 13:50:39.123111 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:39.123093    2573 scope.go:117] "RemoveContainer" containerID="93979bb589cb57fd55aedccf6fa5125f1ee58818cf6a6c1d4a217123975ae215"
Jul 23 13:50:39.123347 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:50:39.123328    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93979bb589cb57fd55aedccf6fa5125f1ee58818cf6a6c1d4a217123975ae215\": container with ID starting with 93979bb589cb57fd55aedccf6fa5125f1ee58818cf6a6c1d4a217123975ae215 not found: ID does not exist" containerID="93979bb589cb57fd55aedccf6fa5125f1ee58818cf6a6c1d4a217123975ae215"
Jul 23 13:50:39.123414 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:39.123356    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93979bb589cb57fd55aedccf6fa5125f1ee58818cf6a6c1d4a217123975ae215"} err="failed to get container status \"93979bb589cb57fd55aedccf6fa5125f1ee58818cf6a6c1d4a217123975ae215\": rpc error: code = NotFound desc = could not find container \"93979bb589cb57fd55aedccf6fa5125f1ee58818cf6a6c1d4a217123975ae215\": container with ID starting with 93979bb589cb57fd55aedccf6fa5125f1ee58818cf6a6c1d4a217123975ae215 not found: ID does not exist"
Jul 23 13:50:39.132202 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:39.132181    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-564487fdc4-ndjc7"]
Jul 23 13:50:39.134464 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:39.134443    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-564487fdc4-ndjc7"]
Jul 23 13:50:41.068097 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:41.068064    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a5e957d-359e-47f4-9f18-cf731cd1137a" path="/var/lib/kubelet/pods/4a5e957d-359e-47f4-9f18-cf731cd1137a/volumes"
Jul 23 13:50:58.234652 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:58.234619    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:50:59.015063 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:59.015004    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-db66f56d8-tmcvl"]
Jul 23 13:50:59.015508 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:59.015491    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a5e957d-359e-47f4-9f18-cf731cd1137a" containerName="manager"
Jul 23 13:50:59.015598 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:59.015511    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a5e957d-359e-47f4-9f18-cf731cd1137a" containerName="manager"
Jul 23 13:50:59.015668 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:59.015655    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a5e957d-359e-47f4-9f18-cf731cd1137a" containerName="manager"
Jul 23 13:50:59.018852 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:59.018831    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-db66f56d8-tmcvl"
Jul 23 13:50:59.021627 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:59.021607    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-c7g9j\""
Jul 23 13:50:59.022445 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:59.022429    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 23 13:50:59.031750 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:59.031724    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-db66f56d8-tmcvl"]
Jul 23 13:50:59.062394 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:59.062347    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9748a48-0a5a-422a-9dae-63e29e3a6905-openshift-service-ca\") pod \"maas-api-db66f56d8-tmcvl\" (UID: \"c9748a48-0a5a-422a-9dae-63e29e3a6905\") " pod="odh-ai-gateway-infra/maas-api-db66f56d8-tmcvl"
Jul 23 13:50:59.062574 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:59.062420    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqqwb\" (UniqueName: \"kubernetes.io/projected/c9748a48-0a5a-422a-9dae-63e29e3a6905-kube-api-access-qqqwb\") pod \"maas-api-db66f56d8-tmcvl\" (UID: \"c9748a48-0a5a-422a-9dae-63e29e3a6905\") " pod="odh-ai-gateway-infra/maas-api-db66f56d8-tmcvl"
Jul 23 13:50:59.062574 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:59.062461    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c9748a48-0a5a-422a-9dae-63e29e3a6905-maas-api-tls\") pod \"maas-api-db66f56d8-tmcvl\" (UID: \"c9748a48-0a5a-422a-9dae-63e29e3a6905\") " pod="odh-ai-gateway-infra/maas-api-db66f56d8-tmcvl"
Jul 23 13:50:59.162869 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:59.162833    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqqwb\" (UniqueName: \"kubernetes.io/projected/c9748a48-0a5a-422a-9dae-63e29e3a6905-kube-api-access-qqqwb\") pod \"maas-api-db66f56d8-tmcvl\" (UID: \"c9748a48-0a5a-422a-9dae-63e29e3a6905\") " pod="odh-ai-gateway-infra/maas-api-db66f56d8-tmcvl"
Jul 23 13:50:59.163196 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:59.162880    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c9748a48-0a5a-422a-9dae-63e29e3a6905-maas-api-tls\") pod \"maas-api-db66f56d8-tmcvl\" (UID: \"c9748a48-0a5a-422a-9dae-63e29e3a6905\") " pod="odh-ai-gateway-infra/maas-api-db66f56d8-tmcvl"
Jul 23 13:50:59.163196 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:59.162985    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9748a48-0a5a-422a-9dae-63e29e3a6905-openshift-service-ca\") pod \"maas-api-db66f56d8-tmcvl\" (UID: \"c9748a48-0a5a-422a-9dae-63e29e3a6905\") " pod="odh-ai-gateway-infra/maas-api-db66f56d8-tmcvl"
Jul 23 13:50:59.163784 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:59.163753    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9748a48-0a5a-422a-9dae-63e29e3a6905-openshift-service-ca\") pod \"maas-api-db66f56d8-tmcvl\" (UID: \"c9748a48-0a5a-422a-9dae-63e29e3a6905\") " pod="odh-ai-gateway-infra/maas-api-db66f56d8-tmcvl"
Jul 23 13:50:59.165794 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:59.165769    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c9748a48-0a5a-422a-9dae-63e29e3a6905-maas-api-tls\") pod \"maas-api-db66f56d8-tmcvl\" (UID: \"c9748a48-0a5a-422a-9dae-63e29e3a6905\") " pod="odh-ai-gateway-infra/maas-api-db66f56d8-tmcvl"
Jul 23 13:50:59.171578 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:59.171555    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqqwb\" (UniqueName: \"kubernetes.io/projected/c9748a48-0a5a-422a-9dae-63e29e3a6905-kube-api-access-qqqwb\") pod \"maas-api-db66f56d8-tmcvl\" (UID: \"c9748a48-0a5a-422a-9dae-63e29e3a6905\") " pod="odh-ai-gateway-infra/maas-api-db66f56d8-tmcvl"
Jul 23 13:50:59.329762 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:59.329725    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-db66f56d8-tmcvl"
Jul 23 13:50:59.487389 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:59.487298    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-db66f56d8-tmcvl"]
Jul 23 13:50:59.490224 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:50:59.490196    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9748a48_0a5a_422a_9dae_63e29e3a6905.slice/crio-1840e779050811e71ce81f916333940e9e1fa3cd92def8658c399ed216524aa8 WatchSource:0}: Error finding container 1840e779050811e71ce81f916333940e9e1fa3cd92def8658c399ed216524aa8: Status 404 returned error can't find the container with id 1840e779050811e71ce81f916333940e9e1fa3cd92def8658c399ed216524aa8
Jul 23 13:50:59.491831 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:59.491811    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 13:50:59.498156 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:59.498134    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-4nzgg"]
Jul 23 13:50:59.504277 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:59.504258    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-4nzgg"
Jul 23 13:50:59.509490 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:59.507080    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-bgw9w\""
Jul 23 13:50:59.509490 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:59.507168    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 23 13:50:59.518274 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:59.518247    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-4nzgg"]
Jul 23 13:50:59.567366 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:59.567326    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c594df9-fd3a-4a5f-8e48-e72e60dc73ea-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-4nzgg\" (UID: \"9c594df9-fd3a-4a5f-8e48-e72e60dc73ea\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-4nzgg"
Jul 23 13:50:59.567523 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:59.567440    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcdf6\" (UniqueName: \"kubernetes.io/projected/9c594df9-fd3a-4a5f-8e48-e72e60dc73ea-kube-api-access-qcdf6\") pod \"payload-pre-processing-7677b774bb-4nzgg\" (UID: \"9c594df9-fd3a-4a5f-8e48-e72e60dc73ea\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-4nzgg"
Jul 23 13:50:59.668623 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:59.668521    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcdf6\" (UniqueName: \"kubernetes.io/projected/9c594df9-fd3a-4a5f-8e48-e72e60dc73ea-kube-api-access-qcdf6\") pod \"payload-pre-processing-7677b774bb-4nzgg\" (UID: \"9c594df9-fd3a-4a5f-8e48-e72e60dc73ea\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-4nzgg"
Jul 23 13:50:59.668623 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:59.668580    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c594df9-fd3a-4a5f-8e48-e72e60dc73ea-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-4nzgg\" (UID: \"9c594df9-fd3a-4a5f-8e48-e72e60dc73ea\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-4nzgg"
Jul 23 13:50:59.669366 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:59.669344    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c594df9-fd3a-4a5f-8e48-e72e60dc73ea-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-4nzgg\" (UID: \"9c594df9-fd3a-4a5f-8e48-e72e60dc73ea\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-4nzgg"
Jul 23 13:50:59.678924 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:59.678899    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcdf6\" (UniqueName: \"kubernetes.io/projected/9c594df9-fd3a-4a5f-8e48-e72e60dc73ea-kube-api-access-qcdf6\") pod \"payload-pre-processing-7677b774bb-4nzgg\" (UID: \"9c594df9-fd3a-4a5f-8e48-e72e60dc73ea\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-4nzgg"
Jul 23 13:50:59.823109 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:59.823079    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-4nzgg"
Jul 23 13:50:59.960986 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:50:59.960956    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-4nzgg"]
Jul 23 13:50:59.962780 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:50:59.962754    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c594df9_fd3a_4a5f_8e48_e72e60dc73ea.slice/crio-86ca5fa912952d390f6851e8a264477f27ba37aafd8530a0a60f6794d8557262 WatchSource:0}: Error finding container 86ca5fa912952d390f6851e8a264477f27ba37aafd8530a0a60f6794d8557262: Status 404 returned error can't find the container with id 86ca5fa912952d390f6851e8a264477f27ba37aafd8530a0a60f6794d8557262
Jul 23 13:51:00.240627 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:00.240519    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-4nzgg" event={"ID":"9c594df9-fd3a-4a5f-8e48-e72e60dc73ea","Type":"ContainerStarted","Data":"86ca5fa912952d390f6851e8a264477f27ba37aafd8530a0a60f6794d8557262"}
Jul 23 13:51:00.242590 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:00.242553    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-db66f56d8-tmcvl" event={"ID":"c9748a48-0a5a-422a-9dae-63e29e3a6905","Type":"ContainerStarted","Data":"1840e779050811e71ce81f916333940e9e1fa3cd92def8658c399ed216524aa8"}
Jul 23 13:51:00.275310 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:00.275262    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:51:02.261333 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:02.261220    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-4nzgg" event={"ID":"9c594df9-fd3a-4a5f-8e48-e72e60dc73ea","Type":"ContainerStarted","Data":"5cb656977a8e8a25c5e9108e63ecbceedbbfc14ac92a9120fa525c72024ce775"}
Jul 23 13:51:02.261333 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:02.261302    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-4nzgg"
Jul 23 13:51:02.262915 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:02.262887    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-db66f56d8-tmcvl" event={"ID":"c9748a48-0a5a-422a-9dae-63e29e3a6905","Type":"ContainerStarted","Data":"0ed29442abbd3f0904aa4a1c2468431b152310bccfcfd7eb0037cb4b3eecd3a8"}
Jul 23 13:51:02.263056 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:02.262975    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-db66f56d8-tmcvl"
Jul 23 13:51:02.279093 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:02.279041    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7677b774bb-4nzgg" podStartSLOduration=1.077975441 podStartE2EDuration="3.279026537s" totalImagesPullingTime="2.201051096s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:50:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:51:02.277180641 +0000 UTC m=+633.716681561" watchObservedRunningTime="2026-07-23 13:51:02.279026537 +0000 UTC m=+633.718527450"
Jul 23 13:51:02.296678 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:02.296629    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-db66f56d8-tmcvl" podStartSLOduration=1.6288880369999998 podStartE2EDuration="4.29661302s" totalImagesPullingTime="2.667724983s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:50:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:51:02.294535181 +0000 UTC m=+633.734036101" watchObservedRunningTime="2026-07-23 13:51:02.29661302 +0000 UTC m=+633.736113940"
Jul 23 13:51:07.293077 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:07.293034    2573 generic.go:356] "Generic (PLEG): container finished" podID="384f08a3-63c6-4f6e-8848-247f6f59c6b9" containerID="4923d99a6a1a341f29c51d8baaf655f0073db68f2a371990d194bbf268afa2c4" exitCode=0
Jul 23 13:51:07.293500 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:07.293114    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zd65t" event={"ID":"384f08a3-63c6-4f6e-8848-247f6f59c6b9","Type":"ContainerDied","Data":"4923d99a6a1a341f29c51d8baaf655f0073db68f2a371990d194bbf268afa2c4"}
Jul 23 13:51:07.293547 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:07.293503    2573 scope.go:117] "RemoveContainer" containerID="4923d99a6a1a341f29c51d8baaf655f0073db68f2a371990d194bbf268afa2c4"
Jul 23 13:51:07.294527 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:07.294502    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 13:51:07.294578 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:07.294566    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 13:51:07.294618 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:07.294600    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 13:51:08.274897 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:08.274862    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-db66f56d8-tmcvl"
Jul 23 13:51:08.300657 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:08.300618    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zd65t" event={"ID":"384f08a3-63c6-4f6e-8848-247f6f59c6b9","Type":"ContainerStarted","Data":"f1ae3d9694dfbaa58b63bab5d98324de6885af9b14e99542a022e092c8372a04"}
Jul 23 13:51:08.548394 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:08.548343    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zd65t"
Jul 23 13:51:08.550126 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:08.550089    2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-zd65t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 23 13:51:08.550299 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:08.550149    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zd65t" podUID="384f08a3-63c6-4f6e-8848-247f6f59c6b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 23 13:51:09.549304 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:09.549251    2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-zd65t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 23 13:51:09.549831 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:09.549367    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zd65t" podUID="384f08a3-63c6-4f6e-8848-247f6f59c6b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 23 13:51:09.989841 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:09.989750    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:51:10.084904 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:10.084865    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:51:10.549342 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:10.549303    2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-zd65t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 23 13:51:10.549988 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:10.549955    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zd65t" podUID="384f08a3-63c6-4f6e-8848-247f6f59c6b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 23 13:51:11.548902 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:11.548858    2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-zd65t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 23 13:51:11.549240 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:11.549205    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zd65t" podUID="384f08a3-63c6-4f6e-8848-247f6f59c6b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 23 13:51:11.749146 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:11.749108    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zd65t"
Jul 23 13:51:12.552389 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:12.552362    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zd65t"
Jul 23 13:51:12.553471 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:12.553450    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zd65t"
Jul 23 13:51:13.271434 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:13.271399    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-4nzgg"
Jul 23 13:51:23.078873 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:23.078835    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:51:26.994791 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:26.994755    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f29pl"]
Jul 23 13:51:26.998380 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:26.998357    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f29pl"
Jul 23 13:51:27.001604 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:27.001582    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-djm7s\""
Jul 23 13:51:27.001812 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:27.001652    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 23 13:51:27.001812 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:27.001720    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 23 13:51:27.001947 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:27.001828    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 23 13:51:27.008853 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:27.008828    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f29pl"]
Jul 23 13:51:27.038152 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:27.038120    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:51:27.114874 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:27.114837    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df8bedc7-9980-4096-8939-65e5c331a1c8-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f29pl\" (UID: \"df8bedc7-9980-4096-8939-65e5c331a1c8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f29pl"
Jul 23 13:51:27.114874 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:27.114874    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df8bedc7-9980-4096-8939-65e5c331a1c8-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f29pl\" (UID: \"df8bedc7-9980-4096-8939-65e5c331a1c8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f29pl"
Jul 23 13:51:27.115173 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:27.114905    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df8bedc7-9980-4096-8939-65e5c331a1c8-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f29pl\" (UID: \"df8bedc7-9980-4096-8939-65e5c331a1c8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f29pl"
Jul 23 13:51:27.115173 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:27.115073    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df8bedc7-9980-4096-8939-65e5c331a1c8-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f29pl\" (UID: \"df8bedc7-9980-4096-8939-65e5c331a1c8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f29pl"
Jul 23 13:51:27.115173 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:27.115129    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfrll\" (UniqueName: \"kubernetes.io/projected/df8bedc7-9980-4096-8939-65e5c331a1c8-kube-api-access-gfrll\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f29pl\" (UID: \"df8bedc7-9980-4096-8939-65e5c331a1c8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f29pl"
Jul 23 13:51:27.115302 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:27.115192    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df8bedc7-9980-4096-8939-65e5c331a1c8-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f29pl\" (UID: \"df8bedc7-9980-4096-8939-65e5c331a1c8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f29pl"
Jul 23 13:51:27.216157 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:27.216127    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df8bedc7-9980-4096-8939-65e5c331a1c8-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f29pl\" (UID: \"df8bedc7-9980-4096-8939-65e5c331a1c8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f29pl"
Jul 23 13:51:27.216320 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:27.216182    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df8bedc7-9980-4096-8939-65e5c331a1c8-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f29pl\" (UID: \"df8bedc7-9980-4096-8939-65e5c331a1c8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f29pl"
Jul 23 13:51:27.216320 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:27.216225    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfrll\" (UniqueName: \"kubernetes.io/projected/df8bedc7-9980-4096-8939-65e5c331a1c8-kube-api-access-gfrll\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f29pl\" (UID: \"df8bedc7-9980-4096-8939-65e5c331a1c8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f29pl"
Jul 23 13:51:27.216320 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:27.216282    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df8bedc7-9980-4096-8939-65e5c331a1c8-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f29pl\" (UID: \"df8bedc7-9980-4096-8939-65e5c331a1c8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f29pl"
Jul 23 13:51:27.216456 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:27.216321    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df8bedc7-9980-4096-8939-65e5c331a1c8-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f29pl\" (UID: \"df8bedc7-9980-4096-8939-65e5c331a1c8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f29pl"
Jul 23 13:51:27.216510 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:27.216445    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df8bedc7-9980-4096-8939-65e5c331a1c8-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f29pl\" (UID: \"df8bedc7-9980-4096-8939-65e5c331a1c8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f29pl"
Jul 23 13:51:27.216581 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:27.216556    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df8bedc7-9980-4096-8939-65e5c331a1c8-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f29pl\" (UID: \"df8bedc7-9980-4096-8939-65e5c331a1c8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f29pl"
Jul 23 13:51:27.216581 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:27.216573    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df8bedc7-9980-4096-8939-65e5c331a1c8-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f29pl\" (UID: \"df8bedc7-9980-4096-8939-65e5c331a1c8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f29pl"
Jul 23 13:51:27.216747 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:27.216612    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df8bedc7-9980-4096-8939-65e5c331a1c8-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f29pl\" (UID: \"df8bedc7-9980-4096-8939-65e5c331a1c8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f29pl"
Jul 23 13:51:27.218518 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:27.218493    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df8bedc7-9980-4096-8939-65e5c331a1c8-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f29pl\" (UID: \"df8bedc7-9980-4096-8939-65e5c331a1c8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f29pl"
Jul 23 13:51:27.218876 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:27.218855    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df8bedc7-9980-4096-8939-65e5c331a1c8-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f29pl\" (UID: \"df8bedc7-9980-4096-8939-65e5c331a1c8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f29pl"
Jul 23 13:51:27.224455 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:27.224434    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfrll\" (UniqueName: \"kubernetes.io/projected/df8bedc7-9980-4096-8939-65e5c331a1c8-kube-api-access-gfrll\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f29pl\" (UID: \"df8bedc7-9980-4096-8939-65e5c331a1c8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f29pl"
Jul 23 13:51:27.310062 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:27.310027    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f29pl"
Jul 23 13:51:27.461723 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:27.461696    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f29pl"]
Jul 23 13:51:27.463158 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:51:27.463126    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf8bedc7_9980_4096_8939_65e5c331a1c8.slice/crio-235f0cf9fdd2796fa331a59b38b6ef16a718a3e1102ebe3da7173eef58e453d0 WatchSource:0}: Error finding container 235f0cf9fdd2796fa331a59b38b6ef16a718a3e1102ebe3da7173eef58e453d0: Status 404 returned error can't find the container with id 235f0cf9fdd2796fa331a59b38b6ef16a718a3e1102ebe3da7173eef58e453d0
Jul 23 13:51:28.423072 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:28.423037    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f29pl" event={"ID":"df8bedc7-9980-4096-8939-65e5c331a1c8","Type":"ContainerStarted","Data":"235f0cf9fdd2796fa331a59b38b6ef16a718a3e1102ebe3da7173eef58e453d0"}
Jul 23 13:51:30.440528 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:30.440490    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f29pl" event={"ID":"df8bedc7-9980-4096-8939-65e5c331a1c8","Type":"ContainerStarted","Data":"a3b2bbff6185863210c418c442bc95cb79e6ef2b1cd598c588fc8b404654916c"}
Jul 23 13:51:30.460435 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:30.460378    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f29pl" podStartSLOduration=2.28518035 podStartE2EDuration="4.460362812s" totalImagesPullingTime="2.175182462s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:51:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:51:30.458668879 +0000 UTC m=+661.898169799" watchObservedRunningTime="2026-07-23 13:51:30.460362812 +0000 UTC m=+661.899863731"
Jul 23 13:51:35.789948 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:35.789913    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-7pmgb"]
Jul 23 13:51:35.796552 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:35.796531    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7pmgb"
Jul 23 13:51:35.799432 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:35.799404    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 23 13:51:35.801545 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:35.801520    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-7pmgb"]
Jul 23 13:51:35.816973 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:35.816912    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:51:35.900088 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:35.900057    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlrdt\" (UniqueName: \"kubernetes.io/projected/98a8aaee-f477-422d-82d3-a7bcd0a5543d-kube-api-access-mlrdt\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7pmgb\" (UID: \"98a8aaee-f477-422d-82d3-a7bcd0a5543d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7pmgb"
Jul 23 13:51:35.900251 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:35.900107    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/98a8aaee-f477-422d-82d3-a7bcd0a5543d-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7pmgb\" (UID: \"98a8aaee-f477-422d-82d3-a7bcd0a5543d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7pmgb"
Jul 23 13:51:35.900251 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:35.900183    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/98a8aaee-f477-422d-82d3-a7bcd0a5543d-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7pmgb\" (UID: \"98a8aaee-f477-422d-82d3-a7bcd0a5543d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7pmgb"
Jul 23 13:51:35.900251 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:35.900219    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/98a8aaee-f477-422d-82d3-a7bcd0a5543d-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7pmgb\" (UID: \"98a8aaee-f477-422d-82d3-a7bcd0a5543d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7pmgb"
Jul 23 13:51:35.900381 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:35.900276    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/98a8aaee-f477-422d-82d3-a7bcd0a5543d-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7pmgb\" (UID: \"98a8aaee-f477-422d-82d3-a7bcd0a5543d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7pmgb"
Jul 23 13:51:35.900381 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:35.900299    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/98a8aaee-f477-422d-82d3-a7bcd0a5543d-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7pmgb\" (UID: \"98a8aaee-f477-422d-82d3-a7bcd0a5543d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7pmgb"
Jul 23 13:51:36.001694 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:36.001656    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/98a8aaee-f477-422d-82d3-a7bcd0a5543d-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7pmgb\" (UID: \"98a8aaee-f477-422d-82d3-a7bcd0a5543d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7pmgb"
Jul 23 13:51:36.001858 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:36.001715    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlrdt\" (UniqueName: \"kubernetes.io/projected/98a8aaee-f477-422d-82d3-a7bcd0a5543d-kube-api-access-mlrdt\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7pmgb\" (UID: \"98a8aaee-f477-422d-82d3-a7bcd0a5543d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7pmgb"
Jul 23 13:51:36.001858 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:36.001750    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/98a8aaee-f477-422d-82d3-a7bcd0a5543d-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7pmgb\" (UID: \"98a8aaee-f477-422d-82d3-a7bcd0a5543d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7pmgb"
Jul 23 13:51:36.001858 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:36.001779    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/98a8aaee-f477-422d-82d3-a7bcd0a5543d-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7pmgb\" (UID: \"98a8aaee-f477-422d-82d3-a7bcd0a5543d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7pmgb"
Jul 23 13:51:36.001858 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:36.001813    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/98a8aaee-f477-422d-82d3-a7bcd0a5543d-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7pmgb\" (UID: \"98a8aaee-f477-422d-82d3-a7bcd0a5543d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7pmgb"
Jul 23 13:51:36.002079 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:36.001861    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/98a8aaee-f477-422d-82d3-a7bcd0a5543d-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7pmgb\" (UID: \"98a8aaee-f477-422d-82d3-a7bcd0a5543d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7pmgb"
Jul 23 13:51:36.002145 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:36.002122    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/98a8aaee-f477-422d-82d3-a7bcd0a5543d-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7pmgb\" (UID: \"98a8aaee-f477-422d-82d3-a7bcd0a5543d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7pmgb"
Jul 23 13:51:36.002201 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:36.002177    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/98a8aaee-f477-422d-82d3-a7bcd0a5543d-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7pmgb\" (UID: \"98a8aaee-f477-422d-82d3-a7bcd0a5543d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7pmgb"
Jul 23 13:51:36.002311 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:36.002284    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/98a8aaee-f477-422d-82d3-a7bcd0a5543d-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7pmgb\" (UID: \"98a8aaee-f477-422d-82d3-a7bcd0a5543d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7pmgb"
Jul 23 13:51:36.004077 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:36.004056    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/98a8aaee-f477-422d-82d3-a7bcd0a5543d-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7pmgb\" (UID: \"98a8aaee-f477-422d-82d3-a7bcd0a5543d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7pmgb"
Jul 23 13:51:36.004243 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:36.004227    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/98a8aaee-f477-422d-82d3-a7bcd0a5543d-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7pmgb\" (UID: \"98a8aaee-f477-422d-82d3-a7bcd0a5543d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7pmgb"
Jul 23 13:51:36.009772 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:36.009751    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlrdt\" (UniqueName: \"kubernetes.io/projected/98a8aaee-f477-422d-82d3-a7bcd0a5543d-kube-api-access-mlrdt\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7pmgb\" (UID: \"98a8aaee-f477-422d-82d3-a7bcd0a5543d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7pmgb"
Jul 23 13:51:36.107774 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:36.107684    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7pmgb"
Jul 23 13:51:36.248930 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:36.248905    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-7pmgb"]
Jul 23 13:51:36.250588 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:51:36.250557    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98a8aaee_f477_422d_82d3_a7bcd0a5543d.slice/crio-fad248ef1eef2cb566464e6e0af4a47ed5dd7446cbfdb1698e0554dc6a4166ce WatchSource:0}: Error finding container fad248ef1eef2cb566464e6e0af4a47ed5dd7446cbfdb1698e0554dc6a4166ce: Status 404 returned error can't find the container with id fad248ef1eef2cb566464e6e0af4a47ed5dd7446cbfdb1698e0554dc6a4166ce
Jul 23 13:51:36.480105 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:36.479988    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7pmgb" event={"ID":"98a8aaee-f477-422d-82d3-a7bcd0a5543d","Type":"ContainerStarted","Data":"fad248ef1eef2cb566464e6e0af4a47ed5dd7446cbfdb1698e0554dc6a4166ce"}
Jul 23 13:51:37.310974 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:37.310937    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f29pl"
Jul 23 13:51:37.311470 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:37.311027    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f29pl"
Jul 23 13:51:37.324232 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:37.324200    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f29pl"
Jul 23 13:51:37.487435 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:37.487391    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7pmgb" event={"ID":"98a8aaee-f477-422d-82d3-a7bcd0a5543d","Type":"ContainerStarted","Data":"1db022eab7faa915910ebb9e9dbbcd46b0909d711df14f6df05a8041359ca3b2"}
Jul 23 13:51:37.498766 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:37.498740    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f29pl"
Jul 23 13:51:37.505914 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:37.505868    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7pmgb" podStartSLOduration=1.920880476 podStartE2EDuration="2.505844967s" totalImagesPullingTime="584.964491ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:51:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:51:37.504596245 +0000 UTC m=+668.944097204" watchObservedRunningTime="2026-07-23 13:51:37.505844967 +0000 UTC m=+668.945345883"
Jul 23 13:51:46.108051 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:46.108000    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7pmgb"
Jul 23 13:51:46.108534 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:46.108069    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7pmgb"
Jul 23 13:51:46.120916 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:46.120890    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7pmgb"
Jul 23 13:51:46.551352 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:46.551323    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7pmgb"
Jul 23 13:51:47.156588 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:47.156548    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:51:57.919579 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:51:57.919537    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:52:08.010942 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:52:08.010848    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:52:20.647035 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:52:20.646980    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:52:47.874100 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:52:47.874055    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:53:09.761829 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:53:09.761793    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:53:11.756412 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:53:11.756373    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:53:11.814502 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:53:11.814464    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:53:27.936160 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:53:27.936124    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:53:28.025257 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:53:28.025224    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:53:29.159210 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:53:29.159176    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:53:29.255359 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:53:29.255311    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:53:29.400722 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:53:29.400674    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-774cd78d5c-8dv77"]
Jul 23 13:53:29.401070 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:53:29.401000    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-774cd78d5c-8dv77" podUID="cd5b06e0-7dd8-4a48-92b0-0309cdcbf337" containerName="authorino" containerID="cri-o://c3b65835cf7027c2cf19f715f584afc1558850346a4dd16988ee1e1f91092ddc" gracePeriod=30
Jul 23 13:53:29.664891 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:53:29.664866    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-774cd78d5c-8dv77"
Jul 23 13:53:29.734191 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:53:29.734110    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cd5b06e0-7dd8-4a48-92b0-0309cdcbf337-tls-cert\") pod \"cd5b06e0-7dd8-4a48-92b0-0309cdcbf337\" (UID: \"cd5b06e0-7dd8-4a48-92b0-0309cdcbf337\") "
Jul 23 13:53:29.734338 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:53:29.734215    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tvbtn\" (UniqueName: \"kubernetes.io/projected/cd5b06e0-7dd8-4a48-92b0-0309cdcbf337-kube-api-access-tvbtn\") pod \"cd5b06e0-7dd8-4a48-92b0-0309cdcbf337\" (UID: \"cd5b06e0-7dd8-4a48-92b0-0309cdcbf337\") "
Jul 23 13:53:29.736235 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:53:29.736204    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd5b06e0-7dd8-4a48-92b0-0309cdcbf337-kube-api-access-tvbtn" (OuterVolumeSpecName: "kube-api-access-tvbtn") pod "cd5b06e0-7dd8-4a48-92b0-0309cdcbf337" (UID: "cd5b06e0-7dd8-4a48-92b0-0309cdcbf337"). InnerVolumeSpecName "kube-api-access-tvbtn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:53:29.745542 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:53:29.745520    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd5b06e0-7dd8-4a48-92b0-0309cdcbf337-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "cd5b06e0-7dd8-4a48-92b0-0309cdcbf337" (UID: "cd5b06e0-7dd8-4a48-92b0-0309cdcbf337"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 13:53:29.835406 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:53:29.835370    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tvbtn\" (UniqueName: \"kubernetes.io/projected/cd5b06e0-7dd8-4a48-92b0-0309cdcbf337-kube-api-access-tvbtn\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 13:53:29.835406 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:53:29.835402    2573 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cd5b06e0-7dd8-4a48-92b0-0309cdcbf337-tls-cert\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 13:53:30.152599 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:53:30.152565    2573 generic.go:356] "Generic (PLEG): container finished" podID="cd5b06e0-7dd8-4a48-92b0-0309cdcbf337" containerID="c3b65835cf7027c2cf19f715f584afc1558850346a4dd16988ee1e1f91092ddc" exitCode=0
Jul 23 13:53:30.152803 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:53:30.152613    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-774cd78d5c-8dv77"
Jul 23 13:53:30.152803 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:53:30.152649    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-774cd78d5c-8dv77" event={"ID":"cd5b06e0-7dd8-4a48-92b0-0309cdcbf337","Type":"ContainerDied","Data":"c3b65835cf7027c2cf19f715f584afc1558850346a4dd16988ee1e1f91092ddc"}
Jul 23 13:53:30.152803 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:53:30.152690    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-774cd78d5c-8dv77" event={"ID":"cd5b06e0-7dd8-4a48-92b0-0309cdcbf337","Type":"ContainerDied","Data":"2d892dcf2390cedd3933830b8fdbcbd63d1283bc0b68bbc2bc26469157d97836"}
Jul 23 13:53:30.152803 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:53:30.152706    2573 scope.go:117] "RemoveContainer" containerID="c3b65835cf7027c2cf19f715f584afc1558850346a4dd16988ee1e1f91092ddc"
Jul 23 13:53:30.162429 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:53:30.162414    2573 scope.go:117] "RemoveContainer" containerID="c3b65835cf7027c2cf19f715f584afc1558850346a4dd16988ee1e1f91092ddc"
Jul 23 13:53:30.162748 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:53:30.162693    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3b65835cf7027c2cf19f715f584afc1558850346a4dd16988ee1e1f91092ddc\": container with ID starting with c3b65835cf7027c2cf19f715f584afc1558850346a4dd16988ee1e1f91092ddc not found: ID does not exist" containerID="c3b65835cf7027c2cf19f715f584afc1558850346a4dd16988ee1e1f91092ddc"
Jul 23 13:53:30.162748 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:53:30.162714    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3b65835cf7027c2cf19f715f584afc1558850346a4dd16988ee1e1f91092ddc"} err="failed to get container status \"c3b65835cf7027c2cf19f715f584afc1558850346a4dd16988ee1e1f91092ddc\": rpc error: code = NotFound desc = could not find container \"c3b65835cf7027c2cf19f715f584afc1558850346a4dd16988ee1e1f91092ddc\": container with ID starting with c3b65835cf7027c2cf19f715f584afc1558850346a4dd16988ee1e1f91092ddc not found: ID does not exist"
Jul 23 13:53:30.183333 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:53:30.183311    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-774cd78d5c-8dv77"]
Jul 23 13:53:30.194791 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:53:30.194771    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-774cd78d5c-8dv77"]
Jul 23 13:53:31.067696 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:53:31.067659    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd5b06e0-7dd8-4a48-92b0-0309cdcbf337" path="/var/lib/kubelet/pods/cd5b06e0-7dd8-4a48-92b0-0309cdcbf337/volumes"
Jul 23 13:54:15.678064 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:54:15.678024    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-c95bb4b5c-ft9bm"]
Jul 23 13:54:15.678580 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:54:15.678263    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-c95bb4b5c-ft9bm" podUID="966a7353-7206-4eeb-8717-ea16a33768d4" containerName="manager" containerID="cri-o://61dc6532c6329d22212352ecaedc2acbe4198f6fa4511f750dc70bf90c16bfaa" gracePeriod=30
Jul 23 13:54:15.934113 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:54:15.934050    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c95bb4b5c-ft9bm"
Jul 23 13:54:15.957206 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:54:15.957160    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jw65n\" (UniqueName: \"kubernetes.io/projected/966a7353-7206-4eeb-8717-ea16a33768d4-kube-api-access-jw65n\") pod \"966a7353-7206-4eeb-8717-ea16a33768d4\" (UID: \"966a7353-7206-4eeb-8717-ea16a33768d4\") "
Jul 23 13:54:15.957387 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:54:15.957250    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/966a7353-7206-4eeb-8717-ea16a33768d4-webhook-cert\") pod \"966a7353-7206-4eeb-8717-ea16a33768d4\" (UID: \"966a7353-7206-4eeb-8717-ea16a33768d4\") "
Jul 23 13:54:15.961159 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:54:15.960976    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/966a7353-7206-4eeb-8717-ea16a33768d4-kube-api-access-jw65n" (OuterVolumeSpecName: "kube-api-access-jw65n") pod "966a7353-7206-4eeb-8717-ea16a33768d4" (UID: "966a7353-7206-4eeb-8717-ea16a33768d4"). InnerVolumeSpecName "kube-api-access-jw65n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:54:15.961159 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:54:15.961119    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/966a7353-7206-4eeb-8717-ea16a33768d4-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "966a7353-7206-4eeb-8717-ea16a33768d4" (UID: "966a7353-7206-4eeb-8717-ea16a33768d4"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 13:54:16.058784 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:54:16.058748    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jw65n\" (UniqueName: \"kubernetes.io/projected/966a7353-7206-4eeb-8717-ea16a33768d4-kube-api-access-jw65n\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 13:54:16.058968 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:54:16.058778    2573 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/966a7353-7206-4eeb-8717-ea16a33768d4-webhook-cert\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 13:54:16.419882 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:54:16.419843    2573 generic.go:356] "Generic (PLEG): container finished" podID="966a7353-7206-4eeb-8717-ea16a33768d4" containerID="61dc6532c6329d22212352ecaedc2acbe4198f6fa4511f750dc70bf90c16bfaa" exitCode=0
Jul 23 13:54:16.420100 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:54:16.419890    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c95bb4b5c-ft9bm"
Jul 23 13:54:16.420100 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:54:16.419928    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c95bb4b5c-ft9bm" event={"ID":"966a7353-7206-4eeb-8717-ea16a33768d4","Type":"ContainerDied","Data":"61dc6532c6329d22212352ecaedc2acbe4198f6fa4511f750dc70bf90c16bfaa"}
Jul 23 13:54:16.420100 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:54:16.419986    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c95bb4b5c-ft9bm" event={"ID":"966a7353-7206-4eeb-8717-ea16a33768d4","Type":"ContainerDied","Data":"fd9acaccd305c44fb0c0cd65b07c265b2175fe4373f481a884bce816597d7a58"}
Jul 23 13:54:16.420100 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:54:16.420008    2573 scope.go:117] "RemoveContainer" containerID="61dc6532c6329d22212352ecaedc2acbe4198f6fa4511f750dc70bf90c16bfaa"
Jul 23 13:54:16.429928 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:54:16.429908    2573 scope.go:117] "RemoveContainer" containerID="61dc6532c6329d22212352ecaedc2acbe4198f6fa4511f750dc70bf90c16bfaa"
Jul 23 13:54:16.430202 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:54:16.430182    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61dc6532c6329d22212352ecaedc2acbe4198f6fa4511f750dc70bf90c16bfaa\": container with ID starting with 61dc6532c6329d22212352ecaedc2acbe4198f6fa4511f750dc70bf90c16bfaa not found: ID does not exist" containerID="61dc6532c6329d22212352ecaedc2acbe4198f6fa4511f750dc70bf90c16bfaa"
Jul 23 13:54:16.430261 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:54:16.430210    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61dc6532c6329d22212352ecaedc2acbe4198f6fa4511f750dc70bf90c16bfaa"} err="failed to get container status \"61dc6532c6329d22212352ecaedc2acbe4198f6fa4511f750dc70bf90c16bfaa\": rpc error: code = NotFound desc = could not find container \"61dc6532c6329d22212352ecaedc2acbe4198f6fa4511f750dc70bf90c16bfaa\": container with ID starting with 61dc6532c6329d22212352ecaedc2acbe4198f6fa4511f750dc70bf90c16bfaa not found: ID does not exist"
Jul 23 13:54:16.443524 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:54:16.443499    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-c95bb4b5c-ft9bm"]
Jul 23 13:54:16.450621 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:54:16.450597    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-c95bb4b5c-ft9bm"]
Jul 23 13:54:17.068534 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:54:17.068501    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="966a7353-7206-4eeb-8717-ea16a33768d4" path="/var/lib/kubelet/pods/966a7353-7206-4eeb-8717-ea16a33768d4/volumes"
Jul 23 13:54:51.599443 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:54:51.599410    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:54:51.666814 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:54:51.666772    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:55:17.307129 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:55:17.307097    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-c95bb4b5c-fqg7p"]
Jul 23 13:55:17.307582 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:55:17.307497    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd5b06e0-7dd8-4a48-92b0-0309cdcbf337" containerName="authorino"
Jul 23 13:55:17.307582 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:55:17.307510    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd5b06e0-7dd8-4a48-92b0-0309cdcbf337" containerName="authorino"
Jul 23 13:55:17.307582 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:55:17.307520    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="966a7353-7206-4eeb-8717-ea16a33768d4" containerName="manager"
Jul 23 13:55:17.307582 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:55:17.307526    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="966a7353-7206-4eeb-8717-ea16a33768d4" containerName="manager"
Jul 23 13:55:17.307720 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:55:17.307603    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="966a7353-7206-4eeb-8717-ea16a33768d4" containerName="manager"
Jul 23 13:55:17.307720 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:55:17.307614    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd5b06e0-7dd8-4a48-92b0-0309cdcbf337" containerName="authorino"
Jul 23 13:55:17.310838 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:55:17.310821    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c95bb4b5c-fqg7p"
Jul 23 13:55:17.314177 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:55:17.314153    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-fq92w\""
Jul 23 13:55:17.314303 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:55:17.314186    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 23 13:55:17.314303 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:55:17.314219    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 23 13:55:17.321926 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:55:17.321898    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-c95bb4b5c-fqg7p"]
Jul 23 13:55:17.399534 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:55:17.399504    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7baad949-8224-4c4c-b857-303674c0c704-webhook-cert\") pod \"maas-controller-c95bb4b5c-fqg7p\" (UID: \"7baad949-8224-4c4c-b857-303674c0c704\") " pod="opendatahub/maas-controller-c95bb4b5c-fqg7p"
Jul 23 13:55:17.399640 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:55:17.399554    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8x4g\" (UniqueName: \"kubernetes.io/projected/7baad949-8224-4c4c-b857-303674c0c704-kube-api-access-h8x4g\") pod \"maas-controller-c95bb4b5c-fqg7p\" (UID: \"7baad949-8224-4c4c-b857-303674c0c704\") " pod="opendatahub/maas-controller-c95bb4b5c-fqg7p"
Jul 23 13:55:17.500209 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:55:17.500172    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7baad949-8224-4c4c-b857-303674c0c704-webhook-cert\") pod \"maas-controller-c95bb4b5c-fqg7p\" (UID: \"7baad949-8224-4c4c-b857-303674c0c704\") " pod="opendatahub/maas-controller-c95bb4b5c-fqg7p"
Jul 23 13:55:17.500352 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:55:17.500226    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8x4g\" (UniqueName: \"kubernetes.io/projected/7baad949-8224-4c4c-b857-303674c0c704-kube-api-access-h8x4g\") pod \"maas-controller-c95bb4b5c-fqg7p\" (UID: \"7baad949-8224-4c4c-b857-303674c0c704\") " pod="opendatahub/maas-controller-c95bb4b5c-fqg7p"
Jul 23 13:55:17.502617 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:55:17.502591    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7baad949-8224-4c4c-b857-303674c0c704-webhook-cert\") pod \"maas-controller-c95bb4b5c-fqg7p\" (UID: \"7baad949-8224-4c4c-b857-303674c0c704\") " pod="opendatahub/maas-controller-c95bb4b5c-fqg7p"
Jul 23 13:55:17.508101 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:55:17.508077    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8x4g\" (UniqueName: \"kubernetes.io/projected/7baad949-8224-4c4c-b857-303674c0c704-kube-api-access-h8x4g\") pod \"maas-controller-c95bb4b5c-fqg7p\" (UID: \"7baad949-8224-4c4c-b857-303674c0c704\") " pod="opendatahub/maas-controller-c95bb4b5c-fqg7p"
Jul 23 13:55:17.642312 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:55:17.642228    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c95bb4b5c-fqg7p"
Jul 23 13:55:17.784830 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:55:17.784791    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-c95bb4b5c-fqg7p"]
Jul 23 13:55:17.787169 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:55:17.786895    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7baad949_8224_4c4c_b857_303674c0c704.slice/crio-4d78f84755c70667056f5089e9cac0d6c7ff576f6d50a6141e8f040a4e1413b8 WatchSource:0}: Error finding container 4d78f84755c70667056f5089e9cac0d6c7ff576f6d50a6141e8f040a4e1413b8: Status 404 returned error can't find the container with id 4d78f84755c70667056f5089e9cac0d6c7ff576f6d50a6141e8f040a4e1413b8
Jul 23 13:55:18.793365 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:55:18.793327    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c95bb4b5c-fqg7p" event={"ID":"7baad949-8224-4c4c-b857-303674c0c704","Type":"ContainerStarted","Data":"4d78f84755c70667056f5089e9cac0d6c7ff576f6d50a6141e8f040a4e1413b8"}
Jul 23 13:55:19.800661 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:55:19.800622    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c95bb4b5c-fqg7p" event={"ID":"7baad949-8224-4c4c-b857-303674c0c704","Type":"ContainerStarted","Data":"4e2b9cb066d476ecbc76f33c7bf5e116f3f077dfb2cebd37b3640c0645db4616"}
Jul 23 13:55:19.801049 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:55:19.800715    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-c95bb4b5c-fqg7p"
Jul 23 13:55:19.820370 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:55:19.820326    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-c95bb4b5c-fqg7p" podStartSLOduration=1.2373732610000001 podStartE2EDuration="2.820309811s" totalImagesPullingTime="1.58293655s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:55:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:55:19.817034791 +0000 UTC m=+891.256535704" watchObservedRunningTime="2026-07-23 13:55:19.820309811 +0000 UTC m=+891.259810731"
Jul 23 13:55:20.400759 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:55:20.400723    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:55:29.021006 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:55:29.020912    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-vh5dp_2d624703-978f-48c2-b02d-9af8fd337236/console-operator/1.log"
Jul 23 13:55:29.024764 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:55:29.024733    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-vh5dp_2d624703-978f-48c2-b02d-9af8fd337236/console-operator/1.log"
Jul 23 13:55:30.808274 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:55:30.808241    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-c95bb4b5c-fqg7p"
Jul 23 13:55:35.385835 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:55:35.385791    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:55:35.507528 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:55:35.507488    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-c95bb4b5c-fqg7p"]
Jul 23 13:55:35.507783 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:55:35.507726    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-c95bb4b5c-fqg7p" podUID="7baad949-8224-4c4c-b857-303674c0c704" containerName="manager" containerID="cri-o://4e2b9cb066d476ecbc76f33c7bf5e116f3f077dfb2cebd37b3640c0645db4616" gracePeriod=30
Jul 23 13:55:35.766195 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:55:35.766171    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c95bb4b5c-fqg7p"
Jul 23 13:55:35.864130 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:55:35.864093    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h8x4g\" (UniqueName: \"kubernetes.io/projected/7baad949-8224-4c4c-b857-303674c0c704-kube-api-access-h8x4g\") pod \"7baad949-8224-4c4c-b857-303674c0c704\" (UID: \"7baad949-8224-4c4c-b857-303674c0c704\") "
Jul 23 13:55:35.864290 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:55:35.864170    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7baad949-8224-4c4c-b857-303674c0c704-webhook-cert\") pod \"7baad949-8224-4c4c-b857-303674c0c704\" (UID: \"7baad949-8224-4c4c-b857-303674c0c704\") "
Jul 23 13:55:35.866269 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:55:35.866239    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7baad949-8224-4c4c-b857-303674c0c704-kube-api-access-h8x4g" (OuterVolumeSpecName: "kube-api-access-h8x4g") pod "7baad949-8224-4c4c-b857-303674c0c704" (UID: "7baad949-8224-4c4c-b857-303674c0c704"). InnerVolumeSpecName "kube-api-access-h8x4g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:55:35.866383 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:55:35.866276    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7baad949-8224-4c4c-b857-303674c0c704-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "7baad949-8224-4c4c-b857-303674c0c704" (UID: "7baad949-8224-4c4c-b857-303674c0c704"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 13:55:35.889718 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:55:35.889688    2573 generic.go:356] "Generic (PLEG): container finished" podID="7baad949-8224-4c4c-b857-303674c0c704" containerID="4e2b9cb066d476ecbc76f33c7bf5e116f3f077dfb2cebd37b3640c0645db4616" exitCode=0
Jul 23 13:55:35.889843 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:55:35.889738    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c95bb4b5c-fqg7p"
Jul 23 13:55:35.889843 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:55:35.889809    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c95bb4b5c-fqg7p" event={"ID":"7baad949-8224-4c4c-b857-303674c0c704","Type":"ContainerDied","Data":"4e2b9cb066d476ecbc76f33c7bf5e116f3f077dfb2cebd37b3640c0645db4616"}
Jul 23 13:55:35.889935 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:55:35.889858    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c95bb4b5c-fqg7p" event={"ID":"7baad949-8224-4c4c-b857-303674c0c704","Type":"ContainerDied","Data":"4d78f84755c70667056f5089e9cac0d6c7ff576f6d50a6141e8f040a4e1413b8"}
Jul 23 13:55:35.889935 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:55:35.889882    2573 scope.go:117] "RemoveContainer" containerID="4e2b9cb066d476ecbc76f33c7bf5e116f3f077dfb2cebd37b3640c0645db4616"
Jul 23 13:55:35.900084 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:55:35.900066    2573 scope.go:117] "RemoveContainer" containerID="4e2b9cb066d476ecbc76f33c7bf5e116f3f077dfb2cebd37b3640c0645db4616"
Jul 23 13:55:35.900327 ip-10-0-140-103 kubenswrapper[2573]: E0723 13:55:35.900307    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e2b9cb066d476ecbc76f33c7bf5e116f3f077dfb2cebd37b3640c0645db4616\": container with ID starting with 4e2b9cb066d476ecbc76f33c7bf5e116f3f077dfb2cebd37b3640c0645db4616 not found: ID does not exist" containerID="4e2b9cb066d476ecbc76f33c7bf5e116f3f077dfb2cebd37b3640c0645db4616"
Jul 23 13:55:35.900377 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:55:35.900336    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e2b9cb066d476ecbc76f33c7bf5e116f3f077dfb2cebd37b3640c0645db4616"} err="failed to get container status \"4e2b9cb066d476ecbc76f33c7bf5e116f3f077dfb2cebd37b3640c0645db4616\": rpc error: code = NotFound desc = could not find container \"4e2b9cb066d476ecbc76f33c7bf5e116f3f077dfb2cebd37b3640c0645db4616\": container with ID starting with 4e2b9cb066d476ecbc76f33c7bf5e116f3f077dfb2cebd37b3640c0645db4616 not found: ID does not exist"
Jul 23 13:55:35.913397 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:55:35.913375    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-c95bb4b5c-fqg7p"]
Jul 23 13:55:35.917904 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:55:35.917881    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-c95bb4b5c-fqg7p"]
Jul 23 13:55:35.965121 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:55:35.965060    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h8x4g\" (UniqueName: \"kubernetes.io/projected/7baad949-8224-4c4c-b857-303674c0c704-kube-api-access-h8x4g\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 13:55:35.965121 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:55:35.965083    2573 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7baad949-8224-4c4c-b857-303674c0c704-webhook-cert\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 13:55:36.620312 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:55:36.620279    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:55:36.738565 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:55:36.738529    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-c95bb4b5c-dghmv"]
Jul 23 13:55:36.739003 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:55:36.738989    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7baad949-8224-4c4c-b857-303674c0c704" containerName="manager"
Jul 23 13:55:36.739064 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:55:36.739006    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="7baad949-8224-4c4c-b857-303674c0c704" containerName="manager"
Jul 23 13:55:36.739132 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:55:36.739121    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="7baad949-8224-4c4c-b857-303674c0c704" containerName="manager"
Jul 23 13:55:36.743720 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:55:36.743693    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c95bb4b5c-dghmv"
Jul 23 13:55:36.746270 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:55:36.746237    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 23 13:55:36.746973 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:55:36.746953    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-fq92w\""
Jul 23 13:55:36.747111 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:55:36.746956    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 23 13:55:36.753480 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:55:36.753456    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-c95bb4b5c-dghmv"]
Jul 23 13:55:36.872394 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:55:36.872310    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7d21cdb4-a1e4-4035-a4be-16ea811069f3-webhook-cert\") pod \"maas-controller-c95bb4b5c-dghmv\" (UID: \"7d21cdb4-a1e4-4035-a4be-16ea811069f3\") " pod="opendatahub/maas-controller-c95bb4b5c-dghmv"
Jul 23 13:55:36.872394 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:55:36.872365    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqph4\" (UniqueName: \"kubernetes.io/projected/7d21cdb4-a1e4-4035-a4be-16ea811069f3-kube-api-access-xqph4\") pod \"maas-controller-c95bb4b5c-dghmv\" (UID: \"7d21cdb4-a1e4-4035-a4be-16ea811069f3\") " pod="opendatahub/maas-controller-c95bb4b5c-dghmv"
Jul 23 13:55:36.973677 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:55:36.973644    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7d21cdb4-a1e4-4035-a4be-16ea811069f3-webhook-cert\") pod \"maas-controller-c95bb4b5c-dghmv\" (UID: \"7d21cdb4-a1e4-4035-a4be-16ea811069f3\") " pod="opendatahub/maas-controller-c95bb4b5c-dghmv"
Jul 23 13:55:36.973855 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:55:36.973699    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqph4\" (UniqueName: \"kubernetes.io/projected/7d21cdb4-a1e4-4035-a4be-16ea811069f3-kube-api-access-xqph4\") pod \"maas-controller-c95bb4b5c-dghmv\" (UID: \"7d21cdb4-a1e4-4035-a4be-16ea811069f3\") " pod="opendatahub/maas-controller-c95bb4b5c-dghmv"
Jul 23 13:55:36.976092 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:55:36.976056    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7d21cdb4-a1e4-4035-a4be-16ea811069f3-webhook-cert\") pod \"maas-controller-c95bb4b5c-dghmv\" (UID: \"7d21cdb4-a1e4-4035-a4be-16ea811069f3\") " pod="opendatahub/maas-controller-c95bb4b5c-dghmv"
Jul 23 13:55:36.982288 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:55:36.982261    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqph4\" (UniqueName: \"kubernetes.io/projected/7d21cdb4-a1e4-4035-a4be-16ea811069f3-kube-api-access-xqph4\") pod \"maas-controller-c95bb4b5c-dghmv\" (UID: \"7d21cdb4-a1e4-4035-a4be-16ea811069f3\") " pod="opendatahub/maas-controller-c95bb4b5c-dghmv"
Jul 23 13:55:37.056553 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:55:37.056515    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c95bb4b5c-dghmv"
Jul 23 13:55:37.068356 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:55:37.068169    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7baad949-8224-4c4c-b857-303674c0c704" path="/var/lib/kubelet/pods/7baad949-8224-4c4c-b857-303674c0c704/volumes"
Jul 23 13:55:37.193814 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:55:37.193777    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-c95bb4b5c-dghmv"]
Jul 23 13:55:37.195074 ip-10-0-140-103 kubenswrapper[2573]: W0723 13:55:37.194997    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d21cdb4_a1e4_4035_a4be_16ea811069f3.slice/crio-c35d5f9d0f2a7b20f1eaa3986d765119afcf430bc71a08688800dd5882ca4404 WatchSource:0}: Error finding container c35d5f9d0f2a7b20f1eaa3986d765119afcf430bc71a08688800dd5882ca4404: Status 404 returned error can't find the container with id c35d5f9d0f2a7b20f1eaa3986d765119afcf430bc71a08688800dd5882ca4404
Jul 23 13:55:37.902952 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:55:37.902909    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c95bb4b5c-dghmv" event={"ID":"7d21cdb4-a1e4-4035-a4be-16ea811069f3","Type":"ContainerStarted","Data":"c35d5f9d0f2a7b20f1eaa3986d765119afcf430bc71a08688800dd5882ca4404"}
Jul 23 13:55:38.910768 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:55:38.910733    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c95bb4b5c-dghmv" event={"ID":"7d21cdb4-a1e4-4035-a4be-16ea811069f3","Type":"ContainerStarted","Data":"6543049123fe16372c671acc34025da80e3d91366574bd3ff23a06e5da3c5280"}
Jul 23 13:55:38.911161 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:55:38.910793    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-c95bb4b5c-dghmv"
Jul 23 13:55:38.932574 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:55:38.932520    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-c95bb4b5c-dghmv" podStartSLOduration=2.055105382 podStartE2EDuration="2.932502714s" totalImagesPullingTime="877.397332ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:55:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:55:38.930710842 +0000 UTC m=+910.370211762" watchObservedRunningTime="2026-07-23 13:55:38.932502714 +0000 UTC m=+910.372003633"
Jul 23 13:55:41.517776 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:55:41.517735    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:55:41.619482 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:55:41.619448    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:55:49.922536 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:55:49.922504    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-c95bb4b5c-dghmv"
Jul 23 13:56:16.183569 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:56:16.183532    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:56:17.525799 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:56:17.525765    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:56:22.420622 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:56:22.420584    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:56:22.528543 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:56:22.528507    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:56:22.621229 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:56:22.621190    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:56:22.760134 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:56:22.760041    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:56:28.627505 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:56:28.627475    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:56:28.732113 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:56:28.732076    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:57:28.222720 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:57:28.222685    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 13:58:34.159205 ip-10-0-140-103 kubenswrapper[2573]: I0723 13:58:34.159118    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:00:00.149738 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:00:00.149694    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29746920-zxkpm"]
Jul 23 14:00:00.153306 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:00:00.153288    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746920-zxkpm"
Jul 23 14:00:00.163101 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:00:00.163083    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6pngt\""
Jul 23 14:00:00.173060 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:00:00.173044    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746920-zxkpm"
Jul 23 14:00:00.189357 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:00:00.189328    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29746920-zxkpm"]
Jul 23 14:00:00.521524 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:00:00.521500    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29746920-zxkpm"]
Jul 23 14:00:00.522943 ip-10-0-140-103 kubenswrapper[2573]: W0723 14:00:00.522910    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72a8edc4_7ae6_4e55_8cc1_1ab8df448486.slice/crio-0a0ccbfd8eb417ac337572f0f5b590b5e619d7e04894ae3f377e00bb6e629cf1 WatchSource:0}: Error finding container 0a0ccbfd8eb417ac337572f0f5b590b5e619d7e04894ae3f377e00bb6e629cf1: Status 404 returned error can't find the container with id 0a0ccbfd8eb417ac337572f0f5b590b5e619d7e04894ae3f377e00bb6e629cf1
Jul 23 14:00:00.524926 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:00:00.524909    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 14:00:01.384561 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:00:01.384522    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746920-zxkpm" event={"ID":"72a8edc4-7ae6-4e55-8cc1-1ab8df448486","Type":"ContainerStarted","Data":"0a0ccbfd8eb417ac337572f0f5b590b5e619d7e04894ae3f377e00bb6e629cf1"}
Jul 23 14:00:04.404710 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:00:04.404675    2573 generic.go:356] "Generic (PLEG): container finished" podID="72a8edc4-7ae6-4e55-8cc1-1ab8df448486" containerID="710a275fed32b393a648377d05743b03512a1f2ff6e7d973e9a3ef59699df004" exitCode=0
Jul 23 14:00:04.405129 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:00:04.404775    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746920-zxkpm" event={"ID":"72a8edc4-7ae6-4e55-8cc1-1ab8df448486","Type":"ContainerDied","Data":"710a275fed32b393a648377d05743b03512a1f2ff6e7d973e9a3ef59699df004"}
Jul 23 14:00:05.543365 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:00:05.543338    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746920-zxkpm"
Jul 23 14:00:06.417528 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:00:06.417483    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746920-zxkpm" event={"ID":"72a8edc4-7ae6-4e55-8cc1-1ab8df448486","Type":"ContainerDied","Data":"0a0ccbfd8eb417ac337572f0f5b590b5e619d7e04894ae3f377e00bb6e629cf1"}
Jul 23 14:00:06.417528 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:00:06.417524    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746920-zxkpm"
Jul 23 14:00:06.417743 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:00:06.417547    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0a0ccbfd8eb417ac337572f0f5b590b5e619d7e04894ae3f377e00bb6e629cf1"
Jul 23 14:00:29.064238 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:00:29.064200    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-vh5dp_2d624703-978f-48c2-b02d-9af8fd337236/console-operator/1.log"
Jul 23 14:00:29.069437 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:00:29.069409    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-vh5dp_2d624703-978f-48c2-b02d-9af8fd337236/console-operator/1.log"
Jul 23 14:02:09.253359 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:02:09.253328    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:02:28.842178 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:02:28.842145    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:02:28.899238 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:02:28.899208    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:04:42.825962 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:04:42.825873    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:04:43.148915 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:04:43.148820    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:05:02.516785 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:05:02.516749    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:05:28.389588 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:05:28.389545    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:05:29.106531 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:05:29.106499    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-vh5dp_2d624703-978f-48c2-b02d-9af8fd337236/console-operator/1.log"
Jul 23 14:05:29.115940 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:05:29.115906    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-vh5dp_2d624703-978f-48c2-b02d-9af8fd337236/console-operator/1.log"
Jul 23 14:05:30.165361 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:05:30.165325    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:06:50.642597 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:06:50.642552    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:08:40.816437 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:08:40.816404    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:09:04.404830 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:04.404796    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:09:07.425323 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:07.425292    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:09:07.566928 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:07.566867    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:09:07.900443 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:07.900410    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:09:13.971735 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:13.971694    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:09:14.070703 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:14.070674    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:09:14.196135 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:14.196091    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:09:14.526195 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:14.526163    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc"]
Jul 23 14:09:14.526825 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:14.526802    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72a8edc4-7ae6-4e55-8cc1-1ab8df448486" containerName="cleanup"
Jul 23 14:09:14.526825 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:14.526827    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="72a8edc4-7ae6-4e55-8cc1-1ab8df448486" containerName="cleanup"
Jul 23 14:09:14.526997 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:14.526935    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="72a8edc4-7ae6-4e55-8cc1-1ab8df448486" containerName="cleanup"
Jul 23 14:09:14.530703 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:14.530682    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc"
Jul 23 14:09:14.533639 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:14.533617    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-cda79bb3-openshift-default-dockercfg-76hdj\""
Jul 23 14:09:14.565346 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:14.565308    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc"]
Jul 23 14:09:14.574338 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:14.574305    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:09:14.638770 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:14.638732    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b812e81-c732-468c-afcb-b25c17f7e9de-istio-envoy\") pod \"e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc\" (UID: \"7b812e81-c732-468c-afcb-b25c17f7e9de\") " pod="openshift-ingress/e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc"
Jul 23 14:09:14.638770 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:14.638772    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b812e81-c732-468c-afcb-b25c17f7e9de-istio-podinfo\") pod \"e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc\" (UID: \"7b812e81-c732-468c-afcb-b25c17f7e9de\") " pod="openshift-ingress/e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc"
Jul 23 14:09:14.639060 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:14.638814    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b812e81-c732-468c-afcb-b25c17f7e9de-workload-socket\") pod \"e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc\" (UID: \"7b812e81-c732-468c-afcb-b25c17f7e9de\") " pod="openshift-ingress/e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc"
Jul 23 14:09:14.639060 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:14.638845    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b812e81-c732-468c-afcb-b25c17f7e9de-credential-socket\") pod \"e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc\" (UID: \"7b812e81-c732-468c-afcb-b25c17f7e9de\") " pod="openshift-ingress/e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc"
Jul 23 14:09:14.639060 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:14.638870    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b812e81-c732-468c-afcb-b25c17f7e9de-istio-data\") pod \"e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc\" (UID: \"7b812e81-c732-468c-afcb-b25c17f7e9de\") " pod="openshift-ingress/e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc"
Jul 23 14:09:14.639060 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:14.638893    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b812e81-c732-468c-afcb-b25c17f7e9de-istiod-ca-cert\") pod \"e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc\" (UID: \"7b812e81-c732-468c-afcb-b25c17f7e9de\") " pod="openshift-ingress/e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc"
Jul 23 14:09:14.639060 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:14.638981    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b812e81-c732-468c-afcb-b25c17f7e9de-workload-certs\") pod \"e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc\" (UID: \"7b812e81-c732-468c-afcb-b25c17f7e9de\") " pod="openshift-ingress/e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc"
Jul 23 14:09:14.639060 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:14.639038    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6sfwv\" (UniqueName: \"kubernetes.io/projected/7b812e81-c732-468c-afcb-b25c17f7e9de-kube-api-access-6sfwv\") pod \"e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc\" (UID: \"7b812e81-c732-468c-afcb-b25c17f7e9de\") " pod="openshift-ingress/e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc"
Jul 23 14:09:14.639383 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:14.639072    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b812e81-c732-468c-afcb-b25c17f7e9de-istio-token\") pod \"e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc\" (UID: \"7b812e81-c732-468c-afcb-b25c17f7e9de\") " pod="openshift-ingress/e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc"
Jul 23 14:09:14.740454 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:14.740420    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b812e81-c732-468c-afcb-b25c17f7e9de-istio-envoy\") pod \"e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc\" (UID: \"7b812e81-c732-468c-afcb-b25c17f7e9de\") " pod="openshift-ingress/e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc"
Jul 23 14:09:14.740454 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:14.740458    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b812e81-c732-468c-afcb-b25c17f7e9de-istio-podinfo\") pod \"e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc\" (UID: \"7b812e81-c732-468c-afcb-b25c17f7e9de\") " pod="openshift-ingress/e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc"
Jul 23 14:09:14.740692 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:14.740510    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b812e81-c732-468c-afcb-b25c17f7e9de-workload-socket\") pod \"e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc\" (UID: \"7b812e81-c732-468c-afcb-b25c17f7e9de\") " pod="openshift-ingress/e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc"
Jul 23 14:09:14.740692 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:14.740532    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b812e81-c732-468c-afcb-b25c17f7e9de-credential-socket\") pod \"e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc\" (UID: \"7b812e81-c732-468c-afcb-b25c17f7e9de\") " pod="openshift-ingress/e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc"
Jul 23 14:09:14.740692 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:14.740557    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b812e81-c732-468c-afcb-b25c17f7e9de-istio-data\") pod \"e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc\" (UID: \"7b812e81-c732-468c-afcb-b25c17f7e9de\") " pod="openshift-ingress/e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc"
Jul 23 14:09:14.740692 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:14.740580    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b812e81-c732-468c-afcb-b25c17f7e9de-istiod-ca-cert\") pod \"e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc\" (UID: \"7b812e81-c732-468c-afcb-b25c17f7e9de\") " pod="openshift-ingress/e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc"
Jul 23 14:09:14.740692 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:14.740643    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b812e81-c732-468c-afcb-b25c17f7e9de-workload-certs\") pod \"e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc\" (UID: \"7b812e81-c732-468c-afcb-b25c17f7e9de\") " pod="openshift-ingress/e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc"
Jul 23 14:09:14.740692 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:14.740668    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6sfwv\" (UniqueName: \"kubernetes.io/projected/7b812e81-c732-468c-afcb-b25c17f7e9de-kube-api-access-6sfwv\") pod \"e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc\" (UID: \"7b812e81-c732-468c-afcb-b25c17f7e9de\") " pod="openshift-ingress/e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc"
Jul 23 14:09:14.741000 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:14.740715    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b812e81-c732-468c-afcb-b25c17f7e9de-istio-token\") pod \"e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc\" (UID: \"7b812e81-c732-468c-afcb-b25c17f7e9de\") " pod="openshift-ingress/e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc"
Jul 23 14:09:14.741000 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:14.740955    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b812e81-c732-468c-afcb-b25c17f7e9de-workload-socket\") pod \"e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc\" (UID: \"7b812e81-c732-468c-afcb-b25c17f7e9de\") " pod="openshift-ingress/e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc"
Jul 23 14:09:14.741612 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:14.741406    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b812e81-c732-468c-afcb-b25c17f7e9de-credential-socket\") pod \"e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc\" (UID: \"7b812e81-c732-468c-afcb-b25c17f7e9de\") " pod="openshift-ingress/e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc"
Jul 23 14:09:14.741729 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:14.741595    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b812e81-c732-468c-afcb-b25c17f7e9de-istio-data\") pod \"e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc\" (UID: \"7b812e81-c732-468c-afcb-b25c17f7e9de\") " pod="openshift-ingress/e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc"
Jul 23 14:09:14.742429 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:14.742399    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b812e81-c732-468c-afcb-b25c17f7e9de-istiod-ca-cert\") pod \"e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc\" (UID: \"7b812e81-c732-468c-afcb-b25c17f7e9de\") " pod="openshift-ingress/e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc"
Jul 23 14:09:14.743726 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:14.743697    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b812e81-c732-468c-afcb-b25c17f7e9de-workload-certs\") pod \"e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc\" (UID: \"7b812e81-c732-468c-afcb-b25c17f7e9de\") " pod="openshift-ingress/e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc"
Jul 23 14:09:14.748301 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:14.748274    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b812e81-c732-468c-afcb-b25c17f7e9de-istio-envoy\") pod \"e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc\" (UID: \"7b812e81-c732-468c-afcb-b25c17f7e9de\") " pod="openshift-ingress/e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc"
Jul 23 14:09:14.752072 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:14.752043    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b812e81-c732-468c-afcb-b25c17f7e9de-istio-podinfo\") pod \"e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc\" (UID: \"7b812e81-c732-468c-afcb-b25c17f7e9de\") " pod="openshift-ingress/e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc"
Jul 23 14:09:14.752488 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:14.752465    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6sfwv\" (UniqueName: \"kubernetes.io/projected/7b812e81-c732-468c-afcb-b25c17f7e9de-kube-api-access-6sfwv\") pod \"e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc\" (UID: \"7b812e81-c732-468c-afcb-b25c17f7e9de\") " pod="openshift-ingress/e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc"
Jul 23 14:09:14.753324 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:14.753295    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b812e81-c732-468c-afcb-b25c17f7e9de-istio-token\") pod \"e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc\" (UID: \"7b812e81-c732-468c-afcb-b25c17f7e9de\") " pod="openshift-ingress/e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc"
Jul 23 14:09:14.841772 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:14.841729    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc"
Jul 23 14:09:14.864723 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:14.864691    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:09:14.994446 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:14.994418    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc"]
Jul 23 14:09:14.995557 ip-10-0-140-103 kubenswrapper[2573]: W0723 14:09:14.995529    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b812e81_c732_468c_afcb_b25c17f7e9de.slice/crio-8e2f33379704295226824a9a82f775a215d0dbc46b592d02b29c2aea07c850f2 WatchSource:0}: Error finding container 8e2f33379704295226824a9a82f775a215d0dbc46b592d02b29c2aea07c850f2: Status 404 returned error can't find the container with id 8e2f33379704295226824a9a82f775a215d0dbc46b592d02b29c2aea07c850f2
Jul 23 14:09:14.997703 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:14.997672    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 14:09:14.997774 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:14.997737    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 14:09:14.997774 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:14.997765    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 14:09:15.336598 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:15.336563    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:09:15.436754 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:15.436717    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:09:15.535725 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:15.535691    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc" event={"ID":"7b812e81-c732-468c-afcb-b25c17f7e9de","Type":"ContainerStarted","Data":"754284a05e4ffb416b17a670c288e176c20dae2e83c0210b7aec7ada9ceed131"}
Jul 23 14:09:15.535932 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:15.535754    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc" event={"ID":"7b812e81-c732-468c-afcb-b25c17f7e9de","Type":"ContainerStarted","Data":"8e2f33379704295226824a9a82f775a215d0dbc46b592d02b29c2aea07c850f2"}
Jul 23 14:09:15.578723 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:15.578652    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc" podStartSLOduration=1.578637184 podStartE2EDuration="1.578637184s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 14:09:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 14:09:15.576111147 +0000 UTC m=+1727.015612066" watchObservedRunningTime="2026-07-23 14:09:15.578637184 +0000 UTC m=+1727.018138103"
Jul 23 14:09:15.842054 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:15.842002    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc"
Jul 23 14:09:16.847873 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:16.847838    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc"
Jul 23 14:09:17.036003 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:17.035968    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:09:17.199590 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:17.199505    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:09:17.346521 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:17.346485    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:09:17.547155 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:17.547124    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc"
Jul 23 14:09:17.548184 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:17.548160    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc"
Jul 23 14:09:17.608817 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:17.608781    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:09:18.257759 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:18.257730    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:09:18.351707 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:18.351669    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:09:24.029539 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:24.029498    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:09:24.130292 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:24.130261    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:09:32.549356 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:32.549317    2573 patch_prober.go:28] interesting pod/e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Jul 23 14:09:32.549773 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:32.549388    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc" podUID="7b812e81-c732-468c-afcb-b25c17f7e9de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Jul 23 14:09:32.642437 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:32.642405    2573 generic.go:356] "Generic (PLEG): container finished" podID="7b812e81-c732-468c-afcb-b25c17f7e9de" containerID="754284a05e4ffb416b17a670c288e176c20dae2e83c0210b7aec7ada9ceed131" exitCode=0
Jul 23 14:09:32.642610 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:32.642478    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc" event={"ID":"7b812e81-c732-468c-afcb-b25c17f7e9de","Type":"ContainerDied","Data":"754284a05e4ffb416b17a670c288e176c20dae2e83c0210b7aec7ada9ceed131"}
Jul 23 14:09:32.642883 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:32.642869    2573 scope.go:117] "RemoveContainer" containerID="754284a05e4ffb416b17a670c288e176c20dae2e83c0210b7aec7ada9ceed131"
Jul 23 14:09:32.643934 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:32.643908    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 14:09:32.643998 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:32.643976    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 14:09:32.644066 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:32.644008    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 14:09:33.654823 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:33.654786    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc" event={"ID":"7b812e81-c732-468c-afcb-b25c17f7e9de","Type":"ContainerStarted","Data":"7e175a5e4eb71cfe5c11b718c2ebec141c5e5d969fc2b644b239082ca9a16212"}
Jul 23 14:09:33.842398 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:33.841999    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc"
Jul 23 14:09:33.842609 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:33.842496    2573 patch_prober.go:28] interesting pod/e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Jul 23 14:09:33.842609 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:33.842545    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc" podUID="7b812e81-c732-468c-afcb-b25c17f7e9de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Jul 23 14:09:34.842424 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:34.842375    2573 patch_prober.go:28] interesting pod/e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Jul 23 14:09:34.842946 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:34.842447    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc" podUID="7b812e81-c732-468c-afcb-b25c17f7e9de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Jul 23 14:09:35.842898 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:35.842847    2573 patch_prober.go:28] interesting pod/e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Jul 23 14:09:35.843431 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:35.842932    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc" podUID="7b812e81-c732-468c-afcb-b25c17f7e9de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Jul 23 14:09:36.843098 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:36.843053    2573 patch_prober.go:28] interesting pod/e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Jul 23 14:09:36.843590 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:36.843134    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc" podUID="7b812e81-c732-468c-afcb-b25c17f7e9de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Jul 23 14:09:37.846769 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:37.846735    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc"
Jul 23 14:09:37.847172 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:37.847022    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc"
Jul 23 14:09:37.847587 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:37.847567    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc"
Jul 23 14:09:42.586874 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:42.586835    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cda79bb3-fq67n"]
Jul 23 14:09:42.591146 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:42.591126    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cda79bb3-fq67n"
Jul 23 14:09:42.594197 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:42.594173    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6pngt\""
Jul 23 14:09:42.602752 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:42.602723    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cda79bb3-fq67n"]
Jul 23 14:09:42.696103 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:42.696073    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/20350d2a-9a87-4252-bd4c-b1521f34eb23-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-cda79bb3-fq67n\" (UID: \"20350d2a-9a87-4252-bd4c-b1521f34eb23\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cda79bb3-fq67n"
Jul 23 14:09:42.797537 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:42.797502    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/20350d2a-9a87-4252-bd4c-b1521f34eb23-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-cda79bb3-fq67n\" (UID: \"20350d2a-9a87-4252-bd4c-b1521f34eb23\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cda79bb3-fq67n"
Jul 23 14:09:42.798224 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:42.798202    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/20350d2a-9a87-4252-bd4c-b1521f34eb23-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-cda79bb3-fq67n\" (UID: \"20350d2a-9a87-4252-bd4c-b1521f34eb23\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cda79bb3-fq67n"
Jul 23 14:09:42.903695 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:42.903615    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cda79bb3-fq67n"
Jul 23 14:09:43.058551 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:43.058525    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cda79bb3-fq67n"]
Jul 23 14:09:43.060211 ip-10-0-140-103 kubenswrapper[2573]: W0723 14:09:43.060178    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20350d2a_9a87_4252_bd4c_b1521f34eb23.slice/crio-4158fee80cc73248dd98cbd898845772d9e728ef0700596a507e4cb1fd6c27dd WatchSource:0}: Error finding container 4158fee80cc73248dd98cbd898845772d9e728ef0700596a507e4cb1fd6c27dd: Status 404 returned error can't find the container with id 4158fee80cc73248dd98cbd898845772d9e728ef0700596a507e4cb1fd6c27dd
Jul 23 14:09:43.715562 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:43.715527    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cda79bb3-fq67n" event={"ID":"20350d2a-9a87-4252-bd4c-b1521f34eb23","Type":"ContainerStarted","Data":"fcf9697453eaace953bb4f58169873de1f47368347255f11d6af9cc119df6753"}
Jul 23 14:09:43.715953 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:43.715579    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cda79bb3-fq67n" event={"ID":"20350d2a-9a87-4252-bd4c-b1521f34eb23","Type":"ContainerStarted","Data":"4158fee80cc73248dd98cbd898845772d9e728ef0700596a507e4cb1fd6c27dd"}
Jul 23 14:09:43.754095 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:43.754043    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cda79bb3-fq67n" podStartSLOduration=1.754001878 podStartE2EDuration="1.754001878s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 14:09:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 14:09:43.753321442 +0000 UTC m=+1755.192822361" watchObservedRunningTime="2026-07-23 14:09:43.754001878 +0000 UTC m=+1755.193502796"
Jul 23 14:09:44.722481 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:44.722448    2573 generic.go:356] "Generic (PLEG): container finished" podID="20350d2a-9a87-4252-bd4c-b1521f34eb23" containerID="fcf9697453eaace953bb4f58169873de1f47368347255f11d6af9cc119df6753" exitCode=0
Jul 23 14:09:44.722904 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:44.722543    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cda79bb3-fq67n" event={"ID":"20350d2a-9a87-4252-bd4c-b1521f34eb23","Type":"ContainerDied","Data":"fcf9697453eaace953bb4f58169873de1f47368347255f11d6af9cc119df6753"}
Jul 23 14:09:45.868241 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:45.868218    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cda79bb3-fq67n"
Jul 23 14:09:45.923531 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:45.923492    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/20350d2a-9a87-4252-bd4c-b1521f34eb23-maas-api-service-ca\") pod \"20350d2a-9a87-4252-bd4c-b1521f34eb23\" (UID: \"20350d2a-9a87-4252-bd4c-b1521f34eb23\") "
Jul 23 14:09:45.923854 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:45.923830    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20350d2a-9a87-4252-bd4c-b1521f34eb23-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "20350d2a-9a87-4252-bd4c-b1521f34eb23" (UID: "20350d2a-9a87-4252-bd4c-b1521f34eb23"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 14:09:46.024805 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:46.024708    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/20350d2a-9a87-4252-bd4c-b1521f34eb23-maas-api-service-ca\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:09:46.736536 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:46.736503    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cda79bb3-fq67n"
Jul 23 14:09:46.736714 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:46.736497    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cda79bb3-fq67n" event={"ID":"20350d2a-9a87-4252-bd4c-b1521f34eb23","Type":"ContainerDied","Data":"4158fee80cc73248dd98cbd898845772d9e728ef0700596a507e4cb1fd6c27dd"}
Jul 23 14:09:46.736714 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:46.736644    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4158fee80cc73248dd98cbd898845772d9e728ef0700596a507e4cb1fd6c27dd"
Jul 23 14:09:53.322378 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:53.322328    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:09:57.676368 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:57.676318    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cda79bb3-fq67n"]
Jul 23 14:09:57.679051 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:57.679026    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cda79bb3-fq67n"]
Jul 23 14:09:57.685506 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:57.685483    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:09:57.820252 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:57.820218    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc"]
Jul 23 14:09:57.820490 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:57.820466    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc" podUID="7b812e81-c732-468c-afcb-b25c17f7e9de" containerName="istio-proxy" containerID="cri-o://7e175a5e4eb71cfe5c11b718c2ebec141c5e5d969fc2b644b239082ca9a16212" gracePeriod=30
Jul 23 14:09:57.847949 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:57.847913    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:09:58.087108 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:58.087074    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:09:58.359081 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:58.358923    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:09:58.446175 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:58.446143    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:09:58.547912 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:58.547874    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:09:58.863798 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:58.863765    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-d9660af7-gw-openshift-default-7b756d744c-k94z6"]
Jul 23 14:09:58.864395 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:58.864375    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20350d2a-9a87-4252-bd4c-b1521f34eb23" containerName="revoke-keys"
Jul 23 14:09:58.864494 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:58.864398    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="20350d2a-9a87-4252-bd4c-b1521f34eb23" containerName="revoke-keys"
Jul 23 14:09:58.864551 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:58.864541    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="20350d2a-9a87-4252-bd4c-b1521f34eb23" containerName="revoke-keys"
Jul 23 14:09:58.867952 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:58.867927    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-d9660af7-gw-openshift-default-7b756d744c-k94z6"
Jul 23 14:09:58.870316 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:58.870292    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-d9660af7-gw-openshift-default-dockercfg-djkf4\""
Jul 23 14:09:58.885457 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:58.885433    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-d9660af7-gw-openshift-default-7b756d744c-k94z6"]
Jul 23 14:09:58.893551 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:58.893527    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:09:58.939363 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:58.939332    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8c88cac-31b7-4054-8104-fd171f87bc42-workload-certs\") pod \"e2e-migrate-d9660af7-gw-openshift-default-7b756d744c-k94z6\" (UID: \"b8c88cac-31b7-4054-8104-fd171f87bc42\") " pod="openshift-ingress/e2e-migrate-d9660af7-gw-openshift-default-7b756d744c-k94z6"
Jul 23 14:09:58.939363 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:58.939366    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8c88cac-31b7-4054-8104-fd171f87bc42-istio-podinfo\") pod \"e2e-migrate-d9660af7-gw-openshift-default-7b756d744c-k94z6\" (UID: \"b8c88cac-31b7-4054-8104-fd171f87bc42\") " pod="openshift-ingress/e2e-migrate-d9660af7-gw-openshift-default-7b756d744c-k94z6"
Jul 23 14:09:58.939566 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:58.939414    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8c88cac-31b7-4054-8104-fd171f87bc42-workload-socket\") pod \"e2e-migrate-d9660af7-gw-openshift-default-7b756d744c-k94z6\" (UID: \"b8c88cac-31b7-4054-8104-fd171f87bc42\") " pod="openshift-ingress/e2e-migrate-d9660af7-gw-openshift-default-7b756d744c-k94z6"
Jul 23 14:09:58.939566 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:58.939436    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmq5g\" (UniqueName: \"kubernetes.io/projected/b8c88cac-31b7-4054-8104-fd171f87bc42-kube-api-access-gmq5g\") pod \"e2e-migrate-d9660af7-gw-openshift-default-7b756d744c-k94z6\" (UID: \"b8c88cac-31b7-4054-8104-fd171f87bc42\") " pod="openshift-ingress/e2e-migrate-d9660af7-gw-openshift-default-7b756d744c-k94z6"
Jul 23 14:09:58.939566 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:58.939454    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8c88cac-31b7-4054-8104-fd171f87bc42-istio-envoy\") pod \"e2e-migrate-d9660af7-gw-openshift-default-7b756d744c-k94z6\" (UID: \"b8c88cac-31b7-4054-8104-fd171f87bc42\") " pod="openshift-ingress/e2e-migrate-d9660af7-gw-openshift-default-7b756d744c-k94z6"
Jul 23 14:09:58.939566 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:58.939479    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8c88cac-31b7-4054-8104-fd171f87bc42-istiod-ca-cert\") pod \"e2e-migrate-d9660af7-gw-openshift-default-7b756d744c-k94z6\" (UID: \"b8c88cac-31b7-4054-8104-fd171f87bc42\") " pod="openshift-ingress/e2e-migrate-d9660af7-gw-openshift-default-7b756d744c-k94z6"
Jul 23 14:09:58.939566 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:58.939540    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8c88cac-31b7-4054-8104-fd171f87bc42-istio-token\") pod \"e2e-migrate-d9660af7-gw-openshift-default-7b756d744c-k94z6\" (UID: \"b8c88cac-31b7-4054-8104-fd171f87bc42\") " pod="openshift-ingress/e2e-migrate-d9660af7-gw-openshift-default-7b756d744c-k94z6"
Jul 23 14:09:58.939803 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:58.939574    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8c88cac-31b7-4054-8104-fd171f87bc42-credential-socket\") pod \"e2e-migrate-d9660af7-gw-openshift-default-7b756d744c-k94z6\" (UID: \"b8c88cac-31b7-4054-8104-fd171f87bc42\") " pod="openshift-ingress/e2e-migrate-d9660af7-gw-openshift-default-7b756d744c-k94z6"
Jul 23 14:09:58.939803 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:58.939707    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8c88cac-31b7-4054-8104-fd171f87bc42-istio-data\") pod \"e2e-migrate-d9660af7-gw-openshift-default-7b756d744c-k94z6\" (UID: \"b8c88cac-31b7-4054-8104-fd171f87bc42\") " pod="openshift-ingress/e2e-migrate-d9660af7-gw-openshift-default-7b756d744c-k94z6"
Jul 23 14:09:59.040690 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:59.040653    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8c88cac-31b7-4054-8104-fd171f87bc42-istio-data\") pod \"e2e-migrate-d9660af7-gw-openshift-default-7b756d744c-k94z6\" (UID: \"b8c88cac-31b7-4054-8104-fd171f87bc42\") " pod="openshift-ingress/e2e-migrate-d9660af7-gw-openshift-default-7b756d744c-k94z6"
Jul 23 14:09:59.040873 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:59.040701    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8c88cac-31b7-4054-8104-fd171f87bc42-workload-certs\") pod \"e2e-migrate-d9660af7-gw-openshift-default-7b756d744c-k94z6\" (UID: \"b8c88cac-31b7-4054-8104-fd171f87bc42\") " pod="openshift-ingress/e2e-migrate-d9660af7-gw-openshift-default-7b756d744c-k94z6"
Jul 23 14:09:59.040873 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:59.040719    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8c88cac-31b7-4054-8104-fd171f87bc42-istio-podinfo\") pod \"e2e-migrate-d9660af7-gw-openshift-default-7b756d744c-k94z6\" (UID: \"b8c88cac-31b7-4054-8104-fd171f87bc42\") " pod="openshift-ingress/e2e-migrate-d9660af7-gw-openshift-default-7b756d744c-k94z6"
Jul 23 14:09:59.040873 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:59.040767    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8c88cac-31b7-4054-8104-fd171f87bc42-workload-socket\") pod \"e2e-migrate-d9660af7-gw-openshift-default-7b756d744c-k94z6\" (UID: \"b8c88cac-31b7-4054-8104-fd171f87bc42\") " pod="openshift-ingress/e2e-migrate-d9660af7-gw-openshift-default-7b756d744c-k94z6"
Jul 23 14:09:59.040873 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:59.040792    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmq5g\" (UniqueName: \"kubernetes.io/projected/b8c88cac-31b7-4054-8104-fd171f87bc42-kube-api-access-gmq5g\") pod \"e2e-migrate-d9660af7-gw-openshift-default-7b756d744c-k94z6\" (UID: \"b8c88cac-31b7-4054-8104-fd171f87bc42\") " pod="openshift-ingress/e2e-migrate-d9660af7-gw-openshift-default-7b756d744c-k94z6"
Jul 23 14:09:59.040873 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:59.040816    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8c88cac-31b7-4054-8104-fd171f87bc42-istio-envoy\") pod \"e2e-migrate-d9660af7-gw-openshift-default-7b756d744c-k94z6\" (UID: \"b8c88cac-31b7-4054-8104-fd171f87bc42\") " pod="openshift-ingress/e2e-migrate-d9660af7-gw-openshift-default-7b756d744c-k94z6"
Jul 23 14:09:59.040873 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:59.040845    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8c88cac-31b7-4054-8104-fd171f87bc42-istiod-ca-cert\") pod \"e2e-migrate-d9660af7-gw-openshift-default-7b756d744c-k94z6\" (UID: \"b8c88cac-31b7-4054-8104-fd171f87bc42\") " pod="openshift-ingress/e2e-migrate-d9660af7-gw-openshift-default-7b756d744c-k94z6"
Jul 23 14:09:59.040873 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:59.040871    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8c88cac-31b7-4054-8104-fd171f87bc42-istio-token\") pod \"e2e-migrate-d9660af7-gw-openshift-default-7b756d744c-k94z6\" (UID: \"b8c88cac-31b7-4054-8104-fd171f87bc42\") " pod="openshift-ingress/e2e-migrate-d9660af7-gw-openshift-default-7b756d744c-k94z6"
Jul 23 14:09:59.041372 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:59.040905    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8c88cac-31b7-4054-8104-fd171f87bc42-credential-socket\") pod \"e2e-migrate-d9660af7-gw-openshift-default-7b756d744c-k94z6\" (UID: \"b8c88cac-31b7-4054-8104-fd171f87bc42\") " pod="openshift-ingress/e2e-migrate-d9660af7-gw-openshift-default-7b756d744c-k94z6"
Jul 23 14:09:59.041372 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:59.041161    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8c88cac-31b7-4054-8104-fd171f87bc42-workload-certs\") pod \"e2e-migrate-d9660af7-gw-openshift-default-7b756d744c-k94z6\" (UID: \"b8c88cac-31b7-4054-8104-fd171f87bc42\") " pod="openshift-ingress/e2e-migrate-d9660af7-gw-openshift-default-7b756d744c-k94z6"
Jul 23 14:09:59.041372 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:59.041190    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8c88cac-31b7-4054-8104-fd171f87bc42-istio-data\") pod \"e2e-migrate-d9660af7-gw-openshift-default-7b756d744c-k94z6\" (UID: \"b8c88cac-31b7-4054-8104-fd171f87bc42\") " pod="openshift-ingress/e2e-migrate-d9660af7-gw-openshift-default-7b756d744c-k94z6"
Jul 23 14:09:59.041372 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:59.041354    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8c88cac-31b7-4054-8104-fd171f87bc42-workload-socket\") pod \"e2e-migrate-d9660af7-gw-openshift-default-7b756d744c-k94z6\" (UID: \"b8c88cac-31b7-4054-8104-fd171f87bc42\") " pod="openshift-ingress/e2e-migrate-d9660af7-gw-openshift-default-7b756d744c-k94z6"
Jul 23 14:09:59.041635 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:59.041614    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8c88cac-31b7-4054-8104-fd171f87bc42-credential-socket\") pod \"e2e-migrate-d9660af7-gw-openshift-default-7b756d744c-k94z6\" (UID: \"b8c88cac-31b7-4054-8104-fd171f87bc42\") " pod="openshift-ingress/e2e-migrate-d9660af7-gw-openshift-default-7b756d744c-k94z6"
Jul 23 14:09:59.041833 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:59.041810    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8c88cac-31b7-4054-8104-fd171f87bc42-istiod-ca-cert\") pod \"e2e-migrate-d9660af7-gw-openshift-default-7b756d744c-k94z6\" (UID: \"b8c88cac-31b7-4054-8104-fd171f87bc42\") " pod="openshift-ingress/e2e-migrate-d9660af7-gw-openshift-default-7b756d744c-k94z6"
Jul 23 14:09:59.043353 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:59.043325    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8c88cac-31b7-4054-8104-fd171f87bc42-istio-podinfo\") pod \"e2e-migrate-d9660af7-gw-openshift-default-7b756d744c-k94z6\" (UID: \"b8c88cac-31b7-4054-8104-fd171f87bc42\") " pod="openshift-ingress/e2e-migrate-d9660af7-gw-openshift-default-7b756d744c-k94z6"
Jul 23 14:09:59.043461 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:59.043393    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8c88cac-31b7-4054-8104-fd171f87bc42-istio-envoy\") pod \"e2e-migrate-d9660af7-gw-openshift-default-7b756d744c-k94z6\" (UID: \"b8c88cac-31b7-4054-8104-fd171f87bc42\") " pod="openshift-ingress/e2e-migrate-d9660af7-gw-openshift-default-7b756d744c-k94z6"
Jul 23 14:09:59.049178 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:59.049150    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8c88cac-31b7-4054-8104-fd171f87bc42-istio-token\") pod \"e2e-migrate-d9660af7-gw-openshift-default-7b756d744c-k94z6\" (UID: \"b8c88cac-31b7-4054-8104-fd171f87bc42\") " pod="openshift-ingress/e2e-migrate-d9660af7-gw-openshift-default-7b756d744c-k94z6"
Jul 23 14:09:59.049292 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:59.049269    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmq5g\" (UniqueName: \"kubernetes.io/projected/b8c88cac-31b7-4054-8104-fd171f87bc42-kube-api-access-gmq5g\") pod \"e2e-migrate-d9660af7-gw-openshift-default-7b756d744c-k94z6\" (UID: \"b8c88cac-31b7-4054-8104-fd171f87bc42\") " pod="openshift-ingress/e2e-migrate-d9660af7-gw-openshift-default-7b756d744c-k94z6"
Jul 23 14:09:59.075854 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:59.075822    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20350d2a-9a87-4252-bd4c-b1521f34eb23" path="/var/lib/kubelet/pods/20350d2a-9a87-4252-bd4c-b1521f34eb23/volumes"
Jul 23 14:09:59.178341 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:59.178255    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-d9660af7-gw-openshift-default-7b756d744c-k94z6"
Jul 23 14:09:59.183074 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:59.183050    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:09:59.326105 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:59.326077    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-d9660af7-gw-openshift-default-7b756d744c-k94z6"]
Jul 23 14:09:59.327961 ip-10-0-140-103 kubenswrapper[2573]: W0723 14:09:59.327931    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8c88cac_31b7_4054_8104_fd171f87bc42.slice/crio-5dd643fb367fe0684793223f1aa0f1b1a4aa751830c15e8be6cb04320779e2c3 WatchSource:0}: Error finding container 5dd643fb367fe0684793223f1aa0f1b1a4aa751830c15e8be6cb04320779e2c3: Status 404 returned error can't find the container with id 5dd643fb367fe0684793223f1aa0f1b1a4aa751830c15e8be6cb04320779e2c3
Jul 23 14:09:59.330269 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:59.330235    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 14:09:59.330368 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:59.330311    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 14:09:59.330368 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:59.330342    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 14:09:59.814708 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:59.814669    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-d9660af7-gw-openshift-default-7b756d744c-k94z6" event={"ID":"b8c88cac-31b7-4054-8104-fd171f87bc42","Type":"ContainerStarted","Data":"a0a4014d8832492508b90a76b1d3d93d4af5774a03f28d8bb45b1abc96818238"}
Jul 23 14:09:59.814913 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:59.814726    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-d9660af7-gw-openshift-default-7b756d744c-k94z6" event={"ID":"b8c88cac-31b7-4054-8104-fd171f87bc42","Type":"ContainerStarted","Data":"5dd643fb367fe0684793223f1aa0f1b1a4aa751830c15e8be6cb04320779e2c3"}
Jul 23 14:09:59.838162 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:09:59.838111    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-d9660af7-gw-openshift-default-7b756d744c-k94z6" podStartSLOduration=1.838096038 podStartE2EDuration="1.838096038s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 14:09:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 14:09:59.8374407 +0000 UTC m=+1771.276941633" watchObservedRunningTime="2026-07-23 14:09:59.838096038 +0000 UTC m=+1771.277596956"
Jul 23 14:10:00.179259 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:00.179177    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-d9660af7-gw-openshift-default-7b756d744c-k94z6"
Jul 23 14:10:00.184474 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:00.184451    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-d9660af7-gw-openshift-default-7b756d744c-k94z6"
Jul 23 14:10:00.820841 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:00.820809    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-d9660af7-gw-openshift-default-7b756d744c-k94z6"
Jul 23 14:10:00.821785 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:00.821764    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-d9660af7-gw-openshift-default-7b756d744c-k94z6"
Jul 23 14:10:01.404395 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:01.404359    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:10:01.534861 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:01.534817    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:10:02.084565 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:02.084531    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:10:02.180147 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:02.180115    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:10:03.093000 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:03.092940    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc"
Jul 23 14:10:03.184648 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:03.184608    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b812e81-c732-468c-afcb-b25c17f7e9de-workload-socket\") pod \"7b812e81-c732-468c-afcb-b25c17f7e9de\" (UID: \"7b812e81-c732-468c-afcb-b25c17f7e9de\") "
Jul 23 14:10:03.184648 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:03.184649    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b812e81-c732-468c-afcb-b25c17f7e9de-istio-data\") pod \"7b812e81-c732-468c-afcb-b25c17f7e9de\" (UID: \"7b812e81-c732-468c-afcb-b25c17f7e9de\") "
Jul 23 14:10:03.184913 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:03.184693    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b812e81-c732-468c-afcb-b25c17f7e9de-istio-envoy\") pod \"7b812e81-c732-468c-afcb-b25c17f7e9de\" (UID: \"7b812e81-c732-468c-afcb-b25c17f7e9de\") "
Jul 23 14:10:03.184913 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:03.184731    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6sfwv\" (UniqueName: \"kubernetes.io/projected/7b812e81-c732-468c-afcb-b25c17f7e9de-kube-api-access-6sfwv\") pod \"7b812e81-c732-468c-afcb-b25c17f7e9de\" (UID: \"7b812e81-c732-468c-afcb-b25c17f7e9de\") "
Jul 23 14:10:03.184913 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:03.184809    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b812e81-c732-468c-afcb-b25c17f7e9de-istiod-ca-cert\") pod \"7b812e81-c732-468c-afcb-b25c17f7e9de\" (UID: \"7b812e81-c732-468c-afcb-b25c17f7e9de\") "
Jul 23 14:10:03.184913 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:03.184846    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b812e81-c732-468c-afcb-b25c17f7e9de-istio-token\") pod \"7b812e81-c732-468c-afcb-b25c17f7e9de\" (UID: \"7b812e81-c732-468c-afcb-b25c17f7e9de\") "
Jul 23 14:10:03.184913 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:03.184872    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b812e81-c732-468c-afcb-b25c17f7e9de-istio-podinfo\") pod \"7b812e81-c732-468c-afcb-b25c17f7e9de\" (UID: \"7b812e81-c732-468c-afcb-b25c17f7e9de\") "
Jul 23 14:10:03.185203 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:03.184928    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b812e81-c732-468c-afcb-b25c17f7e9de-credential-socket\") pod \"7b812e81-c732-468c-afcb-b25c17f7e9de\" (UID: \"7b812e81-c732-468c-afcb-b25c17f7e9de\") "
Jul 23 14:10:03.185203 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:03.184959    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b812e81-c732-468c-afcb-b25c17f7e9de-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7b812e81-c732-468c-afcb-b25c17f7e9de" (UID: "7b812e81-c732-468c-afcb-b25c17f7e9de"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 14:10:03.185203 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:03.184987    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b812e81-c732-468c-afcb-b25c17f7e9de-workload-certs\") pod \"7b812e81-c732-468c-afcb-b25c17f7e9de\" (UID: \"7b812e81-c732-468c-afcb-b25c17f7e9de\") "
Jul 23 14:10:03.185375 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:03.185294    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b812e81-c732-468c-afcb-b25c17f7e9de-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7b812e81-c732-468c-afcb-b25c17f7e9de" (UID: "7b812e81-c732-468c-afcb-b25c17f7e9de"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 14:10:03.185375 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:03.185308    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b812e81-c732-468c-afcb-b25c17f7e9de-workload-socket\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:10:03.185375 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:03.185300    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b812e81-c732-468c-afcb-b25c17f7e9de-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7b812e81-c732-468c-afcb-b25c17f7e9de" (UID: "7b812e81-c732-468c-afcb-b25c17f7e9de"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 14:10:03.185529 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:03.185507    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b812e81-c732-468c-afcb-b25c17f7e9de-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7b812e81-c732-468c-afcb-b25c17f7e9de" (UID: "7b812e81-c732-468c-afcb-b25c17f7e9de"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 14:10:03.185585 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:03.185537    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b812e81-c732-468c-afcb-b25c17f7e9de-istio-data" (OuterVolumeSpecName: "istio-data") pod "7b812e81-c732-468c-afcb-b25c17f7e9de" (UID: "7b812e81-c732-468c-afcb-b25c17f7e9de"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 14:10:03.187250 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:03.187217    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7b812e81-c732-468c-afcb-b25c17f7e9de-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7b812e81-c732-468c-afcb-b25c17f7e9de" (UID: "7b812e81-c732-468c-afcb-b25c17f7e9de"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 14:10:03.187357 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:03.187262    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b812e81-c732-468c-afcb-b25c17f7e9de-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7b812e81-c732-468c-afcb-b25c17f7e9de" (UID: "7b812e81-c732-468c-afcb-b25c17f7e9de"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 14:10:03.187454 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:03.187431    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b812e81-c732-468c-afcb-b25c17f7e9de-istio-token" (OuterVolumeSpecName: "istio-token") pod "7b812e81-c732-468c-afcb-b25c17f7e9de" (UID: "7b812e81-c732-468c-afcb-b25c17f7e9de"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 14:10:03.187454 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:03.187442    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b812e81-c732-468c-afcb-b25c17f7e9de-kube-api-access-6sfwv" (OuterVolumeSpecName: "kube-api-access-6sfwv") pod "7b812e81-c732-468c-afcb-b25c17f7e9de" (UID: "7b812e81-c732-468c-afcb-b25c17f7e9de"). InnerVolumeSpecName "kube-api-access-6sfwv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 14:10:03.286330 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:03.286293    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b812e81-c732-468c-afcb-b25c17f7e9de-workload-certs\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:10:03.286330 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:03.286323    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b812e81-c732-468c-afcb-b25c17f7e9de-istio-data\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:10:03.286330 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:03.286332    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b812e81-c732-468c-afcb-b25c17f7e9de-istio-envoy\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:10:03.286330 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:03.286340    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6sfwv\" (UniqueName: \"kubernetes.io/projected/7b812e81-c732-468c-afcb-b25c17f7e9de-kube-api-access-6sfwv\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:10:03.286611 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:03.286350    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b812e81-c732-468c-afcb-b25c17f7e9de-istiod-ca-cert\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:10:03.286611 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:03.286358    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b812e81-c732-468c-afcb-b25c17f7e9de-istio-token\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:10:03.286611 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:03.286365    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b812e81-c732-468c-afcb-b25c17f7e9de-istio-podinfo\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:10:03.286611 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:03.286374    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b812e81-c732-468c-afcb-b25c17f7e9de-credential-socket\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:10:03.840730 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:03.840697    2573 generic.go:356] "Generic (PLEG): container finished" podID="7b812e81-c732-468c-afcb-b25c17f7e9de" containerID="7e175a5e4eb71cfe5c11b718c2ebec141c5e5d969fc2b644b239082ca9a16212" exitCode=0
Jul 23 14:10:03.840920 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:03.840743    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc"
Jul 23 14:10:03.840920 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:03.840778    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc" event={"ID":"7b812e81-c732-468c-afcb-b25c17f7e9de","Type":"ContainerDied","Data":"7e175a5e4eb71cfe5c11b718c2ebec141c5e5d969fc2b644b239082ca9a16212"}
Jul 23 14:10:03.840920 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:03.840832    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc" event={"ID":"7b812e81-c732-468c-afcb-b25c17f7e9de","Type":"ContainerDied","Data":"8e2f33379704295226824a9a82f775a215d0dbc46b592d02b29c2aea07c850f2"}
Jul 23 14:10:03.840920 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:03.840858    2573 scope.go:117] "RemoveContainer" containerID="7e175a5e4eb71cfe5c11b718c2ebec141c5e5d969fc2b644b239082ca9a16212"
Jul 23 14:10:03.858870 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:03.858849    2573 scope.go:117] "RemoveContainer" containerID="754284a05e4ffb416b17a670c288e176c20dae2e83c0210b7aec7ada9ceed131"
Jul 23 14:10:03.867832 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:03.867806    2573 scope.go:117] "RemoveContainer" containerID="7e175a5e4eb71cfe5c11b718c2ebec141c5e5d969fc2b644b239082ca9a16212"
Jul 23 14:10:03.868146 ip-10-0-140-103 kubenswrapper[2573]: E0723 14:10:03.868126    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e175a5e4eb71cfe5c11b718c2ebec141c5e5d969fc2b644b239082ca9a16212\": container with ID starting with 7e175a5e4eb71cfe5c11b718c2ebec141c5e5d969fc2b644b239082ca9a16212 not found: ID does not exist" containerID="7e175a5e4eb71cfe5c11b718c2ebec141c5e5d969fc2b644b239082ca9a16212"
Jul 23 14:10:03.868217 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:03.868156    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e175a5e4eb71cfe5c11b718c2ebec141c5e5d969fc2b644b239082ca9a16212"} err="failed to get container status \"7e175a5e4eb71cfe5c11b718c2ebec141c5e5d969fc2b644b239082ca9a16212\": rpc error: code = NotFound desc = could not find container \"7e175a5e4eb71cfe5c11b718c2ebec141c5e5d969fc2b644b239082ca9a16212\": container with ID starting with 7e175a5e4eb71cfe5c11b718c2ebec141c5e5d969fc2b644b239082ca9a16212 not found: ID does not exist"
Jul 23 14:10:03.868217 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:03.868175    2573 scope.go:117] "RemoveContainer" containerID="754284a05e4ffb416b17a670c288e176c20dae2e83c0210b7aec7ada9ceed131"
Jul 23 14:10:03.868472 ip-10-0-140-103 kubenswrapper[2573]: E0723 14:10:03.868452    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"754284a05e4ffb416b17a670c288e176c20dae2e83c0210b7aec7ada9ceed131\": container with ID starting with 754284a05e4ffb416b17a670c288e176c20dae2e83c0210b7aec7ada9ceed131 not found: ID does not exist" containerID="754284a05e4ffb416b17a670c288e176c20dae2e83c0210b7aec7ada9ceed131"
Jul 23 14:10:03.868523 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:03.868478    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"754284a05e4ffb416b17a670c288e176c20dae2e83c0210b7aec7ada9ceed131"} err="failed to get container status \"754284a05e4ffb416b17a670c288e176c20dae2e83c0210b7aec7ada9ceed131\": rpc error: code = NotFound desc = could not find container \"754284a05e4ffb416b17a670c288e176c20dae2e83c0210b7aec7ada9ceed131\": container with ID starting with 754284a05e4ffb416b17a670c288e176c20dae2e83c0210b7aec7ada9ceed131 not found: ID does not exist"
Jul 23 14:10:03.869694 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:03.869670    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc"]
Jul 23 14:10:03.875902 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:03.875881    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-cda79bb3-openshift-default-7c6ccc97d5-8m5pc"]
Jul 23 14:10:05.069533 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:05.069497    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b812e81-c732-468c-afcb-b25c17f7e9de" path="/var/lib/kubelet/pods/7b812e81-c732-468c-afcb-b25c17f7e9de/volumes"
Jul 23 14:10:06.431229 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:06.431189    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:10:12.901644 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:12.901605    2573 generic.go:356] "Generic (PLEG): container finished" podID="b8c88cac-31b7-4054-8104-fd171f87bc42" containerID="a0a4014d8832492508b90a76b1d3d93d4af5774a03f28d8bb45b1abc96818238" exitCode=0
Jul 23 14:10:12.902095 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:12.901677    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-d9660af7-gw-openshift-default-7b756d744c-k94z6" event={"ID":"b8c88cac-31b7-4054-8104-fd171f87bc42","Type":"ContainerDied","Data":"a0a4014d8832492508b90a76b1d3d93d4af5774a03f28d8bb45b1abc96818238"}
Jul 23 14:10:12.902142 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:12.902132    2573 scope.go:117] "RemoveContainer" containerID="a0a4014d8832492508b90a76b1d3d93d4af5774a03f28d8bb45b1abc96818238"
Jul 23 14:10:12.903350 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:12.903321    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 14:10:12.903425 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:12.903397    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 14:10:12.903459 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:12.903432    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 14:10:13.909703 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:13.909661    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-d9660af7-gw-openshift-default-7b756d744c-k94z6" event={"ID":"b8c88cac-31b7-4054-8104-fd171f87bc42","Type":"ContainerStarted","Data":"26157b13e32e1c16e756976089020629e6acd07019ac99e1da136a0a44e40989"}
Jul 23 14:10:14.179326 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:14.179227    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-d9660af7-gw-openshift-default-7b756d744c-k94z6"
Jul 23 14:10:14.180512 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:14.180485    2573 patch_prober.go:28] interesting pod/e2e-migrate-d9660af7-gw-openshift-default-7b756d744c-k94z6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Jul 23 14:10:14.180633 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:14.180535    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-d9660af7-gw-openshift-default-7b756d744c-k94z6" podUID="b8c88cac-31b7-4054-8104-fd171f87bc42" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Jul 23 14:10:15.179229 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:15.179189    2573 patch_prober.go:28] interesting pod/e2e-migrate-d9660af7-gw-openshift-default-7b756d744c-k94z6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Jul 23 14:10:15.179651 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:15.179250    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-d9660af7-gw-openshift-default-7b756d744c-k94z6" podUID="b8c88cac-31b7-4054-8104-fd171f87bc42" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Jul 23 14:10:15.821057 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:15.820996    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-d9660af7-gw-openshift-default-7b756d744c-k94z6"
Jul 23 14:10:16.178923 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:16.178831    2573 patch_prober.go:28] interesting pod/e2e-migrate-d9660af7-gw-openshift-default-7b756d744c-k94z6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Jul 23 14:10:16.178923 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:16.178895    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-d9660af7-gw-openshift-default-7b756d744c-k94z6" podUID="b8c88cac-31b7-4054-8104-fd171f87bc42" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Jul 23 14:10:17.179532 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:17.179493    2573 patch_prober.go:28] interesting pod/e2e-migrate-d9660af7-gw-openshift-default-7b756d744c-k94z6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Jul 23 14:10:17.179932 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:17.179550    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-d9660af7-gw-openshift-default-7b756d744c-k94z6" podUID="b8c88cac-31b7-4054-8104-fd171f87bc42" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Jul 23 14:10:18.183313 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:18.183279    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-d9660af7-gw-openshift-default-7b756d744c-k94z6"
Jul 23 14:10:18.184360 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:18.184342    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-d9660af7-gw-openshift-default-7b756d744c-k94z6"
Jul 23 14:10:26.372568 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:26.372487    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d9660af7-l5b58"]
Jul 23 14:10:26.374258 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:26.374055    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b812e81-c732-468c-afcb-b25c17f7e9de" containerName="istio-proxy"
Jul 23 14:10:26.374258 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:26.374094    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b812e81-c732-468c-afcb-b25c17f7e9de" containerName="istio-proxy"
Jul 23 14:10:26.374258 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:26.374131    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b812e81-c732-468c-afcb-b25c17f7e9de" containerName="istio-proxy"
Jul 23 14:10:26.374258 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:26.374140    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b812e81-c732-468c-afcb-b25c17f7e9de" containerName="istio-proxy"
Jul 23 14:10:26.374529 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:26.374338    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b812e81-c732-468c-afcb-b25c17f7e9de" containerName="istio-proxy"
Jul 23 14:10:26.374529 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:26.374360    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b812e81-c732-468c-afcb-b25c17f7e9de" containerName="istio-proxy"
Jul 23 14:10:26.378683 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:26.378651    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d9660af7-l5b58"
Jul 23 14:10:26.386142 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:26.386097    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6pngt\""
Jul 23 14:10:26.388257 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:26.387981    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d9660af7-l5b58"]
Jul 23 14:10:26.412163 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:26.412130    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0344bb4-85e2-43af-8142-a6cfae167175-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-d9660af7-l5b58\" (UID: \"e0344bb4-85e2-43af-8142-a6cfae167175\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d9660af7-l5b58"
Jul 23 14:10:26.513133 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:26.513101    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0344bb4-85e2-43af-8142-a6cfae167175-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-d9660af7-l5b58\" (UID: \"e0344bb4-85e2-43af-8142-a6cfae167175\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d9660af7-l5b58"
Jul 23 14:10:26.513695 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:26.513673    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0344bb4-85e2-43af-8142-a6cfae167175-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-d9660af7-l5b58\" (UID: \"e0344bb4-85e2-43af-8142-a6cfae167175\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d9660af7-l5b58"
Jul 23 14:10:26.692592 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:26.692507    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d9660af7-l5b58"
Jul 23 14:10:26.835516 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:26.835490    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d9660af7-l5b58"]
Jul 23 14:10:26.837764 ip-10-0-140-103 kubenswrapper[2573]: W0723 14:10:26.837723    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0344bb4_85e2_43af_8142_a6cfae167175.slice/crio-cf034e884d1d01f08e23617872f162ebaab929be69a207d6e6d15e29b724eadf WatchSource:0}: Error finding container cf034e884d1d01f08e23617872f162ebaab929be69a207d6e6d15e29b724eadf: Status 404 returned error can't find the container with id cf034e884d1d01f08e23617872f162ebaab929be69a207d6e6d15e29b724eadf
Jul 23 14:10:26.987118 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:26.987039    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d9660af7-l5b58" event={"ID":"e0344bb4-85e2-43af-8142-a6cfae167175","Type":"ContainerStarted","Data":"cf034e884d1d01f08e23617872f162ebaab929be69a207d6e6d15e29b724eadf"}
Jul 23 14:10:27.994050 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:27.993933    2573 generic.go:356] "Generic (PLEG): container finished" podID="e0344bb4-85e2-43af-8142-a6cfae167175" containerID="a7763a854838c10d59e43235cfa373f6c20e7e58fa6a6403dc7bbba80b604caf" exitCode=0
Jul 23 14:10:27.994050 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:27.993977    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d9660af7-l5b58" event={"ID":"e0344bb4-85e2-43af-8142-a6cfae167175","Type":"ContainerDied","Data":"a7763a854838c10d59e43235cfa373f6c20e7e58fa6a6403dc7bbba80b604caf"}
Jul 23 14:10:29.151753 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:29.151725    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d9660af7-l5b58"
Jul 23 14:10:29.155047 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:29.154997    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-vh5dp_2d624703-978f-48c2-b02d-9af8fd337236/console-operator/1.log"
Jul 23 14:10:29.160818 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:29.160788    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-vh5dp_2d624703-978f-48c2-b02d-9af8fd337236/console-operator/1.log"
Jul 23 14:10:29.236719 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:29.236680    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0344bb4-85e2-43af-8142-a6cfae167175-maas-api-service-ca\") pod \"e0344bb4-85e2-43af-8142-a6cfae167175\" (UID: \"e0344bb4-85e2-43af-8142-a6cfae167175\") "
Jul 23 14:10:29.237121 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:29.237090    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0344bb4-85e2-43af-8142-a6cfae167175-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e0344bb4-85e2-43af-8142-a6cfae167175" (UID: "e0344bb4-85e2-43af-8142-a6cfae167175"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 14:10:29.337455 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:29.337421    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0344bb4-85e2-43af-8142-a6cfae167175-maas-api-service-ca\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:10:30.008904 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:30.008872    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d9660af7-l5b58"
Jul 23 14:10:30.009124 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:30.008922    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d9660af7-l5b58" event={"ID":"e0344bb4-85e2-43af-8142-a6cfae167175","Type":"ContainerDied","Data":"cf034e884d1d01f08e23617872f162ebaab929be69a207d6e6d15e29b724eadf"}
Jul 23 14:10:30.009124 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:30.009001    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cf034e884d1d01f08e23617872f162ebaab929be69a207d6e6d15e29b724eadf"
Jul 23 14:10:36.802577 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:36.802531    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:10:41.463850 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:41.463810    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:10:41.476800 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:41.476765    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d9660af7-l5b58"]
Jul 23 14:10:41.480525 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:41.480499    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d9660af7-l5b58"]
Jul 23 14:10:41.621873 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:41.621839    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-d9660af7-gw-openshift-default-7b756d744c-k94z6"]
Jul 23 14:10:41.622129 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:41.622105    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-d9660af7-gw-openshift-default-7b756d744c-k94z6" podUID="b8c88cac-31b7-4054-8104-fd171f87bc42" containerName="istio-proxy" containerID="cri-o://26157b13e32e1c16e756976089020629e6acd07019ac99e1da136a0a44e40989" gracePeriod=30
Jul 23 14:10:41.638612 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:41.638563    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:10:41.906530 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:41.906491    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:10:42.158824 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:42.158737    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:10:42.450155 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:42.450077    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6"]
Jul 23 14:10:42.450512 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:42.450498    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0344bb4-85e2-43af-8142-a6cfae167175" containerName="revoke-keys"
Jul 23 14:10:42.450554 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:42.450513    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0344bb4-85e2-43af-8142-a6cfae167175" containerName="revoke-keys"
Jul 23 14:10:42.450607 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:42.450598    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0344bb4-85e2-43af-8142-a6cfae167175" containerName="revoke-keys"
Jul 23 14:10:42.453869 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:42.453850    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6"
Jul 23 14:10:42.458974 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:42.458949    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-daf75dd9-openshift-default-dockercfg-j5htg\""
Jul 23 14:10:42.475996 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:42.475970    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6"]
Jul 23 14:10:42.485122 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:42.485091    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:10:42.559131 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:42.559093    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/613a77a0-a13f-4704-8020-7c8690878f5d-istio-token\") pod \"e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6\" (UID: \"613a77a0-a13f-4704-8020-7c8690878f5d\") " pod="openshift-ingress/e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6"
Jul 23 14:10:42.559131 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:42.559131    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/613a77a0-a13f-4704-8020-7c8690878f5d-istiod-ca-cert\") pod \"e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6\" (UID: \"613a77a0-a13f-4704-8020-7c8690878f5d\") " pod="openshift-ingress/e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6"
Jul 23 14:10:42.559352 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:42.559162    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/613a77a0-a13f-4704-8020-7c8690878f5d-istio-podinfo\") pod \"e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6\" (UID: \"613a77a0-a13f-4704-8020-7c8690878f5d\") " pod="openshift-ingress/e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6"
Jul 23 14:10:42.559352 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:42.559235    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/613a77a0-a13f-4704-8020-7c8690878f5d-istio-envoy\") pod \"e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6\" (UID: \"613a77a0-a13f-4704-8020-7c8690878f5d\") " pod="openshift-ingress/e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6"
Jul 23 14:10:42.559352 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:42.559269    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/613a77a0-a13f-4704-8020-7c8690878f5d-credential-socket\") pod \"e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6\" (UID: \"613a77a0-a13f-4704-8020-7c8690878f5d\") " pod="openshift-ingress/e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6"
Jul 23 14:10:42.559352 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:42.559292    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/613a77a0-a13f-4704-8020-7c8690878f5d-istio-data\") pod \"e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6\" (UID: \"613a77a0-a13f-4704-8020-7c8690878f5d\") " pod="openshift-ingress/e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6"
Jul 23 14:10:42.559498 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:42.559376    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/613a77a0-a13f-4704-8020-7c8690878f5d-workload-socket\") pod \"e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6\" (UID: \"613a77a0-a13f-4704-8020-7c8690878f5d\") " pod="openshift-ingress/e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6"
Jul 23 14:10:42.559498 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:42.559412    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/613a77a0-a13f-4704-8020-7c8690878f5d-workload-certs\") pod \"e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6\" (UID: \"613a77a0-a13f-4704-8020-7c8690878f5d\") " pod="openshift-ingress/e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6"
Jul 23 14:10:42.559498 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:42.559440    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jdvr\" (UniqueName: \"kubernetes.io/projected/613a77a0-a13f-4704-8020-7c8690878f5d-kube-api-access-9jdvr\") pod \"e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6\" (UID: \"613a77a0-a13f-4704-8020-7c8690878f5d\") " pod="openshift-ingress/e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6"
Jul 23 14:10:42.579494 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:42.579466    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:10:42.660275 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:42.660240    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jdvr\" (UniqueName: \"kubernetes.io/projected/613a77a0-a13f-4704-8020-7c8690878f5d-kube-api-access-9jdvr\") pod \"e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6\" (UID: \"613a77a0-a13f-4704-8020-7c8690878f5d\") " pod="openshift-ingress/e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6"
Jul 23 14:10:42.660442 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:42.660284    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/613a77a0-a13f-4704-8020-7c8690878f5d-istio-token\") pod \"e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6\" (UID: \"613a77a0-a13f-4704-8020-7c8690878f5d\") " pod="openshift-ingress/e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6"
Jul 23 14:10:42.660442 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:42.660397    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/613a77a0-a13f-4704-8020-7c8690878f5d-istiod-ca-cert\") pod \"e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6\" (UID: \"613a77a0-a13f-4704-8020-7c8690878f5d\") " pod="openshift-ingress/e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6"
Jul 23 14:10:42.660537 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:42.660444    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/613a77a0-a13f-4704-8020-7c8690878f5d-istio-podinfo\") pod \"e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6\" (UID: \"613a77a0-a13f-4704-8020-7c8690878f5d\") " pod="openshift-ingress/e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6"
Jul 23 14:10:42.660537 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:42.660483    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/613a77a0-a13f-4704-8020-7c8690878f5d-istio-envoy\") pod \"e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6\" (UID: \"613a77a0-a13f-4704-8020-7c8690878f5d\") " pod="openshift-ingress/e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6"
Jul 23 14:10:42.660537 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:42.660509    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/613a77a0-a13f-4704-8020-7c8690878f5d-credential-socket\") pod \"e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6\" (UID: \"613a77a0-a13f-4704-8020-7c8690878f5d\") " pod="openshift-ingress/e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6"
Jul 23 14:10:42.660537 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:42.660528    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/613a77a0-a13f-4704-8020-7c8690878f5d-istio-data\") pod \"e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6\" (UID: \"613a77a0-a13f-4704-8020-7c8690878f5d\") " pod="openshift-ingress/e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6"
Jul 23 14:10:42.660756 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:42.660622    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/613a77a0-a13f-4704-8020-7c8690878f5d-workload-socket\") pod \"e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6\" (UID: \"613a77a0-a13f-4704-8020-7c8690878f5d\") " pod="openshift-ingress/e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6"
Jul 23 14:10:42.660756 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:42.660691    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/613a77a0-a13f-4704-8020-7c8690878f5d-workload-certs\") pod \"e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6\" (UID: \"613a77a0-a13f-4704-8020-7c8690878f5d\") " pod="openshift-ingress/e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6"
Jul 23 14:10:42.661007 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:42.660980    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/613a77a0-a13f-4704-8020-7c8690878f5d-credential-socket\") pod \"e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6\" (UID: \"613a77a0-a13f-4704-8020-7c8690878f5d\") " pod="openshift-ingress/e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6"
Jul 23 14:10:42.661146 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:42.661060    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/613a77a0-a13f-4704-8020-7c8690878f5d-istio-data\") pod \"e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6\" (UID: \"613a77a0-a13f-4704-8020-7c8690878f5d\") " pod="openshift-ingress/e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6"
Jul 23 14:10:42.661146 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:42.661125    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/613a77a0-a13f-4704-8020-7c8690878f5d-workload-certs\") pod \"e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6\" (UID: \"613a77a0-a13f-4704-8020-7c8690878f5d\") " pod="openshift-ingress/e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6"
Jul 23 14:10:42.661255 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:42.661154    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/613a77a0-a13f-4704-8020-7c8690878f5d-workload-socket\") pod \"e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6\" (UID: \"613a77a0-a13f-4704-8020-7c8690878f5d\") " pod="openshift-ingress/e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6"
Jul 23 14:10:42.661361 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:42.661339    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/613a77a0-a13f-4704-8020-7c8690878f5d-istiod-ca-cert\") pod \"e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6\" (UID: \"613a77a0-a13f-4704-8020-7c8690878f5d\") " pod="openshift-ingress/e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6"
Jul 23 14:10:42.662814 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:42.662791    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/613a77a0-a13f-4704-8020-7c8690878f5d-istio-envoy\") pod \"e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6\" (UID: \"613a77a0-a13f-4704-8020-7c8690878f5d\") " pod="openshift-ingress/e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6"
Jul 23 14:10:42.663092 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:42.663074    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/613a77a0-a13f-4704-8020-7c8690878f5d-istio-podinfo\") pod \"e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6\" (UID: \"613a77a0-a13f-4704-8020-7c8690878f5d\") " pod="openshift-ingress/e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6"
Jul 23 14:10:42.668682 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:42.668658    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jdvr\" (UniqueName: \"kubernetes.io/projected/613a77a0-a13f-4704-8020-7c8690878f5d-kube-api-access-9jdvr\") pod \"e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6\" (UID: \"613a77a0-a13f-4704-8020-7c8690878f5d\") " pod="openshift-ingress/e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6"
Jul 23 14:10:42.668775 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:42.668700    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/613a77a0-a13f-4704-8020-7c8690878f5d-istio-token\") pod \"e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6\" (UID: \"613a77a0-a13f-4704-8020-7c8690878f5d\") " pod="openshift-ingress/e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6"
Jul 23 14:10:42.765321 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:42.765215    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6"
Jul 23 14:10:42.913525 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:42.913499    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6"]
Jul 23 14:10:42.914904 ip-10-0-140-103 kubenswrapper[2573]: W0723 14:10:42.914868    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod613a77a0_a13f_4704_8020_7c8690878f5d.slice/crio-ac4d0aaa74d74c5addf30ffcfa08930f20e751d35bce0fbae44d9f5bb200ef1b WatchSource:0}: Error finding container ac4d0aaa74d74c5addf30ffcfa08930f20e751d35bce0fbae44d9f5bb200ef1b: Status 404 returned error can't find the container with id ac4d0aaa74d74c5addf30ffcfa08930f20e751d35bce0fbae44d9f5bb200ef1b
Jul 23 14:10:42.917133 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:42.917095    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 14:10:42.917206 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:42.917188    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 14:10:42.917253 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:42.917231    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 14:10:43.069793 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:43.069760    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0344bb4-85e2-43af-8142-a6cfae167175" path="/var/lib/kubelet/pods/e0344bb4-85e2-43af-8142-a6cfae167175/volumes"
Jul 23 14:10:43.088551 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:43.088516    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6" event={"ID":"613a77a0-a13f-4704-8020-7c8690878f5d","Type":"ContainerStarted","Data":"28a71a7f4bee8c49800f78a422eafea19e32a59d0f1b9d04687b52b8a69f6a23"}
Jul 23 14:10:43.088728 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:43.088572    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6" event={"ID":"613a77a0-a13f-4704-8020-7c8690878f5d","Type":"ContainerStarted","Data":"ac4d0aaa74d74c5addf30ffcfa08930f20e751d35bce0fbae44d9f5bb200ef1b"}
Jul 23 14:10:43.765931 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:43.765884    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6"
Jul 23 14:10:43.770922 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:43.770892    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6"
Jul 23 14:10:43.798189 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:43.798138    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6" podStartSLOduration=1.7981214620000001 podStartE2EDuration="1.798121462s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 14:10:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 14:10:43.113164153 +0000 UTC m=+1814.552665073" watchObservedRunningTime="2026-07-23 14:10:43.798121462 +0000 UTC m=+1815.237622379"
Jul 23 14:10:44.094436 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:44.094397    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6"
Jul 23 14:10:44.095302 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:44.095281    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6"
Jul 23 14:10:44.532290 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:44.532199    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:10:44.644932 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:44.644901    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:10:44.740180 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:44.740134    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:10:45.122909 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:45.122875    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:10:45.300693 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:45.300658    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:10:45.402504 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:45.402411    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:10:46.879883 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:46.879857    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-d9660af7-gw-openshift-default-7b756d744c-k94z6"
Jul 23 14:10:47.001473 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:47.001385    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8c88cac-31b7-4054-8104-fd171f87bc42-workload-certs\") pod \"b8c88cac-31b7-4054-8104-fd171f87bc42\" (UID: \"b8c88cac-31b7-4054-8104-fd171f87bc42\") "
Jul 23 14:10:47.001473 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:47.001443    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8c88cac-31b7-4054-8104-fd171f87bc42-istiod-ca-cert\") pod \"b8c88cac-31b7-4054-8104-fd171f87bc42\" (UID: \"b8c88cac-31b7-4054-8104-fd171f87bc42\") "
Jul 23 14:10:47.001644 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:47.001566    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8c88cac-31b7-4054-8104-fd171f87bc42-istio-token\") pod \"b8c88cac-31b7-4054-8104-fd171f87bc42\" (UID: \"b8c88cac-31b7-4054-8104-fd171f87bc42\") "
Jul 23 14:10:47.001644 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:47.001595    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gmq5g\" (UniqueName: \"kubernetes.io/projected/b8c88cac-31b7-4054-8104-fd171f87bc42-kube-api-access-gmq5g\") pod \"b8c88cac-31b7-4054-8104-fd171f87bc42\" (UID: \"b8c88cac-31b7-4054-8104-fd171f87bc42\") "
Jul 23 14:10:47.001644 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:47.001630    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8c88cac-31b7-4054-8104-fd171f87bc42-istio-podinfo\") pod \"b8c88cac-31b7-4054-8104-fd171f87bc42\" (UID: \"b8c88cac-31b7-4054-8104-fd171f87bc42\") "
Jul 23 14:10:47.001808 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:47.001644    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8c88cac-31b7-4054-8104-fd171f87bc42-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b8c88cac-31b7-4054-8104-fd171f87bc42" (UID: "b8c88cac-31b7-4054-8104-fd171f87bc42"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 14:10:47.001808 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:47.001670    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8c88cac-31b7-4054-8104-fd171f87bc42-credential-socket\") pod \"b8c88cac-31b7-4054-8104-fd171f87bc42\" (UID: \"b8c88cac-31b7-4054-8104-fd171f87bc42\") "
Jul 23 14:10:47.001808 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:47.001700    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8c88cac-31b7-4054-8104-fd171f87bc42-istio-envoy\") pod \"b8c88cac-31b7-4054-8104-fd171f87bc42\" (UID: \"b8c88cac-31b7-4054-8104-fd171f87bc42\") "
Jul 23 14:10:47.001808 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:47.001724    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8c88cac-31b7-4054-8104-fd171f87bc42-istio-data\") pod \"b8c88cac-31b7-4054-8104-fd171f87bc42\" (UID: \"b8c88cac-31b7-4054-8104-fd171f87bc42\") "
Jul 23 14:10:47.001808 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:47.001753    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8c88cac-31b7-4054-8104-fd171f87bc42-workload-socket\") pod \"b8c88cac-31b7-4054-8104-fd171f87bc42\" (UID: \"b8c88cac-31b7-4054-8104-fd171f87bc42\") "
Jul 23 14:10:47.002123 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:47.001873    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8c88cac-31b7-4054-8104-fd171f87bc42-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b8c88cac-31b7-4054-8104-fd171f87bc42" (UID: "b8c88cac-31b7-4054-8104-fd171f87bc42"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 14:10:47.002123 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:47.002056    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8c88cac-31b7-4054-8104-fd171f87bc42-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b8c88cac-31b7-4054-8104-fd171f87bc42" (UID: "b8c88cac-31b7-4054-8104-fd171f87bc42"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 14:10:47.002237 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:47.002130    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8c88cac-31b7-4054-8104-fd171f87bc42-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b8c88cac-31b7-4054-8104-fd171f87bc42" (UID: "b8c88cac-31b7-4054-8104-fd171f87bc42"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 14:10:47.002315 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:47.002299    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8c88cac-31b7-4054-8104-fd171f87bc42-credential-socket\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:10:47.002373 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:47.002320    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8c88cac-31b7-4054-8104-fd171f87bc42-workload-socket\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:10:47.002373 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:47.002333    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8c88cac-31b7-4054-8104-fd171f87bc42-workload-certs\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:10:47.002373 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:47.002347    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8c88cac-31b7-4054-8104-fd171f87bc42-istiod-ca-cert\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:10:47.002803 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:47.002776    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8c88cac-31b7-4054-8104-fd171f87bc42-istio-data" (OuterVolumeSpecName: "istio-data") pod "b8c88cac-31b7-4054-8104-fd171f87bc42" (UID: "b8c88cac-31b7-4054-8104-fd171f87bc42"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 14:10:47.003991 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:47.003959    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8c88cac-31b7-4054-8104-fd171f87bc42-kube-api-access-gmq5g" (OuterVolumeSpecName: "kube-api-access-gmq5g") pod "b8c88cac-31b7-4054-8104-fd171f87bc42" (UID: "b8c88cac-31b7-4054-8104-fd171f87bc42"). InnerVolumeSpecName "kube-api-access-gmq5g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 14:10:47.003991 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:47.003951    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8c88cac-31b7-4054-8104-fd171f87bc42-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b8c88cac-31b7-4054-8104-fd171f87bc42" (UID: "b8c88cac-31b7-4054-8104-fd171f87bc42"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 14:10:47.004302 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:47.004277    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8c88cac-31b7-4054-8104-fd171f87bc42-istio-token" (OuterVolumeSpecName: "istio-token") pod "b8c88cac-31b7-4054-8104-fd171f87bc42" (UID: "b8c88cac-31b7-4054-8104-fd171f87bc42"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 14:10:47.004387 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:47.004313    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b8c88cac-31b7-4054-8104-fd171f87bc42-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b8c88cac-31b7-4054-8104-fd171f87bc42" (UID: "b8c88cac-31b7-4054-8104-fd171f87bc42"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 14:10:47.103129 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:47.103094    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8c88cac-31b7-4054-8104-fd171f87bc42-istio-token\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:10:47.103129 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:47.103123    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gmq5g\" (UniqueName: \"kubernetes.io/projected/b8c88cac-31b7-4054-8104-fd171f87bc42-kube-api-access-gmq5g\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:10:47.103129 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:47.103133    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8c88cac-31b7-4054-8104-fd171f87bc42-istio-podinfo\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:10:47.103344 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:47.103142    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8c88cac-31b7-4054-8104-fd171f87bc42-istio-envoy\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:10:47.103344 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:47.103150    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8c88cac-31b7-4054-8104-fd171f87bc42-istio-data\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:10:47.116522 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:47.116491    2573 generic.go:356] "Generic (PLEG): container finished" podID="b8c88cac-31b7-4054-8104-fd171f87bc42" containerID="26157b13e32e1c16e756976089020629e6acd07019ac99e1da136a0a44e40989" exitCode=0
Jul 23 14:10:47.116650 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:47.116542    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-d9660af7-gw-openshift-default-7b756d744c-k94z6"
Jul 23 14:10:47.116650 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:47.116583    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-d9660af7-gw-openshift-default-7b756d744c-k94z6" event={"ID":"b8c88cac-31b7-4054-8104-fd171f87bc42","Type":"ContainerDied","Data":"26157b13e32e1c16e756976089020629e6acd07019ac99e1da136a0a44e40989"}
Jul 23 14:10:47.116650 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:47.116645    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-d9660af7-gw-openshift-default-7b756d744c-k94z6" event={"ID":"b8c88cac-31b7-4054-8104-fd171f87bc42","Type":"ContainerDied","Data":"5dd643fb367fe0684793223f1aa0f1b1a4aa751830c15e8be6cb04320779e2c3"}
Jul 23 14:10:47.116834 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:47.116676    2573 scope.go:117] "RemoveContainer" containerID="26157b13e32e1c16e756976089020629e6acd07019ac99e1da136a0a44e40989"
Jul 23 14:10:47.126055 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:47.126038    2573 scope.go:117] "RemoveContainer" containerID="a0a4014d8832492508b90a76b1d3d93d4af5774a03f28d8bb45b1abc96818238"
Jul 23 14:10:47.134468 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:47.134451    2573 scope.go:117] "RemoveContainer" containerID="26157b13e32e1c16e756976089020629e6acd07019ac99e1da136a0a44e40989"
Jul 23 14:10:47.134724 ip-10-0-140-103 kubenswrapper[2573]: E0723 14:10:47.134706    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26157b13e32e1c16e756976089020629e6acd07019ac99e1da136a0a44e40989\": container with ID starting with 26157b13e32e1c16e756976089020629e6acd07019ac99e1da136a0a44e40989 not found: ID does not exist" containerID="26157b13e32e1c16e756976089020629e6acd07019ac99e1da136a0a44e40989"
Jul 23 14:10:47.134795 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:47.134737    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26157b13e32e1c16e756976089020629e6acd07019ac99e1da136a0a44e40989"} err="failed to get container status \"26157b13e32e1c16e756976089020629e6acd07019ac99e1da136a0a44e40989\": rpc error: code = NotFound desc = could not find container \"26157b13e32e1c16e756976089020629e6acd07019ac99e1da136a0a44e40989\": container with ID starting with 26157b13e32e1c16e756976089020629e6acd07019ac99e1da136a0a44e40989 not found: ID does not exist"
Jul 23 14:10:47.134795 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:47.134755    2573 scope.go:117] "RemoveContainer" containerID="a0a4014d8832492508b90a76b1d3d93d4af5774a03f28d8bb45b1abc96818238"
Jul 23 14:10:47.135004 ip-10-0-140-103 kubenswrapper[2573]: E0723 14:10:47.134988    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0a4014d8832492508b90a76b1d3d93d4af5774a03f28d8bb45b1abc96818238\": container with ID starting with a0a4014d8832492508b90a76b1d3d93d4af5774a03f28d8bb45b1abc96818238 not found: ID does not exist" containerID="a0a4014d8832492508b90a76b1d3d93d4af5774a03f28d8bb45b1abc96818238"
Jul 23 14:10:47.135090 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:47.135007    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0a4014d8832492508b90a76b1d3d93d4af5774a03f28d8bb45b1abc96818238"} err="failed to get container status \"a0a4014d8832492508b90a76b1d3d93d4af5774a03f28d8bb45b1abc96818238\": rpc error: code = NotFound desc = could not find container \"a0a4014d8832492508b90a76b1d3d93d4af5774a03f28d8bb45b1abc96818238\": container with ID starting with a0a4014d8832492508b90a76b1d3d93d4af5774a03f28d8bb45b1abc96818238 not found: ID does not exist"
Jul 23 14:10:47.149972 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:47.149947    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-d9660af7-gw-openshift-default-7b756d744c-k94z6"]
Jul 23 14:10:47.152620 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:47.152596    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-d9660af7-gw-openshift-default-7b756d744c-k94z6"]
Jul 23 14:10:49.069690 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:49.069655    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8c88cac-31b7-4054-8104-fd171f87bc42" path="/var/lib/kubelet/pods/b8c88cac-31b7-4054-8104-fd171f87bc42/volumes"
Jul 23 14:10:58.944487 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:58.944457    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:10:59.044261 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:59.044225    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:10:59.096239 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:59.096200    2573 patch_prober.go:28] interesting pod/e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Jul 23 14:10:59.096426 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:59.096272    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6" podUID="613a77a0-a13f-4704-8020-7c8690878f5d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Jul 23 14:10:59.193415 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:59.193381    2573 generic.go:356] "Generic (PLEG): container finished" podID="613a77a0-a13f-4704-8020-7c8690878f5d" containerID="28a71a7f4bee8c49800f78a422eafea19e32a59d0f1b9d04687b52b8a69f6a23" exitCode=0
Jul 23 14:10:59.193583 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:59.193455    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6" event={"ID":"613a77a0-a13f-4704-8020-7c8690878f5d","Type":"ContainerDied","Data":"28a71a7f4bee8c49800f78a422eafea19e32a59d0f1b9d04687b52b8a69f6a23"}
Jul 23 14:10:59.193896 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:59.193882    2573 scope.go:117] "RemoveContainer" containerID="28a71a7f4bee8c49800f78a422eafea19e32a59d0f1b9d04687b52b8a69f6a23"
Jul 23 14:10:59.194926 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:59.194875    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 14:10:59.194988 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:59.194943    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 14:10:59.194988 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:10:59.194976    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 14:11:00.201450 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:00.201398    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6" event={"ID":"613a77a0-a13f-4704-8020-7c8690878f5d","Type":"ContainerStarted","Data":"838b0d1949e7d68f02dd78e8a0eeec11221ed467a9bc774b3bc25871411c8996"}
Jul 23 14:11:00.766166 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:00.766124    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6"
Jul 23 14:11:00.766397 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:00.766373    2573 patch_prober.go:28] interesting pod/e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Jul 23 14:11:00.766449 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:00.766425    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6" podUID="613a77a0-a13f-4704-8020-7c8690878f5d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Jul 23 14:11:01.766340 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:01.766303    2573 patch_prober.go:28] interesting pod/e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Jul 23 14:11:01.766737 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:01.766361    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6" podUID="613a77a0-a13f-4704-8020-7c8690878f5d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Jul 23 14:11:02.765620 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:02.765581    2573 patch_prober.go:28] interesting pod/e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Jul 23 14:11:02.765779 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:02.765636    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6" podUID="613a77a0-a13f-4704-8020-7c8690878f5d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Jul 23 14:11:03.765789 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:03.765751    2573 patch_prober.go:28] interesting pod/e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Jul 23 14:11:03.766225 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:03.765811    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6" podUID="613a77a0-a13f-4704-8020-7c8690878f5d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Jul 23 14:11:04.769473 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:04.769436    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6"
Jul 23 14:11:04.769947 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:04.769926    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6"
Jul 23 14:11:04.770558 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:04.770539    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6"
Jul 23 14:11:06.210841 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:06.210804    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:11:06.312076 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:06.312039    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:11:10.330000 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:10.329962    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-daf75dd9-m99jk"]
Jul 23 14:11:10.330484 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:10.330469    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8c88cac-31b7-4054-8104-fd171f87bc42" containerName="istio-proxy"
Jul 23 14:11:10.330529 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:10.330485    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8c88cac-31b7-4054-8104-fd171f87bc42" containerName="istio-proxy"
Jul 23 14:11:10.330529 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:10.330499    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8c88cac-31b7-4054-8104-fd171f87bc42" containerName="istio-proxy"
Jul 23 14:11:10.330529 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:10.330509    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8c88cac-31b7-4054-8104-fd171f87bc42" containerName="istio-proxy"
Jul 23 14:11:10.330627 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:10.330588    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8c88cac-31b7-4054-8104-fd171f87bc42" containerName="istio-proxy"
Jul 23 14:11:10.330627 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:10.330597    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8c88cac-31b7-4054-8104-fd171f87bc42" containerName="istio-proxy"
Jul 23 14:11:10.333789 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:10.333766    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-daf75dd9-m99jk"
Jul 23 14:11:10.334453 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:10.334423    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/599dd813-9a7d-4709-a068-f31dc9f3b335-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-daf75dd9-m99jk\" (UID: \"599dd813-9a7d-4709-a068-f31dc9f3b335\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-daf75dd9-m99jk"
Jul 23 14:11:10.336022 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:10.335989    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6pngt\""
Jul 23 14:11:10.342786 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:10.342760    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-daf75dd9-m99jk"]
Jul 23 14:11:10.435266 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:10.435223    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/599dd813-9a7d-4709-a068-f31dc9f3b335-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-daf75dd9-m99jk\" (UID: \"599dd813-9a7d-4709-a068-f31dc9f3b335\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-daf75dd9-m99jk"
Jul 23 14:11:10.435894 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:10.435869    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/599dd813-9a7d-4709-a068-f31dc9f3b335-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-daf75dd9-m99jk\" (UID: \"599dd813-9a7d-4709-a068-f31dc9f3b335\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-daf75dd9-m99jk"
Jul 23 14:11:10.645981 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:10.645896    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-daf75dd9-m99jk"
Jul 23 14:11:10.995551 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:10.995517    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-daf75dd9-m99jk"]
Jul 23 14:11:10.996811 ip-10-0-140-103 kubenswrapper[2573]: W0723 14:11:10.996785    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod599dd813_9a7d_4709_a068_f31dc9f3b335.slice/crio-6bcd796ed063e2601d8ffa7ef45cce79713a700cc2ff1c4e64b7c5db61862d85 WatchSource:0}: Error finding container 6bcd796ed063e2601d8ffa7ef45cce79713a700cc2ff1c4e64b7c5db61862d85: Status 404 returned error can't find the container with id 6bcd796ed063e2601d8ffa7ef45cce79713a700cc2ff1c4e64b7c5db61862d85
Jul 23 14:11:11.271952 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:11.271917    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-daf75dd9-m99jk" event={"ID":"599dd813-9a7d-4709-a068-f31dc9f3b335","Type":"ContainerStarted","Data":"6bcd796ed063e2601d8ffa7ef45cce79713a700cc2ff1c4e64b7c5db61862d85"}
Jul 23 14:11:12.280304 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:12.280271    2573 generic.go:356] "Generic (PLEG): container finished" podID="599dd813-9a7d-4709-a068-f31dc9f3b335" containerID="4efed94c53695d023065e11eb67f8b46e4fae853c6f252e0308cbb637862030b" exitCode=0
Jul 23 14:11:12.280650 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:12.280354    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-daf75dd9-m99jk" event={"ID":"599dd813-9a7d-4709-a068-f31dc9f3b335","Type":"ContainerDied","Data":"4efed94c53695d023065e11eb67f8b46e4fae853c6f252e0308cbb637862030b"}
Jul 23 14:11:13.425869 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:13.425846    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-daf75dd9-m99jk"
Jul 23 14:11:13.458955 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:13.458926    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/599dd813-9a7d-4709-a068-f31dc9f3b335-maas-api-service-ca\") pod \"599dd813-9a7d-4709-a068-f31dc9f3b335\" (UID: \"599dd813-9a7d-4709-a068-f31dc9f3b335\") "
Jul 23 14:11:13.459376 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:13.459348    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/599dd813-9a7d-4709-a068-f31dc9f3b335-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "599dd813-9a7d-4709-a068-f31dc9f3b335" (UID: "599dd813-9a7d-4709-a068-f31dc9f3b335"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 14:11:13.559928 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:13.559900    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/599dd813-9a7d-4709-a068-f31dc9f3b335-maas-api-service-ca\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:11:14.293246 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:14.293207    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-daf75dd9-m99jk"
Jul 23 14:11:14.293246 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:14.293232    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-daf75dd9-m99jk" event={"ID":"599dd813-9a7d-4709-a068-f31dc9f3b335","Type":"ContainerDied","Data":"6bcd796ed063e2601d8ffa7ef45cce79713a700cc2ff1c4e64b7c5db61862d85"}
Jul 23 14:11:14.293467 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:14.293289    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6bcd796ed063e2601d8ffa7ef45cce79713a700cc2ff1c4e64b7c5db61862d85"
Jul 23 14:11:20.800752 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:20.800716    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:11:25.406797 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:25.406758    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:11:25.407827 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:25.407794    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-daf75dd9-m99jk"]
Jul 23 14:11:25.410219 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:25.410200    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-daf75dd9-m99jk"]
Jul 23 14:11:26.609791 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:26.609758    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6"]
Jul 23 14:11:26.610249 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:26.609979    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6" podUID="613a77a0-a13f-4704-8020-7c8690878f5d" containerName="istio-proxy" containerID="cri-o://838b0d1949e7d68f02dd78e8a0eeec11221ed467a9bc774b3bc25871411c8996" gracePeriod=30
Jul 23 14:11:26.626807 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:26.626779    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:11:26.850705 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:26.850672    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:11:27.069482 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:27.069447    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="599dd813-9a7d-4709-a068-f31dc9f3b335" path="/var/lib/kubelet/pods/599dd813-9a7d-4709-a068-f31dc9f3b335/volumes"
Jul 23 14:11:27.085940 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:27.085908    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:11:27.357784 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:27.357699    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-854fd7f2-openshift-default-76d7dc9595-nmtkw"]
Jul 23 14:11:27.358250 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:27.358233    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="599dd813-9a7d-4709-a068-f31dc9f3b335" containerName="revoke-keys"
Jul 23 14:11:27.358370 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:27.358254    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="599dd813-9a7d-4709-a068-f31dc9f3b335" containerName="revoke-keys"
Jul 23 14:11:27.358370 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:27.358345    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="599dd813-9a7d-4709-a068-f31dc9f3b335" containerName="revoke-keys"
Jul 23 14:11:27.361706 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:27.361685    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-854fd7f2-openshift-default-76d7dc9595-nmtkw"
Jul 23 14:11:27.364429 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:27.364413    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-854fd7f2-openshift-default-dockercfg-tlbw6\""
Jul 23 14:11:27.381076 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:27.381035    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-854fd7f2-openshift-default-76d7dc9595-nmtkw"]
Jul 23 14:11:27.384336 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:27.384314    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:11:27.492115 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:27.492078    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/efa7342d-f7eb-49e5-bfce-69199b257abb-workload-certs\") pod \"e2e-derive-854fd7f2-openshift-default-76d7dc9595-nmtkw\" (UID: \"efa7342d-f7eb-49e5-bfce-69199b257abb\") " pod="openshift-ingress/e2e-derive-854fd7f2-openshift-default-76d7dc9595-nmtkw"
Jul 23 14:11:27.492318 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:27.492154    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/efa7342d-f7eb-49e5-bfce-69199b257abb-workload-socket\") pod \"e2e-derive-854fd7f2-openshift-default-76d7dc9595-nmtkw\" (UID: \"efa7342d-f7eb-49e5-bfce-69199b257abb\") " pod="openshift-ingress/e2e-derive-854fd7f2-openshift-default-76d7dc9595-nmtkw"
Jul 23 14:11:27.492318 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:27.492187    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/efa7342d-f7eb-49e5-bfce-69199b257abb-istio-envoy\") pod \"e2e-derive-854fd7f2-openshift-default-76d7dc9595-nmtkw\" (UID: \"efa7342d-f7eb-49e5-bfce-69199b257abb\") " pod="openshift-ingress/e2e-derive-854fd7f2-openshift-default-76d7dc9595-nmtkw"
Jul 23 14:11:27.492318 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:27.492241    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/efa7342d-f7eb-49e5-bfce-69199b257abb-istio-token\") pod \"e2e-derive-854fd7f2-openshift-default-76d7dc9595-nmtkw\" (UID: \"efa7342d-f7eb-49e5-bfce-69199b257abb\") " pod="openshift-ingress/e2e-derive-854fd7f2-openshift-default-76d7dc9595-nmtkw"
Jul 23 14:11:27.492318 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:27.492306    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/efa7342d-f7eb-49e5-bfce-69199b257abb-credential-socket\") pod \"e2e-derive-854fd7f2-openshift-default-76d7dc9595-nmtkw\" (UID: \"efa7342d-f7eb-49e5-bfce-69199b257abb\") " pod="openshift-ingress/e2e-derive-854fd7f2-openshift-default-76d7dc9595-nmtkw"
Jul 23 14:11:27.492538 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:27.492332    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sh6gd\" (UniqueName: \"kubernetes.io/projected/efa7342d-f7eb-49e5-bfce-69199b257abb-kube-api-access-sh6gd\") pod \"e2e-derive-854fd7f2-openshift-default-76d7dc9595-nmtkw\" (UID: \"efa7342d-f7eb-49e5-bfce-69199b257abb\") " pod="openshift-ingress/e2e-derive-854fd7f2-openshift-default-76d7dc9595-nmtkw"
Jul 23 14:11:27.492538 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:27.492361    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/efa7342d-f7eb-49e5-bfce-69199b257abb-istio-podinfo\") pod \"e2e-derive-854fd7f2-openshift-default-76d7dc9595-nmtkw\" (UID: \"efa7342d-f7eb-49e5-bfce-69199b257abb\") " pod="openshift-ingress/e2e-derive-854fd7f2-openshift-default-76d7dc9595-nmtkw"
Jul 23 14:11:27.492538 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:27.492396    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/efa7342d-f7eb-49e5-bfce-69199b257abb-istiod-ca-cert\") pod \"e2e-derive-854fd7f2-openshift-default-76d7dc9595-nmtkw\" (UID: \"efa7342d-f7eb-49e5-bfce-69199b257abb\") " pod="openshift-ingress/e2e-derive-854fd7f2-openshift-default-76d7dc9595-nmtkw"
Jul 23 14:11:27.492538 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:27.492418    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/efa7342d-f7eb-49e5-bfce-69199b257abb-istio-data\") pod \"e2e-derive-854fd7f2-openshift-default-76d7dc9595-nmtkw\" (UID: \"efa7342d-f7eb-49e5-bfce-69199b257abb\") " pod="openshift-ingress/e2e-derive-854fd7f2-openshift-default-76d7dc9595-nmtkw"
Jul 23 14:11:27.593368 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:27.593329    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/efa7342d-f7eb-49e5-bfce-69199b257abb-istio-token\") pod \"e2e-derive-854fd7f2-openshift-default-76d7dc9595-nmtkw\" (UID: \"efa7342d-f7eb-49e5-bfce-69199b257abb\") " pod="openshift-ingress/e2e-derive-854fd7f2-openshift-default-76d7dc9595-nmtkw"
Jul 23 14:11:27.593368 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:27.593372    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/efa7342d-f7eb-49e5-bfce-69199b257abb-credential-socket\") pod \"e2e-derive-854fd7f2-openshift-default-76d7dc9595-nmtkw\" (UID: \"efa7342d-f7eb-49e5-bfce-69199b257abb\") " pod="openshift-ingress/e2e-derive-854fd7f2-openshift-default-76d7dc9595-nmtkw"
Jul 23 14:11:27.593578 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:27.593394    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sh6gd\" (UniqueName: \"kubernetes.io/projected/efa7342d-f7eb-49e5-bfce-69199b257abb-kube-api-access-sh6gd\") pod \"e2e-derive-854fd7f2-openshift-default-76d7dc9595-nmtkw\" (UID: \"efa7342d-f7eb-49e5-bfce-69199b257abb\") " pod="openshift-ingress/e2e-derive-854fd7f2-openshift-default-76d7dc9595-nmtkw"
Jul 23 14:11:27.593578 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:27.593512    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/efa7342d-f7eb-49e5-bfce-69199b257abb-istio-podinfo\") pod \"e2e-derive-854fd7f2-openshift-default-76d7dc9595-nmtkw\" (UID: \"efa7342d-f7eb-49e5-bfce-69199b257abb\") " pod="openshift-ingress/e2e-derive-854fd7f2-openshift-default-76d7dc9595-nmtkw"
Jul 23 14:11:27.593578 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:27.593553    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/efa7342d-f7eb-49e5-bfce-69199b257abb-istiod-ca-cert\") pod \"e2e-derive-854fd7f2-openshift-default-76d7dc9595-nmtkw\" (UID: \"efa7342d-f7eb-49e5-bfce-69199b257abb\") " pod="openshift-ingress/e2e-derive-854fd7f2-openshift-default-76d7dc9595-nmtkw"
Jul 23 14:11:27.593772 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:27.593587    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/efa7342d-f7eb-49e5-bfce-69199b257abb-istio-data\") pod \"e2e-derive-854fd7f2-openshift-default-76d7dc9595-nmtkw\" (UID: \"efa7342d-f7eb-49e5-bfce-69199b257abb\") " pod="openshift-ingress/e2e-derive-854fd7f2-openshift-default-76d7dc9595-nmtkw"
Jul 23 14:11:27.593772 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:27.593684    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/efa7342d-f7eb-49e5-bfce-69199b257abb-workload-certs\") pod \"e2e-derive-854fd7f2-openshift-default-76d7dc9595-nmtkw\" (UID: \"efa7342d-f7eb-49e5-bfce-69199b257abb\") " pod="openshift-ingress/e2e-derive-854fd7f2-openshift-default-76d7dc9595-nmtkw"
Jul 23 14:11:27.593772 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:27.593745    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/efa7342d-f7eb-49e5-bfce-69199b257abb-workload-socket\") pod \"e2e-derive-854fd7f2-openshift-default-76d7dc9595-nmtkw\" (UID: \"efa7342d-f7eb-49e5-bfce-69199b257abb\") " pod="openshift-ingress/e2e-derive-854fd7f2-openshift-default-76d7dc9595-nmtkw"
Jul 23 14:11:27.593930 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:27.593770    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/efa7342d-f7eb-49e5-bfce-69199b257abb-credential-socket\") pod \"e2e-derive-854fd7f2-openshift-default-76d7dc9595-nmtkw\" (UID: \"efa7342d-f7eb-49e5-bfce-69199b257abb\") " pod="openshift-ingress/e2e-derive-854fd7f2-openshift-default-76d7dc9595-nmtkw"
Jul 23 14:11:27.593930 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:27.593776    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/efa7342d-f7eb-49e5-bfce-69199b257abb-istio-envoy\") pod \"e2e-derive-854fd7f2-openshift-default-76d7dc9595-nmtkw\" (UID: \"efa7342d-f7eb-49e5-bfce-69199b257abb\") " pod="openshift-ingress/e2e-derive-854fd7f2-openshift-default-76d7dc9595-nmtkw"
Jul 23 14:11:27.594054 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:27.594024    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/efa7342d-f7eb-49e5-bfce-69199b257abb-istio-data\") pod \"e2e-derive-854fd7f2-openshift-default-76d7dc9595-nmtkw\" (UID: \"efa7342d-f7eb-49e5-bfce-69199b257abb\") " pod="openshift-ingress/e2e-derive-854fd7f2-openshift-default-76d7dc9595-nmtkw"
Jul 23 14:11:27.594151 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:27.594131    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/efa7342d-f7eb-49e5-bfce-69199b257abb-workload-socket\") pod \"e2e-derive-854fd7f2-openshift-default-76d7dc9595-nmtkw\" (UID: \"efa7342d-f7eb-49e5-bfce-69199b257abb\") " pod="openshift-ingress/e2e-derive-854fd7f2-openshift-default-76d7dc9595-nmtkw"
Jul 23 14:11:27.594205 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:27.594187    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/efa7342d-f7eb-49e5-bfce-69199b257abb-workload-certs\") pod \"e2e-derive-854fd7f2-openshift-default-76d7dc9595-nmtkw\" (UID: \"efa7342d-f7eb-49e5-bfce-69199b257abb\") " pod="openshift-ingress/e2e-derive-854fd7f2-openshift-default-76d7dc9595-nmtkw"
Jul 23 14:11:27.594332 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:27.594307    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/efa7342d-f7eb-49e5-bfce-69199b257abb-istiod-ca-cert\") pod \"e2e-derive-854fd7f2-openshift-default-76d7dc9595-nmtkw\" (UID: \"efa7342d-f7eb-49e5-bfce-69199b257abb\") " pod="openshift-ingress/e2e-derive-854fd7f2-openshift-default-76d7dc9595-nmtkw"
Jul 23 14:11:27.596048 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:27.596008    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/efa7342d-f7eb-49e5-bfce-69199b257abb-istio-envoy\") pod \"e2e-derive-854fd7f2-openshift-default-76d7dc9595-nmtkw\" (UID: \"efa7342d-f7eb-49e5-bfce-69199b257abb\") " pod="openshift-ingress/e2e-derive-854fd7f2-openshift-default-76d7dc9595-nmtkw"
Jul 23 14:11:27.596200 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:27.596184    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/efa7342d-f7eb-49e5-bfce-69199b257abb-istio-podinfo\") pod \"e2e-derive-854fd7f2-openshift-default-76d7dc9595-nmtkw\" (UID: \"efa7342d-f7eb-49e5-bfce-69199b257abb\") " pod="openshift-ingress/e2e-derive-854fd7f2-openshift-default-76d7dc9595-nmtkw"
Jul 23 14:11:27.601618 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:27.601597    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/efa7342d-f7eb-49e5-bfce-69199b257abb-istio-token\") pod \"e2e-derive-854fd7f2-openshift-default-76d7dc9595-nmtkw\" (UID: \"efa7342d-f7eb-49e5-bfce-69199b257abb\") " pod="openshift-ingress/e2e-derive-854fd7f2-openshift-default-76d7dc9595-nmtkw"
Jul 23 14:11:27.601702 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:27.601623    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sh6gd\" (UniqueName: \"kubernetes.io/projected/efa7342d-f7eb-49e5-bfce-69199b257abb-kube-api-access-sh6gd\") pod \"e2e-derive-854fd7f2-openshift-default-76d7dc9595-nmtkw\" (UID: \"efa7342d-f7eb-49e5-bfce-69199b257abb\") " pod="openshift-ingress/e2e-derive-854fd7f2-openshift-default-76d7dc9595-nmtkw"
Jul 23 14:11:27.679930 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:27.679826    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-854fd7f2-openshift-default-76d7dc9595-nmtkw"
Jul 23 14:11:27.717190 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:27.717142    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:11:27.829477 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:27.829446    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-854fd7f2-openshift-default-76d7dc9595-nmtkw"]
Jul 23 14:11:27.830194 ip-10-0-140-103 kubenswrapper[2573]: W0723 14:11:27.830168    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefa7342d_f7eb_49e5_bfce_69199b257abb.slice/crio-ae0d4c3dda39df81bd72f453929d74438afb949cfb6049e91a42bbf13641381c WatchSource:0}: Error finding container ae0d4c3dda39df81bd72f453929d74438afb949cfb6049e91a42bbf13641381c: Status 404 returned error can't find the container with id ae0d4c3dda39df81bd72f453929d74438afb949cfb6049e91a42bbf13641381c
Jul 23 14:11:27.832754 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:27.832727    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 14:11:27.832815 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:27.832787    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 14:11:27.832853 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:27.832815    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 14:11:28.394987 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:28.394942    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-854fd7f2-openshift-default-76d7dc9595-nmtkw" event={"ID":"efa7342d-f7eb-49e5-bfce-69199b257abb","Type":"ContainerStarted","Data":"fab86fcb8d3f2720015bc0ab18ed09e52125887ccd79ad2ab39ab61c98001118"}
Jul 23 14:11:28.395217 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:28.395067    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-854fd7f2-openshift-default-76d7dc9595-nmtkw" event={"ID":"efa7342d-f7eb-49e5-bfce-69199b257abb","Type":"ContainerStarted","Data":"ae0d4c3dda39df81bd72f453929d74438afb949cfb6049e91a42bbf13641381c"}
Jul 23 14:11:28.424037 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:28.417503    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-854fd7f2-openshift-default-76d7dc9595-nmtkw" podStartSLOduration=1.417483453 podStartE2EDuration="1.417483453s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 14:11:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 14:11:28.414534981 +0000 UTC m=+1859.854035912" watchObservedRunningTime="2026-07-23 14:11:28.417483453 +0000 UTC m=+1859.856984373"
Jul 23 14:11:28.681074 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:28.680952    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-854fd7f2-openshift-default-76d7dc9595-nmtkw"
Jul 23 14:11:28.685958 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:28.685931    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-854fd7f2-openshift-default-76d7dc9595-nmtkw"
Jul 23 14:11:29.400832 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:29.400787    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-854fd7f2-openshift-default-76d7dc9595-nmtkw"
Jul 23 14:11:29.401836 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:29.401814    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-854fd7f2-openshift-default-76d7dc9595-nmtkw"
Jul 23 14:11:29.751265 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:29.751181    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:11:29.859607 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:29.859577    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:11:30.021077 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:30.020989    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:11:30.316257 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:30.316228    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:11:30.672789 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:30.672693    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:11:30.772995 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:30.772951    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:11:31.861919 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:31.861889    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6"
Jul 23 14:11:31.937802 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:31.937717    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/613a77a0-a13f-4704-8020-7c8690878f5d-workload-certs\") pod \"613a77a0-a13f-4704-8020-7c8690878f5d\" (UID: \"613a77a0-a13f-4704-8020-7c8690878f5d\") "
Jul 23 14:11:31.937802 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:31.937756    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/613a77a0-a13f-4704-8020-7c8690878f5d-workload-socket\") pod \"613a77a0-a13f-4704-8020-7c8690878f5d\" (UID: \"613a77a0-a13f-4704-8020-7c8690878f5d\") "
Jul 23 14:11:31.937802 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:31.937786    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/613a77a0-a13f-4704-8020-7c8690878f5d-istio-token\") pod \"613a77a0-a13f-4704-8020-7c8690878f5d\" (UID: \"613a77a0-a13f-4704-8020-7c8690878f5d\") "
Jul 23 14:11:31.938144 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:31.937841    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/613a77a0-a13f-4704-8020-7c8690878f5d-istio-data\") pod \"613a77a0-a13f-4704-8020-7c8690878f5d\" (UID: \"613a77a0-a13f-4704-8020-7c8690878f5d\") "
Jul 23 14:11:31.938144 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:31.937894    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9jdvr\" (UniqueName: \"kubernetes.io/projected/613a77a0-a13f-4704-8020-7c8690878f5d-kube-api-access-9jdvr\") pod \"613a77a0-a13f-4704-8020-7c8690878f5d\" (UID: \"613a77a0-a13f-4704-8020-7c8690878f5d\") "
Jul 23 14:11:31.938144 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:31.937950    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/613a77a0-a13f-4704-8020-7c8690878f5d-credential-socket\") pod \"613a77a0-a13f-4704-8020-7c8690878f5d\" (UID: \"613a77a0-a13f-4704-8020-7c8690878f5d\") "
Jul 23 14:11:31.938144 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:31.937992    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/613a77a0-a13f-4704-8020-7c8690878f5d-istio-podinfo\") pod \"613a77a0-a13f-4704-8020-7c8690878f5d\" (UID: \"613a77a0-a13f-4704-8020-7c8690878f5d\") "
Jul 23 14:11:31.938144 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:31.938059    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/613a77a0-a13f-4704-8020-7c8690878f5d-istio-envoy\") pod \"613a77a0-a13f-4704-8020-7c8690878f5d\" (UID: \"613a77a0-a13f-4704-8020-7c8690878f5d\") "
Jul 23 14:11:31.938144 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:31.938059    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/613a77a0-a13f-4704-8020-7c8690878f5d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "613a77a0-a13f-4704-8020-7c8690878f5d" (UID: "613a77a0-a13f-4704-8020-7c8690878f5d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 14:11:31.938144 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:31.938077    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/613a77a0-a13f-4704-8020-7c8690878f5d-istiod-ca-cert\") pod \"613a77a0-a13f-4704-8020-7c8690878f5d\" (UID: \"613a77a0-a13f-4704-8020-7c8690878f5d\") "
Jul 23 14:11:31.938514 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:31.938278    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/613a77a0-a13f-4704-8020-7c8690878f5d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "613a77a0-a13f-4704-8020-7c8690878f5d" (UID: "613a77a0-a13f-4704-8020-7c8690878f5d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 14:11:31.938514 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:31.938421    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/613a77a0-a13f-4704-8020-7c8690878f5d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "613a77a0-a13f-4704-8020-7c8690878f5d" (UID: "613a77a0-a13f-4704-8020-7c8690878f5d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 14:11:31.938514 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:31.938446    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/613a77a0-a13f-4704-8020-7c8690878f5d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "613a77a0-a13f-4704-8020-7c8690878f5d" (UID: "613a77a0-a13f-4704-8020-7c8690878f5d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 14:11:31.938686 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:31.938546    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/613a77a0-a13f-4704-8020-7c8690878f5d-workload-certs\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:11:31.938686 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:31.938567    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/613a77a0-a13f-4704-8020-7c8690878f5d-workload-socket\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:11:31.938686 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:31.938580    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/613a77a0-a13f-4704-8020-7c8690878f5d-credential-socket\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:11:31.938686 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:31.938595    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/613a77a0-a13f-4704-8020-7c8690878f5d-istiod-ca-cert\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:11:31.939259 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:31.939231    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/613a77a0-a13f-4704-8020-7c8690878f5d-istio-data" (OuterVolumeSpecName: "istio-data") pod "613a77a0-a13f-4704-8020-7c8690878f5d" (UID: "613a77a0-a13f-4704-8020-7c8690878f5d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 14:11:31.940282 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:31.940236    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/613a77a0-a13f-4704-8020-7c8690878f5d-kube-api-access-9jdvr" (OuterVolumeSpecName: "kube-api-access-9jdvr") pod "613a77a0-a13f-4704-8020-7c8690878f5d" (UID: "613a77a0-a13f-4704-8020-7c8690878f5d"). InnerVolumeSpecName "kube-api-access-9jdvr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 14:11:31.940282 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:31.940267    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/613a77a0-a13f-4704-8020-7c8690878f5d-istio-token" (OuterVolumeSpecName: "istio-token") pod "613a77a0-a13f-4704-8020-7c8690878f5d" (UID: "613a77a0-a13f-4704-8020-7c8690878f5d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 14:11:31.940434 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:31.940268    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/613a77a0-a13f-4704-8020-7c8690878f5d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "613a77a0-a13f-4704-8020-7c8690878f5d" (UID: "613a77a0-a13f-4704-8020-7c8690878f5d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 14:11:31.940434 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:31.940308    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/613a77a0-a13f-4704-8020-7c8690878f5d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "613a77a0-a13f-4704-8020-7c8690878f5d" (UID: "613a77a0-a13f-4704-8020-7c8690878f5d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 14:11:32.039640 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:32.039603    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/613a77a0-a13f-4704-8020-7c8690878f5d-istio-data\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:11:32.039640 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:32.039636    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9jdvr\" (UniqueName: \"kubernetes.io/projected/613a77a0-a13f-4704-8020-7c8690878f5d-kube-api-access-9jdvr\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:11:32.039640 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:32.039650    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/613a77a0-a13f-4704-8020-7c8690878f5d-istio-podinfo\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:11:32.039885 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:32.039661    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/613a77a0-a13f-4704-8020-7c8690878f5d-istio-envoy\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:11:32.039885 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:32.039674    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/613a77a0-a13f-4704-8020-7c8690878f5d-istio-token\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:11:32.419593 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:32.419558    2573 generic.go:356] "Generic (PLEG): container finished" podID="613a77a0-a13f-4704-8020-7c8690878f5d" containerID="838b0d1949e7d68f02dd78e8a0eeec11221ed467a9bc774b3bc25871411c8996" exitCode=0
Jul 23 14:11:32.419797 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:32.419612    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6"
Jul 23 14:11:32.419797 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:32.419646    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6" event={"ID":"613a77a0-a13f-4704-8020-7c8690878f5d","Type":"ContainerDied","Data":"838b0d1949e7d68f02dd78e8a0eeec11221ed467a9bc774b3bc25871411c8996"}
Jul 23 14:11:32.419797 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:32.419703    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6" event={"ID":"613a77a0-a13f-4704-8020-7c8690878f5d","Type":"ContainerDied","Data":"ac4d0aaa74d74c5addf30ffcfa08930f20e751d35bce0fbae44d9f5bb200ef1b"}
Jul 23 14:11:32.419797 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:32.419727    2573 scope.go:117] "RemoveContainer" containerID="838b0d1949e7d68f02dd78e8a0eeec11221ed467a9bc774b3bc25871411c8996"
Jul 23 14:11:32.431406 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:32.431387    2573 scope.go:117] "RemoveContainer" containerID="28a71a7f4bee8c49800f78a422eafea19e32a59d0f1b9d04687b52b8a69f6a23"
Jul 23 14:11:32.439998 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:32.439977    2573 scope.go:117] "RemoveContainer" containerID="838b0d1949e7d68f02dd78e8a0eeec11221ed467a9bc774b3bc25871411c8996"
Jul 23 14:11:32.440270 ip-10-0-140-103 kubenswrapper[2573]: E0723 14:11:32.440250    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"838b0d1949e7d68f02dd78e8a0eeec11221ed467a9bc774b3bc25871411c8996\": container with ID starting with 838b0d1949e7d68f02dd78e8a0eeec11221ed467a9bc774b3bc25871411c8996 not found: ID does not exist" containerID="838b0d1949e7d68f02dd78e8a0eeec11221ed467a9bc774b3bc25871411c8996"
Jul 23 14:11:32.440321 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:32.440279    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"838b0d1949e7d68f02dd78e8a0eeec11221ed467a9bc774b3bc25871411c8996"} err="failed to get container status \"838b0d1949e7d68f02dd78e8a0eeec11221ed467a9bc774b3bc25871411c8996\": rpc error: code = NotFound desc = could not find container \"838b0d1949e7d68f02dd78e8a0eeec11221ed467a9bc774b3bc25871411c8996\": container with ID starting with 838b0d1949e7d68f02dd78e8a0eeec11221ed467a9bc774b3bc25871411c8996 not found: ID does not exist"
Jul 23 14:11:32.440321 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:32.440297    2573 scope.go:117] "RemoveContainer" containerID="28a71a7f4bee8c49800f78a422eafea19e32a59d0f1b9d04687b52b8a69f6a23"
Jul 23 14:11:32.440552 ip-10-0-140-103 kubenswrapper[2573]: E0723 14:11:32.440536    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28a71a7f4bee8c49800f78a422eafea19e32a59d0f1b9d04687b52b8a69f6a23\": container with ID starting with 28a71a7f4bee8c49800f78a422eafea19e32a59d0f1b9d04687b52b8a69f6a23 not found: ID does not exist" containerID="28a71a7f4bee8c49800f78a422eafea19e32a59d0f1b9d04687b52b8a69f6a23"
Jul 23 14:11:32.440606 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:32.440563    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28a71a7f4bee8c49800f78a422eafea19e32a59d0f1b9d04687b52b8a69f6a23"} err="failed to get container status \"28a71a7f4bee8c49800f78a422eafea19e32a59d0f1b9d04687b52b8a69f6a23\": rpc error: code = NotFound desc = could not find container \"28a71a7f4bee8c49800f78a422eafea19e32a59d0f1b9d04687b52b8a69f6a23\": container with ID starting with 28a71a7f4bee8c49800f78a422eafea19e32a59d0f1b9d04687b52b8a69f6a23 not found: ID does not exist"
Jul 23 14:11:32.444567 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:32.444545    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6"]
Jul 23 14:11:32.448441 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:32.448420    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-daf75dd9-openshift-default-b9f77c7c9-t5qr6"]
Jul 23 14:11:33.068289 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:33.068256    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="613a77a0-a13f-4704-8020-7c8690878f5d" path="/var/lib/kubelet/pods/613a77a0-a13f-4704-8020-7c8690878f5d/volumes"
Jul 23 14:11:41.487872 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:41.487834    2573 generic.go:356] "Generic (PLEG): container finished" podID="efa7342d-f7eb-49e5-bfce-69199b257abb" containerID="fab86fcb8d3f2720015bc0ab18ed09e52125887ccd79ad2ab39ab61c98001118" exitCode=0
Jul 23 14:11:41.488381 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:41.487942    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-854fd7f2-openshift-default-76d7dc9595-nmtkw" event={"ID":"efa7342d-f7eb-49e5-bfce-69199b257abb","Type":"ContainerDied","Data":"fab86fcb8d3f2720015bc0ab18ed09e52125887ccd79ad2ab39ab61c98001118"}
Jul 23 14:11:41.488426 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:41.488393    2573 scope.go:117] "RemoveContainer" containerID="fab86fcb8d3f2720015bc0ab18ed09e52125887ccd79ad2ab39ab61c98001118"
Jul 23 14:11:41.489433 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:41.489405    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 14:11:41.489497 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:41.489478    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 14:11:41.489536 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:41.489510    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 14:11:42.496167 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:42.496129    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-854fd7f2-openshift-default-76d7dc9595-nmtkw" event={"ID":"efa7342d-f7eb-49e5-bfce-69199b257abb","Type":"ContainerStarted","Data":"82bb3078392ba3b659641ea7e9df742a6d75d36bfd0658f9805c038cd4a82523"}
Jul 23 14:11:42.680029 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:42.679976    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-854fd7f2-openshift-default-76d7dc9595-nmtkw"
Jul 23 14:11:42.680927 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:42.680901    2573 patch_prober.go:28] interesting pod/e2e-derive-854fd7f2-openshift-default-76d7dc9595-nmtkw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Jul 23 14:11:42.681074 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:42.680950    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-854fd7f2-openshift-default-76d7dc9595-nmtkw" podUID="efa7342d-f7eb-49e5-bfce-69199b257abb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Jul 23 14:11:43.680567 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:43.680532    2573 patch_prober.go:28] interesting pod/e2e-derive-854fd7f2-openshift-default-76d7dc9595-nmtkw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Jul 23 14:11:43.680978 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:43.680584    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-854fd7f2-openshift-default-76d7dc9595-nmtkw" podUID="efa7342d-f7eb-49e5-bfce-69199b257abb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Jul 23 14:11:44.401131 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:44.401098    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-854fd7f2-openshift-default-76d7dc9595-nmtkw"
Jul 23 14:11:44.681204 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:44.681111    2573 patch_prober.go:28] interesting pod/e2e-derive-854fd7f2-openshift-default-76d7dc9595-nmtkw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Jul 23 14:11:44.681204 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:44.681173    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-854fd7f2-openshift-default-76d7dc9595-nmtkw" podUID="efa7342d-f7eb-49e5-bfce-69199b257abb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Jul 23 14:11:45.680724 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:45.680685    2573 patch_prober.go:28] interesting pod/e2e-derive-854fd7f2-openshift-default-76d7dc9595-nmtkw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Jul 23 14:11:45.680922 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:45.680743    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-854fd7f2-openshift-default-76d7dc9595-nmtkw" podUID="efa7342d-f7eb-49e5-bfce-69199b257abb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Jul 23 14:11:46.684503 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:46.684473    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-854fd7f2-openshift-default-76d7dc9595-nmtkw"
Jul 23 14:11:46.685500 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:46.685479    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-854fd7f2-openshift-default-76d7dc9595-nmtkw"
Jul 23 14:11:54.671070 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:54.670959    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-854fd7f2-fq7jn"]
Jul 23 14:11:54.671451 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:54.671409    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="613a77a0-a13f-4704-8020-7c8690878f5d" containerName="istio-proxy"
Jul 23 14:11:54.671451 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:54.671422    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="613a77a0-a13f-4704-8020-7c8690878f5d" containerName="istio-proxy"
Jul 23 14:11:54.671529 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:54.671517    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="613a77a0-a13f-4704-8020-7c8690878f5d" containerName="istio-proxy"
Jul 23 14:11:54.675004 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:54.674988    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-854fd7f2-fq7jn"
Jul 23 14:11:54.677504 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:54.677479    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6pngt\""
Jul 23 14:11:54.681453 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:54.681286    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-854fd7f2-fq7jn"]
Jul 23 14:11:54.765077 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:54.764997    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8da094a3-fe96-442a-843f-a1c72e3d244a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-854fd7f2-fq7jn\" (UID: \"8da094a3-fe96-442a-843f-a1c72e3d244a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-854fd7f2-fq7jn"
Jul 23 14:11:54.866003 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:54.865965    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8da094a3-fe96-442a-843f-a1c72e3d244a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-854fd7f2-fq7jn\" (UID: \"8da094a3-fe96-442a-843f-a1c72e3d244a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-854fd7f2-fq7jn"
Jul 23 14:11:54.866589 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:54.866572    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8da094a3-fe96-442a-843f-a1c72e3d244a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-854fd7f2-fq7jn\" (UID: \"8da094a3-fe96-442a-843f-a1c72e3d244a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-854fd7f2-fq7jn"
Jul 23 14:11:54.987716 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:54.987647    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-854fd7f2-fq7jn"
Jul 23 14:11:55.370415 ip-10-0-140-103 kubenswrapper[2573]: W0723 14:11:55.370382    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8da094a3_fe96_442a_843f_a1c72e3d244a.slice/crio-c5234a7013e46487c67131773c7ee9185ca33f9fc4a617b470a2c2daab9afa64 WatchSource:0}: Error finding container c5234a7013e46487c67131773c7ee9185ca33f9fc4a617b470a2c2daab9afa64: Status 404 returned error can't find the container with id c5234a7013e46487c67131773c7ee9185ca33f9fc4a617b470a2c2daab9afa64
Jul 23 14:11:55.373796 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:55.373770    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-854fd7f2-fq7jn"]
Jul 23 14:11:55.572966 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:55.572933    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-854fd7f2-fq7jn" event={"ID":"8da094a3-fe96-442a-843f-a1c72e3d244a","Type":"ContainerStarted","Data":"c5234a7013e46487c67131773c7ee9185ca33f9fc4a617b470a2c2daab9afa64"}
Jul 23 14:11:56.580440 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:56.580404    2573 generic.go:356] "Generic (PLEG): container finished" podID="8da094a3-fe96-442a-843f-a1c72e3d244a" containerID="7c67f578cfad282b8ef80b3a6ed775074eeddfda64c8eb8a41a9334bd08e9e56" exitCode=0
Jul 23 14:11:56.580866 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:56.580491    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-854fd7f2-fq7jn" event={"ID":"8da094a3-fe96-442a-843f-a1c72e3d244a","Type":"ContainerDied","Data":"7c67f578cfad282b8ef80b3a6ed775074eeddfda64c8eb8a41a9334bd08e9e56"}
Jul 23 14:11:57.725658 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:57.725634    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-854fd7f2-fq7jn"
Jul 23 14:11:57.799448 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:57.799415    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8da094a3-fe96-442a-843f-a1c72e3d244a-maas-api-service-ca\") pod \"8da094a3-fe96-442a-843f-a1c72e3d244a\" (UID: \"8da094a3-fe96-442a-843f-a1c72e3d244a\") "
Jul 23 14:11:57.799780 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:57.799757    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8da094a3-fe96-442a-843f-a1c72e3d244a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8da094a3-fe96-442a-843f-a1c72e3d244a" (UID: "8da094a3-fe96-442a-843f-a1c72e3d244a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 14:11:57.901092 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:57.900985    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8da094a3-fe96-442a-843f-a1c72e3d244a-maas-api-service-ca\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:11:58.593636 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:58.593601    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-854fd7f2-fq7jn" event={"ID":"8da094a3-fe96-442a-843f-a1c72e3d244a","Type":"ContainerDied","Data":"c5234a7013e46487c67131773c7ee9185ca33f9fc4a617b470a2c2daab9afa64"}
Jul 23 14:11:58.593636 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:58.593633    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-854fd7f2-fq7jn"
Jul 23 14:11:58.593851 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:11:58.593659    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c5234a7013e46487c67131773c7ee9185ca33f9fc4a617b470a2c2daab9afa64"
Jul 23 14:12:05.283317 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:12:05.283281    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:12:09.756940 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:12:09.756897    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-854fd7f2-fq7jn"]
Jul 23 14:12:09.759347 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:12:09.759326    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-854fd7f2-fq7jn"]
Jul 23 14:12:09.898244 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:12:09.898204    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-854fd7f2-openshift-default-76d7dc9595-nmtkw"]
Jul 23 14:12:09.898446 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:12:09.898413    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-854fd7f2-openshift-default-76d7dc9595-nmtkw" podUID="efa7342d-f7eb-49e5-bfce-69199b257abb" containerName="istio-proxy" containerID="cri-o://82bb3078392ba3b659641ea7e9df742a6d75d36bfd0658f9805c038cd4a82523" gracePeriod=30
Jul 23 14:12:09.980867 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:12:09.980831    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:12:10.045485 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:12:10.045440    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:12:10.505767 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:12:10.505679    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:12:10.651093 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:12:10.651061    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:12:10.746642 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:12:10.746607    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:12:10.849990 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:12:10.849944    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:12:11.069131 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:12:11.069089    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8da094a3-fe96-442a-843f-a1c72e3d244a" path="/var/lib/kubelet/pods/8da094a3-fe96-442a-843f-a1c72e3d244a/volumes"
Jul 23 14:12:12.280998 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:12:12.280951    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:12:15.163851 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:12:15.163784    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-854fd7f2-openshift-default-76d7dc9595-nmtkw"
Jul 23 14:12:15.264406 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:12:15.264321    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/efa7342d-f7eb-49e5-bfce-69199b257abb-istio-token\") pod \"efa7342d-f7eb-49e5-bfce-69199b257abb\" (UID: \"efa7342d-f7eb-49e5-bfce-69199b257abb\") "
Jul 23 14:12:15.264601 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:12:15.264448    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/efa7342d-f7eb-49e5-bfce-69199b257abb-istio-podinfo\") pod \"efa7342d-f7eb-49e5-bfce-69199b257abb\" (UID: \"efa7342d-f7eb-49e5-bfce-69199b257abb\") "
Jul 23 14:12:15.264601 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:12:15.264477    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/efa7342d-f7eb-49e5-bfce-69199b257abb-istio-data\") pod \"efa7342d-f7eb-49e5-bfce-69199b257abb\" (UID: \"efa7342d-f7eb-49e5-bfce-69199b257abb\") "
Jul 23 14:12:15.264601 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:12:15.264529    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/efa7342d-f7eb-49e5-bfce-69199b257abb-workload-certs\") pod \"efa7342d-f7eb-49e5-bfce-69199b257abb\" (UID: \"efa7342d-f7eb-49e5-bfce-69199b257abb\") "
Jul 23 14:12:15.264601 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:12:15.264553    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/efa7342d-f7eb-49e5-bfce-69199b257abb-istiod-ca-cert\") pod \"efa7342d-f7eb-49e5-bfce-69199b257abb\" (UID: \"efa7342d-f7eb-49e5-bfce-69199b257abb\") "
Jul 23 14:12:15.264812 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:12:15.264656    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/efa7342d-f7eb-49e5-bfce-69199b257abb-istio-envoy\") pod \"efa7342d-f7eb-49e5-bfce-69199b257abb\" (UID: \"efa7342d-f7eb-49e5-bfce-69199b257abb\") "
Jul 23 14:12:15.264812 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:12:15.264700    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/efa7342d-f7eb-49e5-bfce-69199b257abb-credential-socket\") pod \"efa7342d-f7eb-49e5-bfce-69199b257abb\" (UID: \"efa7342d-f7eb-49e5-bfce-69199b257abb\") "
Jul 23 14:12:15.264812 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:12:15.264736    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/efa7342d-f7eb-49e5-bfce-69199b257abb-workload-socket\") pod \"efa7342d-f7eb-49e5-bfce-69199b257abb\" (UID: \"efa7342d-f7eb-49e5-bfce-69199b257abb\") "
Jul 23 14:12:15.264955 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:12:15.264879    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sh6gd\" (UniqueName: \"kubernetes.io/projected/efa7342d-f7eb-49e5-bfce-69199b257abb-kube-api-access-sh6gd\") pod \"efa7342d-f7eb-49e5-bfce-69199b257abb\" (UID: \"efa7342d-f7eb-49e5-bfce-69199b257abb\") "
Jul 23 14:12:15.264955 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:12:15.264884    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/efa7342d-f7eb-49e5-bfce-69199b257abb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "efa7342d-f7eb-49e5-bfce-69199b257abb" (UID: "efa7342d-f7eb-49e5-bfce-69199b257abb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 14:12:15.265089 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:12:15.264955    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/efa7342d-f7eb-49e5-bfce-69199b257abb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "efa7342d-f7eb-49e5-bfce-69199b257abb" (UID: "efa7342d-f7eb-49e5-bfce-69199b257abb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 14:12:15.265141 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:12:15.265124    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/efa7342d-f7eb-49e5-bfce-69199b257abb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "efa7342d-f7eb-49e5-bfce-69199b257abb" (UID: "efa7342d-f7eb-49e5-bfce-69199b257abb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 14:12:15.265293 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:12:15.265262    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/efa7342d-f7eb-49e5-bfce-69199b257abb-credential-socket\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:12:15.265469 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:12:15.265297    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/efa7342d-f7eb-49e5-bfce-69199b257abb-workload-socket\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:12:15.265469 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:12:15.265313    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/efa7342d-f7eb-49e5-bfce-69199b257abb-workload-certs\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:12:15.265592 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:12:15.265512    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/efa7342d-f7eb-49e5-bfce-69199b257abb-istio-data" (OuterVolumeSpecName: "istio-data") pod "efa7342d-f7eb-49e5-bfce-69199b257abb" (UID: "efa7342d-f7eb-49e5-bfce-69199b257abb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 14:12:15.265592 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:12:15.265508    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efa7342d-f7eb-49e5-bfce-69199b257abb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "efa7342d-f7eb-49e5-bfce-69199b257abb" (UID: "efa7342d-f7eb-49e5-bfce-69199b257abb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 14:12:15.266645 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:12:15.266623    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/efa7342d-f7eb-49e5-bfce-69199b257abb-istio-token" (OuterVolumeSpecName: "istio-token") pod "efa7342d-f7eb-49e5-bfce-69199b257abb" (UID: "efa7342d-f7eb-49e5-bfce-69199b257abb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 14:12:15.266920 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:12:15.266903    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/efa7342d-f7eb-49e5-bfce-69199b257abb-kube-api-access-sh6gd" (OuterVolumeSpecName: "kube-api-access-sh6gd") pod "efa7342d-f7eb-49e5-bfce-69199b257abb" (UID: "efa7342d-f7eb-49e5-bfce-69199b257abb"). InnerVolumeSpecName "kube-api-access-sh6gd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 14:12:15.267107 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:12:15.267087    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/efa7342d-f7eb-49e5-bfce-69199b257abb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "efa7342d-f7eb-49e5-bfce-69199b257abb" (UID: "efa7342d-f7eb-49e5-bfce-69199b257abb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 14:12:15.267188 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:12:15.267161    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/efa7342d-f7eb-49e5-bfce-69199b257abb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "efa7342d-f7eb-49e5-bfce-69199b257abb" (UID: "efa7342d-f7eb-49e5-bfce-69199b257abb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 14:12:15.366680 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:12:15.366640    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sh6gd\" (UniqueName: \"kubernetes.io/projected/efa7342d-f7eb-49e5-bfce-69199b257abb-kube-api-access-sh6gd\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:12:15.366680 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:12:15.366668    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/efa7342d-f7eb-49e5-bfce-69199b257abb-istio-token\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:12:15.366680 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:12:15.366680    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/efa7342d-f7eb-49e5-bfce-69199b257abb-istio-podinfo\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:12:15.366680 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:12:15.366688    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/efa7342d-f7eb-49e5-bfce-69199b257abb-istio-data\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:12:15.366999 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:12:15.366696    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/efa7342d-f7eb-49e5-bfce-69199b257abb-istiod-ca-cert\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:12:15.366999 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:12:15.366704    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/efa7342d-f7eb-49e5-bfce-69199b257abb-istio-envoy\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:12:15.695033 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:12:15.694977    2573 generic.go:356] "Generic (PLEG): container finished" podID="efa7342d-f7eb-49e5-bfce-69199b257abb" containerID="82bb3078392ba3b659641ea7e9df742a6d75d36bfd0658f9805c038cd4a82523" exitCode=0
Jul 23 14:12:15.695215 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:12:15.695040    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-854fd7f2-openshift-default-76d7dc9595-nmtkw"
Jul 23 14:12:15.695215 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:12:15.695045    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-854fd7f2-openshift-default-76d7dc9595-nmtkw" event={"ID":"efa7342d-f7eb-49e5-bfce-69199b257abb","Type":"ContainerDied","Data":"82bb3078392ba3b659641ea7e9df742a6d75d36bfd0658f9805c038cd4a82523"}
Jul 23 14:12:15.695215 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:12:15.695097    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-854fd7f2-openshift-default-76d7dc9595-nmtkw" event={"ID":"efa7342d-f7eb-49e5-bfce-69199b257abb","Type":"ContainerDied","Data":"ae0d4c3dda39df81bd72f453929d74438afb949cfb6049e91a42bbf13641381c"}
Jul 23 14:12:15.695215 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:12:15.695119    2573 scope.go:117] "RemoveContainer" containerID="82bb3078392ba3b659641ea7e9df742a6d75d36bfd0658f9805c038cd4a82523"
Jul 23 14:12:15.705452 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:12:15.705432    2573 scope.go:117] "RemoveContainer" containerID="fab86fcb8d3f2720015bc0ab18ed09e52125887ccd79ad2ab39ab61c98001118"
Jul 23 14:12:15.714705 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:12:15.714675    2573 scope.go:117] "RemoveContainer" containerID="82bb3078392ba3b659641ea7e9df742a6d75d36bfd0658f9805c038cd4a82523"
Jul 23 14:12:15.715229 ip-10-0-140-103 kubenswrapper[2573]: E0723 14:12:15.714999    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82bb3078392ba3b659641ea7e9df742a6d75d36bfd0658f9805c038cd4a82523\": container with ID starting with 82bb3078392ba3b659641ea7e9df742a6d75d36bfd0658f9805c038cd4a82523 not found: ID does not exist" containerID="82bb3078392ba3b659641ea7e9df742a6d75d36bfd0658f9805c038cd4a82523"
Jul 23 14:12:15.715229 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:12:15.715111    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82bb3078392ba3b659641ea7e9df742a6d75d36bfd0658f9805c038cd4a82523"} err="failed to get container status \"82bb3078392ba3b659641ea7e9df742a6d75d36bfd0658f9805c038cd4a82523\": rpc error: code = NotFound desc = could not find container \"82bb3078392ba3b659641ea7e9df742a6d75d36bfd0658f9805c038cd4a82523\": container with ID starting with 82bb3078392ba3b659641ea7e9df742a6d75d36bfd0658f9805c038cd4a82523 not found: ID does not exist"
Jul 23 14:12:15.715229 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:12:15.715138    2573 scope.go:117] "RemoveContainer" containerID="fab86fcb8d3f2720015bc0ab18ed09e52125887ccd79ad2ab39ab61c98001118"
Jul 23 14:12:15.715433 ip-10-0-140-103 kubenswrapper[2573]: E0723 14:12:15.715407    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fab86fcb8d3f2720015bc0ab18ed09e52125887ccd79ad2ab39ab61c98001118\": container with ID starting with fab86fcb8d3f2720015bc0ab18ed09e52125887ccd79ad2ab39ab61c98001118 not found: ID does not exist" containerID="fab86fcb8d3f2720015bc0ab18ed09e52125887ccd79ad2ab39ab61c98001118"
Jul 23 14:12:15.715473 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:12:15.715444    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fab86fcb8d3f2720015bc0ab18ed09e52125887ccd79ad2ab39ab61c98001118"} err="failed to get container status \"fab86fcb8d3f2720015bc0ab18ed09e52125887ccd79ad2ab39ab61c98001118\": rpc error: code = NotFound desc = could not find container \"fab86fcb8d3f2720015bc0ab18ed09e52125887ccd79ad2ab39ab61c98001118\": container with ID starting with fab86fcb8d3f2720015bc0ab18ed09e52125887ccd79ad2ab39ab61c98001118 not found: ID does not exist"
Jul 23 14:12:15.718250 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:12:15.718211    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-854fd7f2-openshift-default-76d7dc9595-nmtkw"]
Jul 23 14:12:15.721263 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:12:15.721242    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-854fd7f2-openshift-default-76d7dc9595-nmtkw"]
Jul 23 14:12:17.072219 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:12:17.070275    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="efa7342d-f7eb-49e5-bfce-69199b257abb" path="/var/lib/kubelet/pods/efa7342d-f7eb-49e5-bfce-69199b257abb/volumes"
Jul 23 14:12:18.037944 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:12:18.037910    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:12:18.567220 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:12:18.567179    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:12:18.665199 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:12:18.665160    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:12:18.765976 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:12:18.765930    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:12:44.737929 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:12:44.737882    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:12:50.928515 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:12:50.928465    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:12:50.991559 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:12:50.991526    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:12:51.106908 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:12:51.106860    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:12:51.208659 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:12:51.208562    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:13:07.029286 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:13:07.029250    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:13:13.018398 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:13:13.018361    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:13:13.127343 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:13:13.127307    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:13:13.230618 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:13:13.230586    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:13:23.822507 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:13:23.822418    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:13:24.643689 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:13:24.643651    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:13:32.005385 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:13:32.005351    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:13:32.130697 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:13:32.130664    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:13:32.303333 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:13:32.303302    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:13:32.429212 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:13:32.429164    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:13:33.167882 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:13:33.167843    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:13:33.270766 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:13:33.270732    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:13:33.378260 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:13:33.378223    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:13:35.035939 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:13:35.035902    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:13:41.169123 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:13:41.169085    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:13:41.245333 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:13:41.245277    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:13:41.917734 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:13:41.917698    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:13:50.411145 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:13:50.411106    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:13:51.043531 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:13:51.043496    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c"]
Jul 23 14:13:51.043925 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:13:51.043913    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efa7342d-f7eb-49e5-bfce-69199b257abb" containerName="istio-proxy"
Jul 23 14:13:51.043972 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:13:51.043927    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="efa7342d-f7eb-49e5-bfce-69199b257abb" containerName="istio-proxy"
Jul 23 14:13:51.043972 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:13:51.043937    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8da094a3-fe96-442a-843f-a1c72e3d244a" containerName="revoke-keys"
Jul 23 14:13:51.043972 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:13:51.043942    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="8da094a3-fe96-442a-843f-a1c72e3d244a" containerName="revoke-keys"
Jul 23 14:13:51.043972 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:13:51.043954    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="613a77a0-a13f-4704-8020-7c8690878f5d" containerName="istio-proxy"
Jul 23 14:13:51.043972 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:13:51.043960    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="613a77a0-a13f-4704-8020-7c8690878f5d" containerName="istio-proxy"
Jul 23 14:13:51.044158 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:13:51.044069    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="efa7342d-f7eb-49e5-bfce-69199b257abb" containerName="istio-proxy"
Jul 23 14:13:51.044158 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:13:51.044080    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="613a77a0-a13f-4704-8020-7c8690878f5d" containerName="istio-proxy"
Jul 23 14:13:51.044158 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:13:51.044088    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="8da094a3-fe96-442a-843f-a1c72e3d244a" containerName="revoke-keys"
Jul 23 14:13:51.047408 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:13:51.047392    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c"
Jul 23 14:13:51.051888 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:13:51.051865    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-ffcc91a2-openshift-default-dockercfg-rlfbk\""
Jul 23 14:13:51.076822 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:13:51.076793    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c"]
Jul 23 14:13:51.144199 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:13:51.144168    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/799cb2e2-87c4-4e41-93ed-b96a28385dd9-workload-certs\") pod \"e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c\" (UID: \"799cb2e2-87c4-4e41-93ed-b96a28385dd9\") " pod="openshift-ingress/e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c"
Jul 23 14:13:51.144361 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:13:51.144222    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/799cb2e2-87c4-4e41-93ed-b96a28385dd9-istio-token\") pod \"e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c\" (UID: \"799cb2e2-87c4-4e41-93ed-b96a28385dd9\") " pod="openshift-ingress/e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c"
Jul 23 14:13:51.144361 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:13:51.144250    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tc9w\" (UniqueName: \"kubernetes.io/projected/799cb2e2-87c4-4e41-93ed-b96a28385dd9-kube-api-access-8tc9w\") pod \"e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c\" (UID: \"799cb2e2-87c4-4e41-93ed-b96a28385dd9\") " pod="openshift-ingress/e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c"
Jul 23 14:13:51.144361 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:13:51.144284    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/799cb2e2-87c4-4e41-93ed-b96a28385dd9-istio-envoy\") pod \"e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c\" (UID: \"799cb2e2-87c4-4e41-93ed-b96a28385dd9\") " pod="openshift-ingress/e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c"
Jul 23 14:13:51.144361 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:13:51.144302    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/799cb2e2-87c4-4e41-93ed-b96a28385dd9-istio-podinfo\") pod \"e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c\" (UID: \"799cb2e2-87c4-4e41-93ed-b96a28385dd9\") " pod="openshift-ingress/e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c"
Jul 23 14:13:51.144361 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:13:51.144344    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/799cb2e2-87c4-4e41-93ed-b96a28385dd9-istio-data\") pod \"e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c\" (UID: \"799cb2e2-87c4-4e41-93ed-b96a28385dd9\") " pod="openshift-ingress/e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c"
Jul 23 14:13:51.144532 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:13:51.144372    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/799cb2e2-87c4-4e41-93ed-b96a28385dd9-istiod-ca-cert\") pod \"e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c\" (UID: \"799cb2e2-87c4-4e41-93ed-b96a28385dd9\") " pod="openshift-ingress/e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c"
Jul 23 14:13:51.144532 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:13:51.144421    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/799cb2e2-87c4-4e41-93ed-b96a28385dd9-workload-socket\") pod \"e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c\" (UID: \"799cb2e2-87c4-4e41-93ed-b96a28385dd9\") " pod="openshift-ingress/e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c"
Jul 23 14:13:51.144532 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:13:51.144440    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/799cb2e2-87c4-4e41-93ed-b96a28385dd9-credential-socket\") pod \"e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c\" (UID: \"799cb2e2-87c4-4e41-93ed-b96a28385dd9\") " pod="openshift-ingress/e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c"
Jul 23 14:13:51.245929 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:13:51.245892    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/799cb2e2-87c4-4e41-93ed-b96a28385dd9-istio-envoy\") pod \"e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c\" (UID: \"799cb2e2-87c4-4e41-93ed-b96a28385dd9\") " pod="openshift-ingress/e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c"
Jul 23 14:13:51.245929 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:13:51.245928    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/799cb2e2-87c4-4e41-93ed-b96a28385dd9-istio-podinfo\") pod \"e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c\" (UID: \"799cb2e2-87c4-4e41-93ed-b96a28385dd9\") " pod="openshift-ingress/e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c"
Jul 23 14:13:51.246203 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:13:51.245952    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/799cb2e2-87c4-4e41-93ed-b96a28385dd9-istio-data\") pod \"e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c\" (UID: \"799cb2e2-87c4-4e41-93ed-b96a28385dd9\") " pod="openshift-ingress/e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c"
Jul 23 14:13:51.246203 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:13:51.245992    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/799cb2e2-87c4-4e41-93ed-b96a28385dd9-istiod-ca-cert\") pod \"e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c\" (UID: \"799cb2e2-87c4-4e41-93ed-b96a28385dd9\") " pod="openshift-ingress/e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c"
Jul 23 14:13:51.246203 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:13:51.246063    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/799cb2e2-87c4-4e41-93ed-b96a28385dd9-workload-socket\") pod \"e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c\" (UID: \"799cb2e2-87c4-4e41-93ed-b96a28385dd9\") " pod="openshift-ingress/e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c"
Jul 23 14:13:51.246203 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:13:51.246090    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/799cb2e2-87c4-4e41-93ed-b96a28385dd9-credential-socket\") pod \"e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c\" (UID: \"799cb2e2-87c4-4e41-93ed-b96a28385dd9\") " pod="openshift-ingress/e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c"
Jul 23 14:13:51.246203 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:13:51.246143    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/799cb2e2-87c4-4e41-93ed-b96a28385dd9-workload-certs\") pod \"e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c\" (UID: \"799cb2e2-87c4-4e41-93ed-b96a28385dd9\") " pod="openshift-ingress/e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c"
Jul 23 14:13:51.246692 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:13:51.246248    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/799cb2e2-87c4-4e41-93ed-b96a28385dd9-istio-token\") pod \"e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c\" (UID: \"799cb2e2-87c4-4e41-93ed-b96a28385dd9\") " pod="openshift-ingress/e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c"
Jul 23 14:13:51.246692 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:13:51.246272    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tc9w\" (UniqueName: \"kubernetes.io/projected/799cb2e2-87c4-4e41-93ed-b96a28385dd9-kube-api-access-8tc9w\") pod \"e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c\" (UID: \"799cb2e2-87c4-4e41-93ed-b96a28385dd9\") " pod="openshift-ingress/e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c"
Jul 23 14:13:51.246692 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:13:51.246433    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/799cb2e2-87c4-4e41-93ed-b96a28385dd9-istio-data\") pod \"e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c\" (UID: \"799cb2e2-87c4-4e41-93ed-b96a28385dd9\") " pod="openshift-ingress/e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c"
Jul 23 14:13:51.246692 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:13:51.246493    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/799cb2e2-87c4-4e41-93ed-b96a28385dd9-credential-socket\") pod \"e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c\" (UID: \"799cb2e2-87c4-4e41-93ed-b96a28385dd9\") " pod="openshift-ingress/e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c"
Jul 23 14:13:51.246692 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:13:51.246561    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/799cb2e2-87c4-4e41-93ed-b96a28385dd9-workload-socket\") pod \"e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c\" (UID: \"799cb2e2-87c4-4e41-93ed-b96a28385dd9\") " pod="openshift-ingress/e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c"
Jul 23 14:13:51.246692 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:13:51.246677    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/799cb2e2-87c4-4e41-93ed-b96a28385dd9-workload-certs\") pod \"e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c\" (UID: \"799cb2e2-87c4-4e41-93ed-b96a28385dd9\") " pod="openshift-ingress/e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c"
Jul 23 14:13:51.247233 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:13:51.247207    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/799cb2e2-87c4-4e41-93ed-b96a28385dd9-istiod-ca-cert\") pod \"e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c\" (UID: \"799cb2e2-87c4-4e41-93ed-b96a28385dd9\") " pod="openshift-ingress/e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c"
Jul 23 14:13:51.248281 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:13:51.248262    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/799cb2e2-87c4-4e41-93ed-b96a28385dd9-istio-envoy\") pod \"e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c\" (UID: \"799cb2e2-87c4-4e41-93ed-b96a28385dd9\") " pod="openshift-ingress/e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c"
Jul 23 14:13:51.248618 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:13:51.248595    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/799cb2e2-87c4-4e41-93ed-b96a28385dd9-istio-podinfo\") pod \"e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c\" (UID: \"799cb2e2-87c4-4e41-93ed-b96a28385dd9\") " pod="openshift-ingress/e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c"
Jul 23 14:13:51.255002 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:13:51.254979    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/799cb2e2-87c4-4e41-93ed-b96a28385dd9-istio-token\") pod \"e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c\" (UID: \"799cb2e2-87c4-4e41-93ed-b96a28385dd9\") " pod="openshift-ingress/e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c"
Jul 23 14:13:51.255002 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:13:51.254993    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tc9w\" (UniqueName: \"kubernetes.io/projected/799cb2e2-87c4-4e41-93ed-b96a28385dd9-kube-api-access-8tc9w\") pod \"e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c\" (UID: \"799cb2e2-87c4-4e41-93ed-b96a28385dd9\") " pod="openshift-ingress/e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c"
Jul 23 14:13:51.357353 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:13:51.357269    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c"
Jul 23 14:13:51.510640 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:13:51.510614    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c"]
Jul 23 14:13:51.512578 ip-10-0-140-103 kubenswrapper[2573]: W0723 14:13:51.512543    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod799cb2e2_87c4_4e41_93ed_b96a28385dd9.slice/crio-f3ba722f60455d54055fccd38f0d21ffce42a8ac6e5c3e3ce9ef5f252f03f6c9 WatchSource:0}: Error finding container f3ba722f60455d54055fccd38f0d21ffce42a8ac6e5c3e3ce9ef5f252f03f6c9: Status 404 returned error can't find the container with id f3ba722f60455d54055fccd38f0d21ffce42a8ac6e5c3e3ce9ef5f252f03f6c9
Jul 23 14:13:51.515061 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:13:51.515026    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 14:13:51.515157 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:13:51.515095    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 14:13:51.515157 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:13:51.515131    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 14:13:52.263343 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:13:52.263308    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c" event={"ID":"799cb2e2-87c4-4e41-93ed-b96a28385dd9","Type":"ContainerStarted","Data":"51f04dd65597756dd5fe6e728dafb950e9bc096120bd5725a83b7a36b590135f"}
Jul 23 14:13:52.263509 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:13:52.263363    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c" event={"ID":"799cb2e2-87c4-4e41-93ed-b96a28385dd9","Type":"ContainerStarted","Data":"f3ba722f60455d54055fccd38f0d21ffce42a8ac6e5c3e3ce9ef5f252f03f6c9"}
Jul 23 14:13:52.287182 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:13:52.287152    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:13:52.292374 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:13:52.292331    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c" podStartSLOduration=1.292314249 podStartE2EDuration="1.292314249s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 14:13:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 14:13:52.289443774 +0000 UTC m=+2003.728944696" watchObservedRunningTime="2026-07-23 14:13:52.292314249 +0000 UTC m=+2003.731815167"
Jul 23 14:13:52.357657 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:13:52.357618    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c"
Jul 23 14:13:52.362780 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:13:52.362757    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c"
Jul 23 14:13:53.268924 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:13:53.268886    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c"
Jul 23 14:13:53.269825 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:13:53.269794    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c"
Jul 23 14:13:54.309693 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:13:54.309662    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:13:54.417597 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:13:54.417561    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:13:54.506994 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:13:54.506956    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:13:54.679965 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:13:54.679889    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:13:55.260373 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:13:55.260337    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:13:55.378891 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:13:55.378849    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:13:58.803717 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:13:58.803679    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:13:59.517158 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:13:59.517127    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:13:59.612517 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:13:59.612481    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:13:59.973283 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:13:59.973251    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:14:06.252286 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:06.252250    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:14:06.338597 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:06.338563    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:14:06.650657 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:06.650623    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ffcc91a2-w4p4t"]
Jul 23 14:14:06.651083 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:06.651069    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efa7342d-f7eb-49e5-bfce-69199b257abb" containerName="istio-proxy"
Jul 23 14:14:06.651142 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:06.651084    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="efa7342d-f7eb-49e5-bfce-69199b257abb" containerName="istio-proxy"
Jul 23 14:14:06.651179 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:06.651149    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="efa7342d-f7eb-49e5-bfce-69199b257abb" containerName="istio-proxy"
Jul 23 14:14:06.655204 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:06.655181    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ffcc91a2-w4p4t"
Jul 23 14:14:06.657845 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:06.657808    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6pngt\""
Jul 23 14:14:06.663948 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:06.663918    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ffcc91a2-w4p4t"]
Jul 23 14:14:06.693626 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:06.693589    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b69f05a-b666-4b6c-a03d-e8e7f5a2de0e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-ffcc91a2-w4p4t\" (UID: \"2b69f05a-b666-4b6c-a03d-e8e7f5a2de0e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ffcc91a2-w4p4t"
Jul 23 14:14:06.794822 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:06.794772    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b69f05a-b666-4b6c-a03d-e8e7f5a2de0e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-ffcc91a2-w4p4t\" (UID: \"2b69f05a-b666-4b6c-a03d-e8e7f5a2de0e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ffcc91a2-w4p4t"
Jul 23 14:14:06.795441 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:06.795422    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b69f05a-b666-4b6c-a03d-e8e7f5a2de0e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-ffcc91a2-w4p4t\" (UID: \"2b69f05a-b666-4b6c-a03d-e8e7f5a2de0e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ffcc91a2-w4p4t"
Jul 23 14:14:06.970114 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:06.970007    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ffcc91a2-w4p4t"
Jul 23 14:14:07.325980 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:07.325952    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ffcc91a2-w4p4t"]
Jul 23 14:14:07.327606 ip-10-0-140-103 kubenswrapper[2573]: W0723 14:14:07.327582    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b69f05a_b666_4b6c_a03d_e8e7f5a2de0e.slice/crio-2612bb6c316546a3a28ca5c778f4986be158c33945a726960f2ceeced98329b5 WatchSource:0}: Error finding container 2612bb6c316546a3a28ca5c778f4986be158c33945a726960f2ceeced98329b5: Status 404 returned error can't find the container with id 2612bb6c316546a3a28ca5c778f4986be158c33945a726960f2ceeced98329b5
Jul 23 14:14:07.372182 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:07.372148    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ffcc91a2-w4p4t" event={"ID":"2b69f05a-b666-4b6c-a03d-e8e7f5a2de0e","Type":"ContainerStarted","Data":"2612bb6c316546a3a28ca5c778f4986be158c33945a726960f2ceeced98329b5"}
Jul 23 14:14:08.270382 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:08.270349    2573 patch_prober.go:28] interesting pod/e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Jul 23 14:14:08.270592 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:08.270410    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c" podUID="799cb2e2-87c4-4e41-93ed-b96a28385dd9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Jul 23 14:14:08.379780 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:08.379694    2573 generic.go:356] "Generic (PLEG): container finished" podID="799cb2e2-87c4-4e41-93ed-b96a28385dd9" containerID="51f04dd65597756dd5fe6e728dafb950e9bc096120bd5725a83b7a36b590135f" exitCode=0
Jul 23 14:14:08.380193 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:08.379772    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c" event={"ID":"799cb2e2-87c4-4e41-93ed-b96a28385dd9","Type":"ContainerDied","Data":"51f04dd65597756dd5fe6e728dafb950e9bc096120bd5725a83b7a36b590135f"}
Jul 23 14:14:08.380295 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:08.380277    2573 scope.go:117] "RemoveContainer" containerID="51f04dd65597756dd5fe6e728dafb950e9bc096120bd5725a83b7a36b590135f"
Jul 23 14:14:08.381510 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:08.381478    2573 generic.go:356] "Generic (PLEG): container finished" podID="2b69f05a-b666-4b6c-a03d-e8e7f5a2de0e" containerID="1403d0512ff7f23aada54df65155d53acb83c9dc639611d480cb1d9249b5da5a" exitCode=0
Jul 23 14:14:08.381510 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:08.381493    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 14:14:08.381653 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:08.381579    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 14:14:08.381653 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:08.381622    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 14:14:08.381745 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:08.381568    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ffcc91a2-w4p4t" event={"ID":"2b69f05a-b666-4b6c-a03d-e8e7f5a2de0e","Type":"ContainerDied","Data":"1403d0512ff7f23aada54df65155d53acb83c9dc639611d480cb1d9249b5da5a"}
Jul 23 14:14:09.389694 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:09.389656    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c" event={"ID":"799cb2e2-87c4-4e41-93ed-b96a28385dd9","Type":"ContainerStarted","Data":"de4ee5760a6ed0381080366c5d2b784736af1467c619aec72f4d4b65aa785b6a"}
Jul 23 14:14:09.534272 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:09.534251    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ffcc91a2-w4p4t"
Jul 23 14:14:09.625135 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:09.625103    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b69f05a-b666-4b6c-a03d-e8e7f5a2de0e-maas-api-service-ca\") pod \"2b69f05a-b666-4b6c-a03d-e8e7f5a2de0e\" (UID: \"2b69f05a-b666-4b6c-a03d-e8e7f5a2de0e\") "
Jul 23 14:14:09.625510 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:09.625489    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b69f05a-b666-4b6c-a03d-e8e7f5a2de0e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2b69f05a-b666-4b6c-a03d-e8e7f5a2de0e" (UID: "2b69f05a-b666-4b6c-a03d-e8e7f5a2de0e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 14:14:09.726850 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:09.726751    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b69f05a-b666-4b6c-a03d-e8e7f5a2de0e-maas-api-service-ca\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:14:10.357707 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:10.357663    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c"
Jul 23 14:14:10.358006 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:10.357981    2573 patch_prober.go:28] interesting pod/e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Jul 23 14:14:10.358091 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:10.358057    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c" podUID="799cb2e2-87c4-4e41-93ed-b96a28385dd9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Jul 23 14:14:10.397358 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:10.397323    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ffcc91a2-w4p4t" event={"ID":"2b69f05a-b666-4b6c-a03d-e8e7f5a2de0e","Type":"ContainerDied","Data":"2612bb6c316546a3a28ca5c778f4986be158c33945a726960f2ceeced98329b5"}
Jul 23 14:14:10.397741 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:10.397377    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2612bb6c316546a3a28ca5c778f4986be158c33945a726960f2ceeced98329b5"
Jul 23 14:14:10.397741 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:10.397341    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ffcc91a2-w4p4t"
Jul 23 14:14:10.689916 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:10.689835    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:14:11.357906 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:11.357863    2573 patch_prober.go:28] interesting pod/e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Jul 23 14:14:11.358148 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:11.357929    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c" podUID="799cb2e2-87c4-4e41-93ed-b96a28385dd9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Jul 23 14:14:12.357787 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:12.357749    2573 patch_prober.go:28] interesting pod/e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Jul 23 14:14:12.358208 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:12.357807    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c" podUID="799cb2e2-87c4-4e41-93ed-b96a28385dd9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Jul 23 14:14:13.357976 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:13.357932    2573 patch_prober.go:28] interesting pod/e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Jul 23 14:14:13.358400 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:13.358002    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c" podUID="799cb2e2-87c4-4e41-93ed-b96a28385dd9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Jul 23 14:14:14.362228 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:14.362194    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c"
Jul 23 14:14:14.362645 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:14.362470    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c"
Jul 23 14:14:14.363140 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:14.363125    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c"
Jul 23 14:14:17.287258 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:17.287228    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:14:21.747372 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:21.747334    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ffcc91a2-w4p4t"]
Jul 23 14:14:21.750425 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:21.750398    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ffcc91a2-w4p4t"]
Jul 23 14:14:21.754576 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:21.754550    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:14:22.174438 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:22.174405    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:14:23.067819 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:23.067786    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b69f05a-b666-4b6c-a03d-e8e7f5a2de0e" path="/var/lib/kubelet/pods/2b69f05a-b666-4b6c-a03d-e8e7f5a2de0e/volumes"
Jul 23 14:14:28.574999 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:28.574965    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:14:28.740224 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:28.740187    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:14:28.848231 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:28.848139    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c"]
Jul 23 14:14:28.848429 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:28.848402    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c" podUID="799cb2e2-87c4-4e41-93ed-b96a28385dd9" containerName="istio-proxy" containerID="cri-o://de4ee5760a6ed0381080366c5d2b784736af1467c619aec72f4d4b65aa785b6a" gracePeriod=30
Jul 23 14:14:28.868227 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:28.868195    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:14:29.082668 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:29.082616    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:14:29.267191 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:29.267073    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:14:29.364800 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:29.364758    2573 patch_prober.go:28] interesting pod/e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Jul 23 14:14:29.365000 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:29.364833    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c" podUID="799cb2e2-87c4-4e41-93ed-b96a28385dd9" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 23 14:14:29.387719 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:29.387667    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:14:29.478761 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:29.478708    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:14:34.119076 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:34.118999    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c"
Jul 23 14:14:34.257981 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:34.257950    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/799cb2e2-87c4-4e41-93ed-b96a28385dd9-workload-socket\") pod \"799cb2e2-87c4-4e41-93ed-b96a28385dd9\" (UID: \"799cb2e2-87c4-4e41-93ed-b96a28385dd9\") "
Jul 23 14:14:34.258190 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:34.257995    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/799cb2e2-87c4-4e41-93ed-b96a28385dd9-istio-envoy\") pod \"799cb2e2-87c4-4e41-93ed-b96a28385dd9\" (UID: \"799cb2e2-87c4-4e41-93ed-b96a28385dd9\") "
Jul 23 14:14:34.258190 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:34.258032    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/799cb2e2-87c4-4e41-93ed-b96a28385dd9-istio-data\") pod \"799cb2e2-87c4-4e41-93ed-b96a28385dd9\" (UID: \"799cb2e2-87c4-4e41-93ed-b96a28385dd9\") "
Jul 23 14:14:34.258190 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:34.258064    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/799cb2e2-87c4-4e41-93ed-b96a28385dd9-istiod-ca-cert\") pod \"799cb2e2-87c4-4e41-93ed-b96a28385dd9\" (UID: \"799cb2e2-87c4-4e41-93ed-b96a28385dd9\") "
Jul 23 14:14:34.258190 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:34.258133    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8tc9w\" (UniqueName: \"kubernetes.io/projected/799cb2e2-87c4-4e41-93ed-b96a28385dd9-kube-api-access-8tc9w\") pod \"799cb2e2-87c4-4e41-93ed-b96a28385dd9\" (UID: \"799cb2e2-87c4-4e41-93ed-b96a28385dd9\") "
Jul 23 14:14:34.258190 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:34.258178    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/799cb2e2-87c4-4e41-93ed-b96a28385dd9-credential-socket\") pod \"799cb2e2-87c4-4e41-93ed-b96a28385dd9\" (UID: \"799cb2e2-87c4-4e41-93ed-b96a28385dd9\") "
Jul 23 14:14:34.258470 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:34.258236    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/799cb2e2-87c4-4e41-93ed-b96a28385dd9-istio-token\") pod \"799cb2e2-87c4-4e41-93ed-b96a28385dd9\" (UID: \"799cb2e2-87c4-4e41-93ed-b96a28385dd9\") "
Jul 23 14:14:34.258470 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:34.258263    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/799cb2e2-87c4-4e41-93ed-b96a28385dd9-workload-certs\") pod \"799cb2e2-87c4-4e41-93ed-b96a28385dd9\" (UID: \"799cb2e2-87c4-4e41-93ed-b96a28385dd9\") "
Jul 23 14:14:34.258470 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:34.258261    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/799cb2e2-87c4-4e41-93ed-b96a28385dd9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "799cb2e2-87c4-4e41-93ed-b96a28385dd9" (UID: "799cb2e2-87c4-4e41-93ed-b96a28385dd9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 14:14:34.258470 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:34.258288    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/799cb2e2-87c4-4e41-93ed-b96a28385dd9-istio-podinfo\") pod \"799cb2e2-87c4-4e41-93ed-b96a28385dd9\" (UID: \"799cb2e2-87c4-4e41-93ed-b96a28385dd9\") "
Jul 23 14:14:34.258678 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:34.258512    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/799cb2e2-87c4-4e41-93ed-b96a28385dd9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "799cb2e2-87c4-4e41-93ed-b96a28385dd9" (UID: "799cb2e2-87c4-4e41-93ed-b96a28385dd9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 14:14:34.258678 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:34.258557    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/799cb2e2-87c4-4e41-93ed-b96a28385dd9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "799cb2e2-87c4-4e41-93ed-b96a28385dd9" (UID: "799cb2e2-87c4-4e41-93ed-b96a28385dd9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 14:14:34.258678 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:34.258611    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/799cb2e2-87c4-4e41-93ed-b96a28385dd9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "799cb2e2-87c4-4e41-93ed-b96a28385dd9" (UID: "799cb2e2-87c4-4e41-93ed-b96a28385dd9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 14:14:34.258678 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:34.258665    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/799cb2e2-87c4-4e41-93ed-b96a28385dd9-istiod-ca-cert\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:14:34.258888 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:34.258684    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/799cb2e2-87c4-4e41-93ed-b96a28385dd9-credential-socket\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:14:34.258888 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:34.258699    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/799cb2e2-87c4-4e41-93ed-b96a28385dd9-workload-socket\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:14:34.258999 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:34.258904    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/799cb2e2-87c4-4e41-93ed-b96a28385dd9-istio-data" (OuterVolumeSpecName: "istio-data") pod "799cb2e2-87c4-4e41-93ed-b96a28385dd9" (UID: "799cb2e2-87c4-4e41-93ed-b96a28385dd9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 14:14:34.260314 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:34.260289    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/799cb2e2-87c4-4e41-93ed-b96a28385dd9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "799cb2e2-87c4-4e41-93ed-b96a28385dd9" (UID: "799cb2e2-87c4-4e41-93ed-b96a28385dd9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 14:14:34.260445 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:34.260355    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/799cb2e2-87c4-4e41-93ed-b96a28385dd9-kube-api-access-8tc9w" (OuterVolumeSpecName: "kube-api-access-8tc9w") pod "799cb2e2-87c4-4e41-93ed-b96a28385dd9" (UID: "799cb2e2-87c4-4e41-93ed-b96a28385dd9"). InnerVolumeSpecName "kube-api-access-8tc9w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 14:14:34.260857 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:34.260839    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/799cb2e2-87c4-4e41-93ed-b96a28385dd9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "799cb2e2-87c4-4e41-93ed-b96a28385dd9" (UID: "799cb2e2-87c4-4e41-93ed-b96a28385dd9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 14:14:34.260941 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:34.260842    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/799cb2e2-87c4-4e41-93ed-b96a28385dd9-istio-token" (OuterVolumeSpecName: "istio-token") pod "799cb2e2-87c4-4e41-93ed-b96a28385dd9" (UID: "799cb2e2-87c4-4e41-93ed-b96a28385dd9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 14:14:34.359413 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:34.359376    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8tc9w\" (UniqueName: \"kubernetes.io/projected/799cb2e2-87c4-4e41-93ed-b96a28385dd9-kube-api-access-8tc9w\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:14:34.359413 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:34.359408    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/799cb2e2-87c4-4e41-93ed-b96a28385dd9-istio-token\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:14:34.359413 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:34.359418    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/799cb2e2-87c4-4e41-93ed-b96a28385dd9-workload-certs\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:14:34.359661 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:34.359427    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/799cb2e2-87c4-4e41-93ed-b96a28385dd9-istio-podinfo\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:14:34.359661 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:34.359435    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/799cb2e2-87c4-4e41-93ed-b96a28385dd9-istio-envoy\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:14:34.359661 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:34.359443    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/799cb2e2-87c4-4e41-93ed-b96a28385dd9-istio-data\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:14:34.551409 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:34.551377    2573 generic.go:356] "Generic (PLEG): container finished" podID="799cb2e2-87c4-4e41-93ed-b96a28385dd9" containerID="de4ee5760a6ed0381080366c5d2b784736af1467c619aec72f4d4b65aa785b6a" exitCode=0
Jul 23 14:14:34.551592 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:34.551425    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c"
Jul 23 14:14:34.551592 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:34.551470    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c" event={"ID":"799cb2e2-87c4-4e41-93ed-b96a28385dd9","Type":"ContainerDied","Data":"de4ee5760a6ed0381080366c5d2b784736af1467c619aec72f4d4b65aa785b6a"}
Jul 23 14:14:34.551592 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:34.551525    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c" event={"ID":"799cb2e2-87c4-4e41-93ed-b96a28385dd9","Type":"ContainerDied","Data":"f3ba722f60455d54055fccd38f0d21ffce42a8ac6e5c3e3ce9ef5f252f03f6c9"}
Jul 23 14:14:34.551592 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:34.551553    2573 scope.go:117] "RemoveContainer" containerID="de4ee5760a6ed0381080366c5d2b784736af1467c619aec72f4d4b65aa785b6a"
Jul 23 14:14:34.561494 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:34.561476    2573 scope.go:117] "RemoveContainer" containerID="51f04dd65597756dd5fe6e728dafb950e9bc096120bd5725a83b7a36b590135f"
Jul 23 14:14:34.569925 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:34.569907    2573 scope.go:117] "RemoveContainer" containerID="de4ee5760a6ed0381080366c5d2b784736af1467c619aec72f4d4b65aa785b6a"
Jul 23 14:14:34.570243 ip-10-0-140-103 kubenswrapper[2573]: E0723 14:14:34.570225    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de4ee5760a6ed0381080366c5d2b784736af1467c619aec72f4d4b65aa785b6a\": container with ID starting with de4ee5760a6ed0381080366c5d2b784736af1467c619aec72f4d4b65aa785b6a not found: ID does not exist" containerID="de4ee5760a6ed0381080366c5d2b784736af1467c619aec72f4d4b65aa785b6a"
Jul 23 14:14:34.570298 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:34.570251    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de4ee5760a6ed0381080366c5d2b784736af1467c619aec72f4d4b65aa785b6a"} err="failed to get container status \"de4ee5760a6ed0381080366c5d2b784736af1467c619aec72f4d4b65aa785b6a\": rpc error: code = NotFound desc = could not find container \"de4ee5760a6ed0381080366c5d2b784736af1467c619aec72f4d4b65aa785b6a\": container with ID starting with de4ee5760a6ed0381080366c5d2b784736af1467c619aec72f4d4b65aa785b6a not found: ID does not exist"
Jul 23 14:14:34.570298 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:34.570267    2573 scope.go:117] "RemoveContainer" containerID="51f04dd65597756dd5fe6e728dafb950e9bc096120bd5725a83b7a36b590135f"
Jul 23 14:14:34.570479 ip-10-0-140-103 kubenswrapper[2573]: E0723 14:14:34.570460    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51f04dd65597756dd5fe6e728dafb950e9bc096120bd5725a83b7a36b590135f\": container with ID starting with 51f04dd65597756dd5fe6e728dafb950e9bc096120bd5725a83b7a36b590135f not found: ID does not exist" containerID="51f04dd65597756dd5fe6e728dafb950e9bc096120bd5725a83b7a36b590135f"
Jul 23 14:14:34.570515 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:34.570483    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51f04dd65597756dd5fe6e728dafb950e9bc096120bd5725a83b7a36b590135f"} err="failed to get container status \"51f04dd65597756dd5fe6e728dafb950e9bc096120bd5725a83b7a36b590135f\": rpc error: code = NotFound desc = could not find container \"51f04dd65597756dd5fe6e728dafb950e9bc096120bd5725a83b7a36b590135f\": container with ID starting with 51f04dd65597756dd5fe6e728dafb950e9bc096120bd5725a83b7a36b590135f not found: ID does not exist"
Jul 23 14:14:34.582784 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:34.582757    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c"]
Jul 23 14:14:34.588867 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:34.588841    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-ffcc91a2-openshift-default-685b598d4c-pm28c"]
Jul 23 14:14:35.068605 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:35.068571    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="799cb2e2-87c4-4e41-93ed-b96a28385dd9" path="/var/lib/kubelet/pods/799cb2e2-87c4-4e41-93ed-b96a28385dd9/volumes"
Jul 23 14:14:35.768135 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:35.768102    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:14:35.872713 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:35.872679    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:14:35.973908 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:35.973878    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:14:36.137304 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:36.137266    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:14:42.310030 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:42.309982    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:14:42.410551 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:42.410517    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:14:49.223620 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:49.223587    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:14:49.524781 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:49.524703    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-b34b8623-openshift-default-677877f787-gpkmr"]
Jul 23 14:14:49.525204 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:49.525179    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="799cb2e2-87c4-4e41-93ed-b96a28385dd9" containerName="istio-proxy"
Jul 23 14:14:49.525294 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:49.525207    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="799cb2e2-87c4-4e41-93ed-b96a28385dd9" containerName="istio-proxy"
Jul 23 14:14:49.525294 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:49.525249    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b69f05a-b666-4b6c-a03d-e8e7f5a2de0e" containerName="revoke-keys"
Jul 23 14:14:49.525294 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:49.525258    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b69f05a-b666-4b6c-a03d-e8e7f5a2de0e" containerName="revoke-keys"
Jul 23 14:14:49.525391 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:49.525345    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b69f05a-b666-4b6c-a03d-e8e7f5a2de0e" containerName="revoke-keys"
Jul 23 14:14:49.525391 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:49.525359    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="799cb2e2-87c4-4e41-93ed-b96a28385dd9" containerName="istio-proxy"
Jul 23 14:14:49.525391 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:49.525369    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="799cb2e2-87c4-4e41-93ed-b96a28385dd9" containerName="istio-proxy"
Jul 23 14:14:49.530300 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:49.530280    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b34b8623-openshift-default-677877f787-gpkmr"
Jul 23 14:14:49.533341 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:49.533317    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-b34b8623-openshift-default-dockercfg-flw2k\""
Jul 23 14:14:49.541742 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:49.541718    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-b34b8623-openshift-default-677877f787-gpkmr"]
Jul 23 14:14:49.569569 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:49.569537    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:14:49.698003 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:49.697969    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eac7230b-154f-4b4b-9599-b92e7a043a93-workload-socket\") pod \"e2e-mt-b34b8623-openshift-default-677877f787-gpkmr\" (UID: \"eac7230b-154f-4b4b-9599-b92e7a043a93\") " pod="openshift-ingress/e2e-mt-b34b8623-openshift-default-677877f787-gpkmr"
Jul 23 14:14:49.698229 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:49.698035    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eac7230b-154f-4b4b-9599-b92e7a043a93-istio-envoy\") pod \"e2e-mt-b34b8623-openshift-default-677877f787-gpkmr\" (UID: \"eac7230b-154f-4b4b-9599-b92e7a043a93\") " pod="openshift-ingress/e2e-mt-b34b8623-openshift-default-677877f787-gpkmr"
Jul 23 14:14:49.698229 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:49.698067    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eac7230b-154f-4b4b-9599-b92e7a043a93-istiod-ca-cert\") pod \"e2e-mt-b34b8623-openshift-default-677877f787-gpkmr\" (UID: \"eac7230b-154f-4b4b-9599-b92e7a043a93\") " pod="openshift-ingress/e2e-mt-b34b8623-openshift-default-677877f787-gpkmr"
Jul 23 14:14:49.698229 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:49.698106    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eac7230b-154f-4b4b-9599-b92e7a043a93-istio-token\") pod \"e2e-mt-b34b8623-openshift-default-677877f787-gpkmr\" (UID: \"eac7230b-154f-4b4b-9599-b92e7a043a93\") " pod="openshift-ingress/e2e-mt-b34b8623-openshift-default-677877f787-gpkmr"
Jul 23 14:14:49.698229 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:49.698156    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eac7230b-154f-4b4b-9599-b92e7a043a93-workload-certs\") pod \"e2e-mt-b34b8623-openshift-default-677877f787-gpkmr\" (UID: \"eac7230b-154f-4b4b-9599-b92e7a043a93\") " pod="openshift-ingress/e2e-mt-b34b8623-openshift-default-677877f787-gpkmr"
Jul 23 14:14:49.698410 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:49.698245    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eac7230b-154f-4b4b-9599-b92e7a043a93-istio-podinfo\") pod \"e2e-mt-b34b8623-openshift-default-677877f787-gpkmr\" (UID: \"eac7230b-154f-4b4b-9599-b92e7a043a93\") " pod="openshift-ingress/e2e-mt-b34b8623-openshift-default-677877f787-gpkmr"
Jul 23 14:14:49.698410 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:49.698281    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eac7230b-154f-4b4b-9599-b92e7a043a93-istio-data\") pod \"e2e-mt-b34b8623-openshift-default-677877f787-gpkmr\" (UID: \"eac7230b-154f-4b4b-9599-b92e7a043a93\") " pod="openshift-ingress/e2e-mt-b34b8623-openshift-default-677877f787-gpkmr"
Jul 23 14:14:49.698410 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:49.698303    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eac7230b-154f-4b4b-9599-b92e7a043a93-credential-socket\") pod \"e2e-mt-b34b8623-openshift-default-677877f787-gpkmr\" (UID: \"eac7230b-154f-4b4b-9599-b92e7a043a93\") " pod="openshift-ingress/e2e-mt-b34b8623-openshift-default-677877f787-gpkmr"
Jul 23 14:14:49.698410 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:49.698326    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlqfq\" (UniqueName: \"kubernetes.io/projected/eac7230b-154f-4b4b-9599-b92e7a043a93-kube-api-access-mlqfq\") pod \"e2e-mt-b34b8623-openshift-default-677877f787-gpkmr\" (UID: \"eac7230b-154f-4b4b-9599-b92e7a043a93\") " pod="openshift-ingress/e2e-mt-b34b8623-openshift-default-677877f787-gpkmr"
Jul 23 14:14:49.790294 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:49.790264    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:14:49.798986 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:49.798959    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlqfq\" (UniqueName: \"kubernetes.io/projected/eac7230b-154f-4b4b-9599-b92e7a043a93-kube-api-access-mlqfq\") pod \"e2e-mt-b34b8623-openshift-default-677877f787-gpkmr\" (UID: \"eac7230b-154f-4b4b-9599-b92e7a043a93\") " pod="openshift-ingress/e2e-mt-b34b8623-openshift-default-677877f787-gpkmr"
Jul 23 14:14:49.799125 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:49.799042    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eac7230b-154f-4b4b-9599-b92e7a043a93-workload-socket\") pod \"e2e-mt-b34b8623-openshift-default-677877f787-gpkmr\" (UID: \"eac7230b-154f-4b4b-9599-b92e7a043a93\") " pod="openshift-ingress/e2e-mt-b34b8623-openshift-default-677877f787-gpkmr"
Jul 23 14:14:49.799125 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:49.799065    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eac7230b-154f-4b4b-9599-b92e7a043a93-istio-envoy\") pod \"e2e-mt-b34b8623-openshift-default-677877f787-gpkmr\" (UID: \"eac7230b-154f-4b4b-9599-b92e7a043a93\") " pod="openshift-ingress/e2e-mt-b34b8623-openshift-default-677877f787-gpkmr"
Jul 23 14:14:49.799125 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:49.799086    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eac7230b-154f-4b4b-9599-b92e7a043a93-istiod-ca-cert\") pod \"e2e-mt-b34b8623-openshift-default-677877f787-gpkmr\" (UID: \"eac7230b-154f-4b4b-9599-b92e7a043a93\") " pod="openshift-ingress/e2e-mt-b34b8623-openshift-default-677877f787-gpkmr"
Jul 23 14:14:49.799125 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:49.799116    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eac7230b-154f-4b4b-9599-b92e7a043a93-istio-token\") pod \"e2e-mt-b34b8623-openshift-default-677877f787-gpkmr\" (UID: \"eac7230b-154f-4b4b-9599-b92e7a043a93\") " pod="openshift-ingress/e2e-mt-b34b8623-openshift-default-677877f787-gpkmr"
Jul 23 14:14:49.799342 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:49.799168    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eac7230b-154f-4b4b-9599-b92e7a043a93-workload-certs\") pod \"e2e-mt-b34b8623-openshift-default-677877f787-gpkmr\" (UID: \"eac7230b-154f-4b4b-9599-b92e7a043a93\") " pod="openshift-ingress/e2e-mt-b34b8623-openshift-default-677877f787-gpkmr"
Jul 23 14:14:49.799342 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:49.799218    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eac7230b-154f-4b4b-9599-b92e7a043a93-istio-podinfo\") pod \"e2e-mt-b34b8623-openshift-default-677877f787-gpkmr\" (UID: \"eac7230b-154f-4b4b-9599-b92e7a043a93\") " pod="openshift-ingress/e2e-mt-b34b8623-openshift-default-677877f787-gpkmr"
Jul 23 14:14:49.799342 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:49.799242    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eac7230b-154f-4b4b-9599-b92e7a043a93-istio-data\") pod \"e2e-mt-b34b8623-openshift-default-677877f787-gpkmr\" (UID: \"eac7230b-154f-4b4b-9599-b92e7a043a93\") " pod="openshift-ingress/e2e-mt-b34b8623-openshift-default-677877f787-gpkmr"
Jul 23 14:14:49.799342 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:49.799268    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eac7230b-154f-4b4b-9599-b92e7a043a93-credential-socket\") pod \"e2e-mt-b34b8623-openshift-default-677877f787-gpkmr\" (UID: \"eac7230b-154f-4b4b-9599-b92e7a043a93\") " pod="openshift-ingress/e2e-mt-b34b8623-openshift-default-677877f787-gpkmr"
Jul 23 14:14:49.799670 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:49.799647    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eac7230b-154f-4b4b-9599-b92e7a043a93-workload-socket\") pod \"e2e-mt-b34b8623-openshift-default-677877f787-gpkmr\" (UID: \"eac7230b-154f-4b4b-9599-b92e7a043a93\") " pod="openshift-ingress/e2e-mt-b34b8623-openshift-default-677877f787-gpkmr"
Jul 23 14:14:49.799771 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:49.799651    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eac7230b-154f-4b4b-9599-b92e7a043a93-workload-certs\") pod \"e2e-mt-b34b8623-openshift-default-677877f787-gpkmr\" (UID: \"eac7230b-154f-4b4b-9599-b92e7a043a93\") " pod="openshift-ingress/e2e-mt-b34b8623-openshift-default-677877f787-gpkmr"
Jul 23 14:14:49.799771 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:49.799736    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eac7230b-154f-4b4b-9599-b92e7a043a93-istio-data\") pod \"e2e-mt-b34b8623-openshift-default-677877f787-gpkmr\" (UID: \"eac7230b-154f-4b4b-9599-b92e7a043a93\") " pod="openshift-ingress/e2e-mt-b34b8623-openshift-default-677877f787-gpkmr"
Jul 23 14:14:49.799771 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:49.799746    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eac7230b-154f-4b4b-9599-b92e7a043a93-credential-socket\") pod \"e2e-mt-b34b8623-openshift-default-677877f787-gpkmr\" (UID: \"eac7230b-154f-4b4b-9599-b92e7a043a93\") " pod="openshift-ingress/e2e-mt-b34b8623-openshift-default-677877f787-gpkmr"
Jul 23 14:14:49.800078 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:49.800055    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eac7230b-154f-4b4b-9599-b92e7a043a93-istiod-ca-cert\") pod \"e2e-mt-b34b8623-openshift-default-677877f787-gpkmr\" (UID: \"eac7230b-154f-4b4b-9599-b92e7a043a93\") " pod="openshift-ingress/e2e-mt-b34b8623-openshift-default-677877f787-gpkmr"
Jul 23 14:14:49.801439 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:49.801421    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eac7230b-154f-4b4b-9599-b92e7a043a93-istio-envoy\") pod \"e2e-mt-b34b8623-openshift-default-677877f787-gpkmr\" (UID: \"eac7230b-154f-4b4b-9599-b92e7a043a93\") " pod="openshift-ingress/e2e-mt-b34b8623-openshift-default-677877f787-gpkmr"
Jul 23 14:14:49.801704 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:49.801688    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eac7230b-154f-4b4b-9599-b92e7a043a93-istio-podinfo\") pod \"e2e-mt-b34b8623-openshift-default-677877f787-gpkmr\" (UID: \"eac7230b-154f-4b4b-9599-b92e7a043a93\") " pod="openshift-ingress/e2e-mt-b34b8623-openshift-default-677877f787-gpkmr"
Jul 23 14:14:49.809481 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:49.809461    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eac7230b-154f-4b4b-9599-b92e7a043a93-istio-token\") pod \"e2e-mt-b34b8623-openshift-default-677877f787-gpkmr\" (UID: \"eac7230b-154f-4b4b-9599-b92e7a043a93\") " pod="openshift-ingress/e2e-mt-b34b8623-openshift-default-677877f787-gpkmr"
Jul 23 14:14:49.810134 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:49.810109    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlqfq\" (UniqueName: \"kubernetes.io/projected/eac7230b-154f-4b4b-9599-b92e7a043a93-kube-api-access-mlqfq\") pod \"e2e-mt-b34b8623-openshift-default-677877f787-gpkmr\" (UID: \"eac7230b-154f-4b4b-9599-b92e7a043a93\") " pod="openshift-ingress/e2e-mt-b34b8623-openshift-default-677877f787-gpkmr"
Jul 23 14:14:49.841952 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:49.841919    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b34b8623-openshift-default-677877f787-gpkmr"
Jul 23 14:14:49.988791 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:49.988764    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-b34b8623-openshift-default-677877f787-gpkmr"]
Jul 23 14:14:49.990282 ip-10-0-140-103 kubenswrapper[2573]: W0723 14:14:49.990242    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeac7230b_154f_4b4b_9599_b92e7a043a93.slice/crio-d979f6978082f88dd997cc2bbc7e79fdda387ec8855ef108e5fd1cadf028723c WatchSource:0}: Error finding container d979f6978082f88dd997cc2bbc7e79fdda387ec8855ef108e5fd1cadf028723c: Status 404 returned error can't find the container with id d979f6978082f88dd997cc2bbc7e79fdda387ec8855ef108e5fd1cadf028723c
Jul 23 14:14:49.992406 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:49.992373    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 14:14:49.992500 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:49.992441    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 14:14:49.992500 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:49.992475    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 14:14:50.648788 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:50.648753    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b34b8623-openshift-default-677877f787-gpkmr" event={"ID":"eac7230b-154f-4b4b-9599-b92e7a043a93","Type":"ContainerStarted","Data":"8933718183c89a6e15c883be44e1b4ba6f208ae0049986a9adf24d0d3cfd0094"}
Jul 23 14:14:50.649292 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:50.648805    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b34b8623-openshift-default-677877f787-gpkmr" event={"ID":"eac7230b-154f-4b4b-9599-b92e7a043a93","Type":"ContainerStarted","Data":"d979f6978082f88dd997cc2bbc7e79fdda387ec8855ef108e5fd1cadf028723c"}
Jul 23 14:14:50.673792 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:50.673740    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-b34b8623-openshift-default-677877f787-gpkmr" podStartSLOduration=1.673725806 podStartE2EDuration="1.673725806s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 14:14:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 14:14:50.671756479 +0000 UTC m=+2062.111257400" watchObservedRunningTime="2026-07-23 14:14:50.673725806 +0000 UTC m=+2062.113226785"
Jul 23 14:14:50.842545 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:50.842510    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-b34b8623-openshift-default-677877f787-gpkmr"
Jul 23 14:14:51.847881 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:51.847852    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-b34b8623-openshift-default-677877f787-gpkmr"
Jul 23 14:14:52.663475 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:52.663442    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-b34b8623-openshift-default-677877f787-gpkmr"
Jul 23 14:14:52.664272 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:52.664255    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-b34b8623-openshift-default-677877f787-gpkmr"
Jul 23 14:14:52.670617 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:52.670588    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:14:52.795552 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:52.795519    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:14:52.939082 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:52.938966    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:14:53.093878 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:53.093844    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:14:53.446539 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:53.446499    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:14:53.544159 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:53.544124    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:14:57.116248 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:14:57.116214    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:15:00.164280 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:00.164246    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-b34b8623-29746935-svl92"]
Jul 23 14:15:00.164899 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:00.164880    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="799cb2e2-87c4-4e41-93ed-b96a28385dd9" containerName="istio-proxy"
Jul 23 14:15:00.164945 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:00.164904    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="799cb2e2-87c4-4e41-93ed-b96a28385dd9" containerName="istio-proxy"
Jul 23 14:15:00.169614 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:00.169597    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29746935-w7lwt"]
Jul 23 14:15:00.169715 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:00.169698    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-b34b8623-29746935-svl92"
Jul 23 14:15:00.173504 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:00.173482    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746935-w7lwt"
Jul 23 14:15:00.174312 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:00.174293    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6pngt\""
Jul 23 14:15:00.181508 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:00.181491    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-b34b8623-29746935-svl92"
Jul 23 14:15:00.189323 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:00.189303    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746935-w7lwt"
Jul 23 14:15:00.197201 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:00.197169    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-b34b8623-29746935-svl92"]
Jul 23 14:15:00.201829 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:00.201799    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29746935-w7lwt"]
Jul 23 14:15:00.613827 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:00.613800    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-b34b8623-29746935-svl92"]
Jul 23 14:15:00.615573 ip-10-0-140-103 kubenswrapper[2573]: W0723 14:15:00.615526    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ae082d2_f77c_4f57_82b5_cb89805147f9.slice/crio-693942af02628f6162c4724a30506d0b314cf33f301c0686910951cd900bad48 WatchSource:0}: Error finding container 693942af02628f6162c4724a30506d0b314cf33f301c0686910951cd900bad48: Status 404 returned error can't find the container with id 693942af02628f6162c4724a30506d0b314cf33f301c0686910951cd900bad48
Jul 23 14:15:00.655372 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:00.651883    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29746935-w7lwt"]
Jul 23 14:15:00.655757 ip-10-0-140-103 kubenswrapper[2573]: W0723 14:15:00.655707    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8a3cab1_591c_4252_8b74_2ca2675a5373.slice/crio-f5612304d485dc464248bdb840905ba7b46de1088a313e07cf1e0c2f3f35765c WatchSource:0}: Error finding container f5612304d485dc464248bdb840905ba7b46de1088a313e07cf1e0c2f3f35765c: Status 404 returned error can't find the container with id f5612304d485dc464248bdb840905ba7b46de1088a313e07cf1e0c2f3f35765c
Jul 23 14:15:00.713940 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:00.713904    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746935-w7lwt" event={"ID":"d8a3cab1-591c-4252-8b74-2ca2675a5373","Type":"ContainerStarted","Data":"f5612304d485dc464248bdb840905ba7b46de1088a313e07cf1e0c2f3f35765c"}
Jul 23 14:15:00.714937 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:00.714913    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-b34b8623-29746935-svl92" event={"ID":"6ae082d2-f77c-4f57-82b5-cb89805147f9","Type":"ContainerStarted","Data":"693942af02628f6162c4724a30506d0b314cf33f301c0686910951cd900bad48"}
Jul 23 14:15:01.721846 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:01.721808    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746935-w7lwt" event={"ID":"d8a3cab1-591c-4252-8b74-2ca2675a5373","Type":"ContainerStarted","Data":"e315bbaa2dd5c06ed4d077da4e6c9f39cb4b701873e1f405492f400b88311192"}
Jul 23 14:15:01.723407 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:01.723379    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-b34b8623-29746935-svl92" event={"ID":"6ae082d2-f77c-4f57-82b5-cb89805147f9","Type":"ContainerStarted","Data":"568fed2bf5090838690ade96d3996ae235ca0b33531c7d9d28a40ba7c3f0fd30"}
Jul 23 14:15:01.770523 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:01.770472    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746935-w7lwt" podStartSLOduration=1.7704560200000001 podStartE2EDuration="1.77045602s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 14:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 14:15:01.748219888 +0000 UTC m=+2073.187720809" watchObservedRunningTime="2026-07-23 14:15:01.77045602 +0000 UTC m=+2073.209956938"
Jul 23 14:15:01.772272 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:01.772240    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-b34b8623-29746935-svl92" podStartSLOduration=1.772226684 podStartE2EDuration="1.772226684s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 14:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 14:15:01.770256424 +0000 UTC m=+2073.209757343" watchObservedRunningTime="2026-07-23 14:15:01.772226684 +0000 UTC m=+2073.211727603"
Jul 23 14:15:02.742991 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:02.742942    2573 generic.go:356] "Generic (PLEG): container finished" podID="d8a3cab1-591c-4252-8b74-2ca2675a5373" containerID="e315bbaa2dd5c06ed4d077da4e6c9f39cb4b701873e1f405492f400b88311192" exitCode=0
Jul 23 14:15:02.743598 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:02.743072    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746935-w7lwt" event={"ID":"d8a3cab1-591c-4252-8b74-2ca2675a5373","Type":"ContainerDied","Data":"e315bbaa2dd5c06ed4d077da4e6c9f39cb4b701873e1f405492f400b88311192"}
Jul 23 14:15:02.749518 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:02.749131    2573 generic.go:356] "Generic (PLEG): container finished" podID="6ae082d2-f77c-4f57-82b5-cb89805147f9" containerID="568fed2bf5090838690ade96d3996ae235ca0b33531c7d9d28a40ba7c3f0fd30" exitCode=0
Jul 23 14:15:02.749518 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:02.749356    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-b34b8623-29746935-svl92" event={"ID":"6ae082d2-f77c-4f57-82b5-cb89805147f9","Type":"ContainerDied","Data":"568fed2bf5090838690ade96d3996ae235ca0b33531c7d9d28a40ba7c3f0fd30"}
Jul 23 14:15:03.946035 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:03.943455    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746935-w7lwt"
Jul 23 14:15:03.956314 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:03.956289    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-b34b8623-29746935-svl92"
Jul 23 14:15:04.763774 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:04.763738    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746935-w7lwt"
Jul 23 14:15:04.763969 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:04.763737    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746935-w7lwt" event={"ID":"d8a3cab1-591c-4252-8b74-2ca2675a5373","Type":"ContainerDied","Data":"f5612304d485dc464248bdb840905ba7b46de1088a313e07cf1e0c2f3f35765c"}
Jul 23 14:15:04.763969 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:04.763883    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f5612304d485dc464248bdb840905ba7b46de1088a313e07cf1e0c2f3f35765c"
Jul 23 14:15:04.765080 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:04.765063    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-b34b8623-29746935-svl92"
Jul 23 14:15:04.765206 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:04.765104    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-b34b8623-29746935-svl92" event={"ID":"6ae082d2-f77c-4f57-82b5-cb89805147f9","Type":"ContainerDied","Data":"693942af02628f6162c4724a30506d0b314cf33f301c0686910951cd900bad48"}
Jul 23 14:15:04.765206 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:04.765146    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="693942af02628f6162c4724a30506d0b314cf33f301c0686910951cd900bad48"
Jul 23 14:15:07.664146 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:07.664111    2573 patch_prober.go:28] interesting pod/e2e-mt-b34b8623-openshift-default-677877f787-gpkmr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Jul 23 14:15:07.664608 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:07.664172    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-b34b8623-openshift-default-677877f787-gpkmr" podUID="eac7230b-154f-4b4b-9599-b92e7a043a93" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Jul 23 14:15:07.785302 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:07.785268    2573 generic.go:356] "Generic (PLEG): container finished" podID="eac7230b-154f-4b4b-9599-b92e7a043a93" containerID="8933718183c89a6e15c883be44e1b4ba6f208ae0049986a9adf24d0d3cfd0094" exitCode=0
Jul 23 14:15:07.785479 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:07.785332    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b34b8623-openshift-default-677877f787-gpkmr" event={"ID":"eac7230b-154f-4b4b-9599-b92e7a043a93","Type":"ContainerDied","Data":"8933718183c89a6e15c883be44e1b4ba6f208ae0049986a9adf24d0d3cfd0094"}
Jul 23 14:15:07.785730 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:07.785716    2573 scope.go:117] "RemoveContainer" containerID="8933718183c89a6e15c883be44e1b4ba6f208ae0049986a9adf24d0d3cfd0094"
Jul 23 14:15:07.786833 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:07.786802    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 14:15:07.786907 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:07.786889    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 14:15:07.786947 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:07.786936    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 14:15:08.795261 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:08.795216    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b34b8623-openshift-default-677877f787-gpkmr" event={"ID":"eac7230b-154f-4b4b-9599-b92e7a043a93","Type":"ContainerStarted","Data":"78ad83580cf60e35553e3a76e4c41c7c08c2994521265c9650435a5b24695d35"}
Jul 23 14:15:08.842594 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:08.842553    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-b34b8623-openshift-default-677877f787-gpkmr"
Jul 23 14:15:08.843372 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:08.843343    2573 patch_prober.go:28] interesting pod/e2e-mt-b34b8623-openshift-default-677877f787-gpkmr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Jul 23 14:15:08.843564 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:08.843539    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b34b8623-openshift-default-677877f787-gpkmr" podUID="eac7230b-154f-4b4b-9599-b92e7a043a93" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Jul 23 14:15:09.842864 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:09.842825    2573 patch_prober.go:28] interesting pod/e2e-mt-b34b8623-openshift-default-677877f787-gpkmr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Jul 23 14:15:09.843484 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:09.843451    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b34b8623-openshift-default-677877f787-gpkmr" podUID="eac7230b-154f-4b4b-9599-b92e7a043a93" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Jul 23 14:15:10.842464 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:10.842416    2573 patch_prober.go:28] interesting pod/e2e-mt-b34b8623-openshift-default-677877f787-gpkmr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Jul 23 14:15:10.842699 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:10.842485    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b34b8623-openshift-default-677877f787-gpkmr" podUID="eac7230b-154f-4b4b-9599-b92e7a043a93" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Jul 23 14:15:11.842967 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:11.842485    2573 patch_prober.go:28] interesting pod/e2e-mt-b34b8623-openshift-default-677877f787-gpkmr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Jul 23 14:15:11.842967 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:11.842569    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b34b8623-openshift-default-677877f787-gpkmr" podUID="eac7230b-154f-4b4b-9599-b92e7a043a93" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Jul 23 14:15:12.846127 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:12.846096    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-b34b8623-openshift-default-677877f787-gpkmr"
Jul 23 14:15:12.846550 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:12.846385    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-b34b8623-openshift-default-677877f787-gpkmr"
Jul 23 14:15:12.847191 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:12.847174    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-b34b8623-openshift-default-677877f787-gpkmr"
Jul 23 14:15:17.522535 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:17.522504    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:15:29.196249 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:29.196220    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-vh5dp_2d624703-978f-48c2-b02d-9af8fd337236/console-operator/1.log"
Jul 23 14:15:29.205657 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:29.205633    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-vh5dp_2d624703-978f-48c2-b02d-9af8fd337236/console-operator/1.log"
Jul 23 14:15:36.065911 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:36.065872    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:15:40.901456 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:40.901421    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b34b8623-kf6s4"]
Jul 23 14:15:40.901865 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:40.901851    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8a3cab1-591c-4252-8b74-2ca2675a5373" containerName="cleanup"
Jul 23 14:15:40.901865 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:40.901866    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8a3cab1-591c-4252-8b74-2ca2675a5373" containerName="cleanup"
Jul 23 14:15:40.901945 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:40.901877    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ae082d2-f77c-4f57-82b5-cb89805147f9" containerName="cleanup"
Jul 23 14:15:40.901945 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:40.901883    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ae082d2-f77c-4f57-82b5-cb89805147f9" containerName="cleanup"
Jul 23 14:15:40.902023 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:40.901954    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ae082d2-f77c-4f57-82b5-cb89805147f9" containerName="cleanup"
Jul 23 14:15:40.902023 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:40.901963    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8a3cab1-591c-4252-8b74-2ca2675a5373" containerName="cleanup"
Jul 23 14:15:40.905109 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:40.905084    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b34b8623-kf6s4"
Jul 23 14:15:40.908081 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:40.908058    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6pngt\""
Jul 23 14:15:40.918232 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:40.918205    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b34b8623-kf6s4"]
Jul 23 14:15:40.997894 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:40.997858    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ef12966-5b4e-4851-b6a3-189bcbc6f81d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-b34b8623-kf6s4\" (UID: \"4ef12966-5b4e-4851-b6a3-189bcbc6f81d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b34b8623-kf6s4"
Jul 23 14:15:41.098780 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:41.098739    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ef12966-5b4e-4851-b6a3-189bcbc6f81d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-b34b8623-kf6s4\" (UID: \"4ef12966-5b4e-4851-b6a3-189bcbc6f81d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b34b8623-kf6s4"
Jul 23 14:15:41.099396 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:41.099377    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ef12966-5b4e-4851-b6a3-189bcbc6f81d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-b34b8623-kf6s4\" (UID: \"4ef12966-5b4e-4851-b6a3-189bcbc6f81d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b34b8623-kf6s4"
Jul 23 14:15:41.216061 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:41.215953    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b34b8623-kf6s4"
Jul 23 14:15:41.361199 ip-10-0-140-103 kubenswrapper[2573]: W0723 14:15:41.361154    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ef12966_5b4e_4851_b6a3_189bcbc6f81d.slice/crio-c6d839bfe2d401cdb8bab37b0067ea48032406b817035952283af8461d0eaa0c WatchSource:0}: Error finding container c6d839bfe2d401cdb8bab37b0067ea48032406b817035952283af8461d0eaa0c: Status 404 returned error can't find the container with id c6d839bfe2d401cdb8bab37b0067ea48032406b817035952283af8461d0eaa0c
Jul 23 14:15:41.361739 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:41.361711    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b34b8623-kf6s4"]
Jul 23 14:15:41.959947 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:41.959862    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:15:42.001437 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:42.001401    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b34b8623-kf6s4" event={"ID":"4ef12966-5b4e-4851-b6a3-189bcbc6f81d","Type":"ContainerStarted","Data":"4a126cc02fa357f1f698593bc5a29310551b2df950e7e2bf074a97bb2f66f33a"}
Jul 23 14:15:42.001622 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:42.001461    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b34b8623-kf6s4" event={"ID":"4ef12966-5b4e-4851-b6a3-189bcbc6f81d","Type":"ContainerStarted","Data":"c6d839bfe2d401cdb8bab37b0067ea48032406b817035952283af8461d0eaa0c"}
Jul 23 14:15:42.028162 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:42.028114    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b34b8623-kf6s4" podStartSLOduration=2.028094151 podStartE2EDuration="2.028094151s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 14:15:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 14:15:42.024766772 +0000 UTC m=+2113.464267691" watchObservedRunningTime="2026-07-23 14:15:42.028094151 +0000 UTC m=+2113.467595069"
Jul 23 14:15:43.008670 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:43.008632    2573 generic.go:356] "Generic (PLEG): container finished" podID="4ef12966-5b4e-4851-b6a3-189bcbc6f81d" containerID="4a126cc02fa357f1f698593bc5a29310551b2df950e7e2bf074a97bb2f66f33a" exitCode=0
Jul 23 14:15:43.009130 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:43.008698    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b34b8623-kf6s4" event={"ID":"4ef12966-5b4e-4851-b6a3-189bcbc6f81d","Type":"ContainerDied","Data":"4a126cc02fa357f1f698593bc5a29310551b2df950e7e2bf074a97bb2f66f33a"}
Jul 23 14:15:44.156969 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:44.156941    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b34b8623-kf6s4"
Jul 23 14:15:44.329386 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:44.329350    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ef12966-5b4e-4851-b6a3-189bcbc6f81d-maas-api-service-ca\") pod \"4ef12966-5b4e-4851-b6a3-189bcbc6f81d\" (UID: \"4ef12966-5b4e-4851-b6a3-189bcbc6f81d\") "
Jul 23 14:15:44.329718 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:44.329694    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ef12966-5b4e-4851-b6a3-189bcbc6f81d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4ef12966-5b4e-4851-b6a3-189bcbc6f81d" (UID: "4ef12966-5b4e-4851-b6a3-189bcbc6f81d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 14:15:44.430375 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:44.430337    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ef12966-5b4e-4851-b6a3-189bcbc6f81d-maas-api-service-ca\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:15:45.021702 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:45.021667    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b34b8623-kf6s4"
Jul 23 14:15:45.021876 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:45.021707    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b34b8623-kf6s4" event={"ID":"4ef12966-5b4e-4851-b6a3-189bcbc6f81d","Type":"ContainerDied","Data":"c6d839bfe2d401cdb8bab37b0067ea48032406b817035952283af8461d0eaa0c"}
Jul 23 14:15:45.021876 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:45.021755    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c6d839bfe2d401cdb8bab37b0067ea48032406b817035952283af8461d0eaa0c"
Jul 23 14:15:56.475392 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:56.475355    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-b34b8623-29746935-svl92"]
Jul 23 14:15:56.480504 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:56.480474    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-b34b8623-29746935-svl92"]
Jul 23 14:15:56.496308 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:56.496276    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:15:57.068780 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:57.068749    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ae082d2-f77c-4f57-82b5-cb89805147f9" path="/var/lib/kubelet/pods/6ae082d2-f77c-4f57-82b5-cb89805147f9/volumes"
Jul 23 14:15:59.816474 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:59.816425    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:15:59.916607 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:15:59.916573    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:16:00.995890 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:16:00.995856    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b34b8623-kf6s4"]
Jul 23 14:16:01.000984 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:16:01.000953    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b34b8623-kf6s4"]
Jul 23 14:16:01.003683 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:16:01.003660    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:16:01.068026 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:16:01.067992    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ef12966-5b4e-4851-b6a3-189bcbc6f81d" path="/var/lib/kubelet/pods/4ef12966-5b4e-4851-b6a3-189bcbc6f81d/volumes"
Jul 23 14:16:03.286786 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:16:03.280507    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:16:08.348367 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:16:08.348328    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:16:29.478154 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:16:29.478079    2573 scope.go:117] "RemoveContainer" containerID="fcf9697453eaace953bb4f58169873de1f47368347255f11d6af9cc119df6753"
Jul 23 14:16:29.487131 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:16:29.487114    2573 scope.go:117] "RemoveContainer" containerID="a7763a854838c10d59e43235cfa373f6c20e7e58fa6a6403dc7bbba80b604caf"
Jul 23 14:16:43.377718 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:16:43.377678    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:16:43.651732 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:16:43.651647    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:16:49.788163 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:16:49.788125    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:17:05.277775 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:17:05.277737    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:17:05.388176 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:17:05.388130    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:17:05.600456 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:17:05.600420    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-b34b8623-openshift-default-677877f787-gpkmr"]
Jul 23 14:17:05.600670 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:17:05.600644    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-b34b8623-openshift-default-677877f787-gpkmr" podUID="eac7230b-154f-4b4b-9599-b92e7a043a93" containerName="istio-proxy" containerID="cri-o://78ad83580cf60e35553e3a76e4c41c7c08c2994521265c9650435a5b24695d35" gracePeriod=30
Jul 23 14:17:05.639778 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:17:05.639739    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:17:05.880543 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:17:05.880465    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:17:07.077886 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:17:07.077841    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:17:07.183644 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:17:07.183612    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:17:08.031309 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:17:08.031272    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:17:08.145945 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:17:08.145910    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:17:08.247162 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:17:08.247131    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:17:09.733983 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:17:09.733949    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:17:10.872409 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:17:10.872337    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b34b8623-openshift-default-677877f787-gpkmr"
Jul 23 14:17:11.036447 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:17:11.036403    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mlqfq\" (UniqueName: \"kubernetes.io/projected/eac7230b-154f-4b4b-9599-b92e7a043a93-kube-api-access-mlqfq\") pod \"eac7230b-154f-4b4b-9599-b92e7a043a93\" (UID: \"eac7230b-154f-4b4b-9599-b92e7a043a93\") "
Jul 23 14:17:11.036447 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:17:11.036450    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eac7230b-154f-4b4b-9599-b92e7a043a93-istio-envoy\") pod \"eac7230b-154f-4b4b-9599-b92e7a043a93\" (UID: \"eac7230b-154f-4b4b-9599-b92e7a043a93\") "
Jul 23 14:17:11.036717 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:17:11.036478    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eac7230b-154f-4b4b-9599-b92e7a043a93-workload-socket\") pod \"eac7230b-154f-4b4b-9599-b92e7a043a93\" (UID: \"eac7230b-154f-4b4b-9599-b92e7a043a93\") "
Jul 23 14:17:11.036717 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:17:11.036496    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eac7230b-154f-4b4b-9599-b92e7a043a93-istio-token\") pod \"eac7230b-154f-4b4b-9599-b92e7a043a93\" (UID: \"eac7230b-154f-4b4b-9599-b92e7a043a93\") "
Jul 23 14:17:11.036717 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:17:11.036524    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eac7230b-154f-4b4b-9599-b92e7a043a93-istio-podinfo\") pod \"eac7230b-154f-4b4b-9599-b92e7a043a93\" (UID: \"eac7230b-154f-4b4b-9599-b92e7a043a93\") "
Jul 23 14:17:11.036717 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:17:11.036556    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eac7230b-154f-4b4b-9599-b92e7a043a93-credential-socket\") pod \"eac7230b-154f-4b4b-9599-b92e7a043a93\" (UID: \"eac7230b-154f-4b4b-9599-b92e7a043a93\") "
Jul 23 14:17:11.036717 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:17:11.036589    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eac7230b-154f-4b4b-9599-b92e7a043a93-istio-data\") pod \"eac7230b-154f-4b4b-9599-b92e7a043a93\" (UID: \"eac7230b-154f-4b4b-9599-b92e7a043a93\") "
Jul 23 14:17:11.036717 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:17:11.036692    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eac7230b-154f-4b4b-9599-b92e7a043a93-istiod-ca-cert\") pod \"eac7230b-154f-4b4b-9599-b92e7a043a93\" (UID: \"eac7230b-154f-4b4b-9599-b92e7a043a93\") "
Jul 23 14:17:11.037069 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:17:11.036727    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eac7230b-154f-4b4b-9599-b92e7a043a93-workload-certs\") pod \"eac7230b-154f-4b4b-9599-b92e7a043a93\" (UID: \"eac7230b-154f-4b4b-9599-b92e7a043a93\") "
Jul 23 14:17:11.037069 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:17:11.036787    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eac7230b-154f-4b4b-9599-b92e7a043a93-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "eac7230b-154f-4b4b-9599-b92e7a043a93" (UID: "eac7230b-154f-4b4b-9599-b92e7a043a93"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 14:17:11.037069 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:17:11.036906    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eac7230b-154f-4b4b-9599-b92e7a043a93-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "eac7230b-154f-4b4b-9599-b92e7a043a93" (UID: "eac7230b-154f-4b4b-9599-b92e7a043a93"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 14:17:11.037246 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:17:11.037100    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eac7230b-154f-4b4b-9599-b92e7a043a93-workload-socket\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:17:11.037246 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:17:11.037124    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eac7230b-154f-4b4b-9599-b92e7a043a93-credential-socket\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:17:11.037246 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:17:11.037184    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eac7230b-154f-4b4b-9599-b92e7a043a93-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "eac7230b-154f-4b4b-9599-b92e7a043a93" (UID: "eac7230b-154f-4b4b-9599-b92e7a043a93"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 14:17:11.037413 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:17:11.037338    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eac7230b-154f-4b4b-9599-b92e7a043a93-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "eac7230b-154f-4b4b-9599-b92e7a043a93" (UID: "eac7230b-154f-4b4b-9599-b92e7a043a93"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 14:17:11.037689 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:17:11.037664    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eac7230b-154f-4b4b-9599-b92e7a043a93-istio-data" (OuterVolumeSpecName: "istio-data") pod "eac7230b-154f-4b4b-9599-b92e7a043a93" (UID: "eac7230b-154f-4b4b-9599-b92e7a043a93"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 14:17:11.038866 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:17:11.038842    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eac7230b-154f-4b4b-9599-b92e7a043a93-kube-api-access-mlqfq" (OuterVolumeSpecName: "kube-api-access-mlqfq") pod "eac7230b-154f-4b4b-9599-b92e7a043a93" (UID: "eac7230b-154f-4b4b-9599-b92e7a043a93"). InnerVolumeSpecName "kube-api-access-mlqfq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 14:17:11.039068 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:17:11.039043    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eac7230b-154f-4b4b-9599-b92e7a043a93-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "eac7230b-154f-4b4b-9599-b92e7a043a93" (UID: "eac7230b-154f-4b4b-9599-b92e7a043a93"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 14:17:11.039195 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:17:11.039176    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eac7230b-154f-4b4b-9599-b92e7a043a93-istio-token" (OuterVolumeSpecName: "istio-token") pod "eac7230b-154f-4b4b-9599-b92e7a043a93" (UID: "eac7230b-154f-4b4b-9599-b92e7a043a93"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 14:17:11.039337 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:17:11.039310    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/eac7230b-154f-4b4b-9599-b92e7a043a93-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "eac7230b-154f-4b4b-9599-b92e7a043a93" (UID: "eac7230b-154f-4b4b-9599-b92e7a043a93"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 14:17:11.138324 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:17:11.138242    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mlqfq\" (UniqueName: \"kubernetes.io/projected/eac7230b-154f-4b4b-9599-b92e7a043a93-kube-api-access-mlqfq\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:17:11.138324 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:17:11.138272    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eac7230b-154f-4b4b-9599-b92e7a043a93-istio-envoy\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:17:11.138324 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:17:11.138283    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eac7230b-154f-4b4b-9599-b92e7a043a93-istio-token\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:17:11.138324 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:17:11.138291    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eac7230b-154f-4b4b-9599-b92e7a043a93-istio-podinfo\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:17:11.138324 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:17:11.138298    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eac7230b-154f-4b4b-9599-b92e7a043a93-istio-data\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:17:11.138324 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:17:11.138306    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eac7230b-154f-4b4b-9599-b92e7a043a93-istiod-ca-cert\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:17:11.138324 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:17:11.138313    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eac7230b-154f-4b4b-9599-b92e7a043a93-workload-certs\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:17:11.543003 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:17:11.542970    2573 generic.go:356] "Generic (PLEG): container finished" podID="eac7230b-154f-4b4b-9599-b92e7a043a93" containerID="78ad83580cf60e35553e3a76e4c41c7c08c2994521265c9650435a5b24695d35" exitCode=0
Jul 23 14:17:11.543189 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:17:11.543036    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b34b8623-openshift-default-677877f787-gpkmr" event={"ID":"eac7230b-154f-4b4b-9599-b92e7a043a93","Type":"ContainerDied","Data":"78ad83580cf60e35553e3a76e4c41c7c08c2994521265c9650435a5b24695d35"}
Jul 23 14:17:11.543189 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:17:11.543050    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b34b8623-openshift-default-677877f787-gpkmr"
Jul 23 14:17:11.543189 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:17:11.543083    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b34b8623-openshift-default-677877f787-gpkmr" event={"ID":"eac7230b-154f-4b4b-9599-b92e7a043a93","Type":"ContainerDied","Data":"d979f6978082f88dd997cc2bbc7e79fdda387ec8855ef108e5fd1cadf028723c"}
Jul 23 14:17:11.543189 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:17:11.543105    2573 scope.go:117] "RemoveContainer" containerID="78ad83580cf60e35553e3a76e4c41c7c08c2994521265c9650435a5b24695d35"
Jul 23 14:17:11.552796 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:17:11.552779    2573 scope.go:117] "RemoveContainer" containerID="8933718183c89a6e15c883be44e1b4ba6f208ae0049986a9adf24d0d3cfd0094"
Jul 23 14:17:11.561084 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:17:11.561068    2573 scope.go:117] "RemoveContainer" containerID="78ad83580cf60e35553e3a76e4c41c7c08c2994521265c9650435a5b24695d35"
Jul 23 14:17:11.561339 ip-10-0-140-103 kubenswrapper[2573]: E0723 14:17:11.561322    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78ad83580cf60e35553e3a76e4c41c7c08c2994521265c9650435a5b24695d35\": container with ID starting with 78ad83580cf60e35553e3a76e4c41c7c08c2994521265c9650435a5b24695d35 not found: ID does not exist" containerID="78ad83580cf60e35553e3a76e4c41c7c08c2994521265c9650435a5b24695d35"
Jul 23 14:17:11.561405 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:17:11.561346    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78ad83580cf60e35553e3a76e4c41c7c08c2994521265c9650435a5b24695d35"} err="failed to get container status \"78ad83580cf60e35553e3a76e4c41c7c08c2994521265c9650435a5b24695d35\": rpc error: code = NotFound desc = could not find container \"78ad83580cf60e35553e3a76e4c41c7c08c2994521265c9650435a5b24695d35\": container with ID starting with 78ad83580cf60e35553e3a76e4c41c7c08c2994521265c9650435a5b24695d35 not found: ID does not exist"
Jul 23 14:17:11.561405 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:17:11.561361    2573 scope.go:117] "RemoveContainer" containerID="8933718183c89a6e15c883be44e1b4ba6f208ae0049986a9adf24d0d3cfd0094"
Jul 23 14:17:11.561579 ip-10-0-140-103 kubenswrapper[2573]: E0723 14:17:11.561564    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8933718183c89a6e15c883be44e1b4ba6f208ae0049986a9adf24d0d3cfd0094\": container with ID starting with 8933718183c89a6e15c883be44e1b4ba6f208ae0049986a9adf24d0d3cfd0094 not found: ID does not exist" containerID="8933718183c89a6e15c883be44e1b4ba6f208ae0049986a9adf24d0d3cfd0094"
Jul 23 14:17:11.561621 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:17:11.561584    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8933718183c89a6e15c883be44e1b4ba6f208ae0049986a9adf24d0d3cfd0094"} err="failed to get container status \"8933718183c89a6e15c883be44e1b4ba6f208ae0049986a9adf24d0d3cfd0094\": rpc error: code = NotFound desc = could not find container \"8933718183c89a6e15c883be44e1b4ba6f208ae0049986a9adf24d0d3cfd0094\": container with ID starting with 8933718183c89a6e15c883be44e1b4ba6f208ae0049986a9adf24d0d3cfd0094 not found: ID does not exist"
Jul 23 14:17:11.567334 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:17:11.567311    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-b34b8623-openshift-default-677877f787-gpkmr"]
Jul 23 14:17:11.578557 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:17:11.578533    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-b34b8623-openshift-default-677877f787-gpkmr"]
Jul 23 14:17:13.068118 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:17:13.068083    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eac7230b-154f-4b4b-9599-b92e7a043a93" path="/var/lib/kubelet/pods/eac7230b-154f-4b4b-9599-b92e7a043a93/volumes"
Jul 23 14:17:16.563417 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:17:16.563375    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:17:16.659541 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:17:16.659504    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:17:17.302376 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:17:17.302338    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:17:18.480818 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:17:18.480787    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:17:24.170440 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:17:24.170395    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:17:25.159919 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:17:25.159885    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:17:25.268732 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:17:25.268698    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:17:28.296741 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:17:28.296705    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:17:28.397691 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:17:28.397659    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:17:29.513436 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:17:29.513403    2573 scope.go:117] "RemoveContainer" containerID="4efed94c53695d023065e11eb67f8b46e4fae853c6f252e0308cbb637862030b"
Jul 23 14:17:34.935857 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:17:34.935803    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:17:35.272430 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:17:35.272315    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:17:56.312910 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:17:56.312833    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:18:03.532925 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:03.532845    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:18:03.665817 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:03.665776    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:18:04.252699 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:04.252666    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c"]
Jul 23 14:18:04.253328 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:04.253296    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ef12966-5b4e-4851-b6a3-189bcbc6f81d" containerName="revoke-keys"
Jul 23 14:18:04.253328 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:04.253317    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ef12966-5b4e-4851-b6a3-189bcbc6f81d" containerName="revoke-keys"
Jul 23 14:18:04.253461 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:04.253330    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eac7230b-154f-4b4b-9599-b92e7a043a93" containerName="istio-proxy"
Jul 23 14:18:04.253461 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:04.253340    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="eac7230b-154f-4b4b-9599-b92e7a043a93" containerName="istio-proxy"
Jul 23 14:18:04.253461 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:04.253362    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eac7230b-154f-4b4b-9599-b92e7a043a93" containerName="istio-proxy"
Jul 23 14:18:04.253461 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:04.253371    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="eac7230b-154f-4b4b-9599-b92e7a043a93" containerName="istio-proxy"
Jul 23 14:18:04.253584 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:04.253514    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="eac7230b-154f-4b4b-9599-b92e7a043a93" containerName="istio-proxy"
Jul 23 14:18:04.253584 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:04.253526    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ef12966-5b4e-4851-b6a3-189bcbc6f81d" containerName="revoke-keys"
Jul 23 14:18:04.257414 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:04.257390    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c"
Jul 23 14:18:04.260140 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:04.260119    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-23f4ff-openshift-default-dockercfg-m7gfc\""
Jul 23 14:18:04.271683 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:04.271655    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c"]
Jul 23 14:18:04.420047 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:04.419986    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60d27b1e-015d-423b-aec9-d18dfef9949e-istio-token\") pod \"e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c\" (UID: \"60d27b1e-015d-423b-aec9-d18dfef9949e\") " pod="openshift-ingress/e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c"
Jul 23 14:18:04.420238 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:04.420061    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60d27b1e-015d-423b-aec9-d18dfef9949e-credential-socket\") pod \"e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c\" (UID: \"60d27b1e-015d-423b-aec9-d18dfef9949e\") " pod="openshift-ingress/e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c"
Jul 23 14:18:04.420238 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:04.420084    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fz8qw\" (UniqueName: \"kubernetes.io/projected/60d27b1e-015d-423b-aec9-d18dfef9949e-kube-api-access-fz8qw\") pod \"e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c\" (UID: \"60d27b1e-015d-423b-aec9-d18dfef9949e\") " pod="openshift-ingress/e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c"
Jul 23 14:18:04.420238 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:04.420113    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60d27b1e-015d-423b-aec9-d18dfef9949e-workload-certs\") pod \"e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c\" (UID: \"60d27b1e-015d-423b-aec9-d18dfef9949e\") " pod="openshift-ingress/e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c"
Jul 23 14:18:04.420238 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:04.420139    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60d27b1e-015d-423b-aec9-d18dfef9949e-istiod-ca-cert\") pod \"e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c\" (UID: \"60d27b1e-015d-423b-aec9-d18dfef9949e\") " pod="openshift-ingress/e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c"
Jul 23 14:18:04.420238 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:04.420166    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60d27b1e-015d-423b-aec9-d18dfef9949e-istio-envoy\") pod \"e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c\" (UID: \"60d27b1e-015d-423b-aec9-d18dfef9949e\") " pod="openshift-ingress/e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c"
Jul 23 14:18:04.420238 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:04.420198    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60d27b1e-015d-423b-aec9-d18dfef9949e-istio-data\") pod \"e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c\" (UID: \"60d27b1e-015d-423b-aec9-d18dfef9949e\") " pod="openshift-ingress/e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c"
Jul 23 14:18:04.420238 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:04.420222    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60d27b1e-015d-423b-aec9-d18dfef9949e-workload-socket\") pod \"e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c\" (UID: \"60d27b1e-015d-423b-aec9-d18dfef9949e\") " pod="openshift-ingress/e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c"
Jul 23 14:18:04.420477 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:04.420251    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60d27b1e-015d-423b-aec9-d18dfef9949e-istio-podinfo\") pod \"e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c\" (UID: \"60d27b1e-015d-423b-aec9-d18dfef9949e\") " pod="openshift-ingress/e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c"
Jul 23 14:18:04.494034 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:04.493973    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:18:04.521273 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:04.521201    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60d27b1e-015d-423b-aec9-d18dfef9949e-credential-socket\") pod \"e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c\" (UID: \"60d27b1e-015d-423b-aec9-d18dfef9949e\") " pod="openshift-ingress/e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c"
Jul 23 14:18:04.521273 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:04.521239    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fz8qw\" (UniqueName: \"kubernetes.io/projected/60d27b1e-015d-423b-aec9-d18dfef9949e-kube-api-access-fz8qw\") pod \"e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c\" (UID: \"60d27b1e-015d-423b-aec9-d18dfef9949e\") " pod="openshift-ingress/e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c"
Jul 23 14:18:04.521273 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:04.521268    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60d27b1e-015d-423b-aec9-d18dfef9949e-workload-certs\") pod \"e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c\" (UID: \"60d27b1e-015d-423b-aec9-d18dfef9949e\") " pod="openshift-ingress/e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c"
Jul 23 14:18:04.521518 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:04.521290    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60d27b1e-015d-423b-aec9-d18dfef9949e-istiod-ca-cert\") pod \"e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c\" (UID: \"60d27b1e-015d-423b-aec9-d18dfef9949e\") " pod="openshift-ingress/e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c"
Jul 23 14:18:04.521518 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:04.521317    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60d27b1e-015d-423b-aec9-d18dfef9949e-istio-envoy\") pod \"e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c\" (UID: \"60d27b1e-015d-423b-aec9-d18dfef9949e\") " pod="openshift-ingress/e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c"
Jul 23 14:18:04.521518 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:04.521341    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60d27b1e-015d-423b-aec9-d18dfef9949e-istio-data\") pod \"e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c\" (UID: \"60d27b1e-015d-423b-aec9-d18dfef9949e\") " pod="openshift-ingress/e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c"
Jul 23 14:18:04.521518 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:04.521360    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60d27b1e-015d-423b-aec9-d18dfef9949e-workload-socket\") pod \"e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c\" (UID: \"60d27b1e-015d-423b-aec9-d18dfef9949e\") " pod="openshift-ingress/e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c"
Jul 23 14:18:04.521518 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:04.521398    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60d27b1e-015d-423b-aec9-d18dfef9949e-istio-podinfo\") pod \"e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c\" (UID: \"60d27b1e-015d-423b-aec9-d18dfef9949e\") " pod="openshift-ingress/e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c"
Jul 23 14:18:04.521518 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:04.521447    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60d27b1e-015d-423b-aec9-d18dfef9949e-istio-token\") pod \"e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c\" (UID: \"60d27b1e-015d-423b-aec9-d18dfef9949e\") " pod="openshift-ingress/e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c"
Jul 23 14:18:04.521899 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:04.521668    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60d27b1e-015d-423b-aec9-d18dfef9949e-credential-socket\") pod \"e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c\" (UID: \"60d27b1e-015d-423b-aec9-d18dfef9949e\") " pod="openshift-ingress/e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c"
Jul 23 14:18:04.521899 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:04.521690    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60d27b1e-015d-423b-aec9-d18dfef9949e-workload-certs\") pod \"e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c\" (UID: \"60d27b1e-015d-423b-aec9-d18dfef9949e\") " pod="openshift-ingress/e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c"
Jul 23 14:18:04.521899 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:04.521766    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60d27b1e-015d-423b-aec9-d18dfef9949e-workload-socket\") pod \"e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c\" (UID: \"60d27b1e-015d-423b-aec9-d18dfef9949e\") " pod="openshift-ingress/e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c"
Jul 23 14:18:04.521899 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:04.521819    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60d27b1e-015d-423b-aec9-d18dfef9949e-istio-data\") pod \"e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c\" (UID: \"60d27b1e-015d-423b-aec9-d18dfef9949e\") " pod="openshift-ingress/e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c"
Jul 23 14:18:04.522108 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:04.522078    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60d27b1e-015d-423b-aec9-d18dfef9949e-istiod-ca-cert\") pod \"e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c\" (UID: \"60d27b1e-015d-423b-aec9-d18dfef9949e\") " pod="openshift-ingress/e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c"
Jul 23 14:18:04.523893 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:04.523870    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60d27b1e-015d-423b-aec9-d18dfef9949e-istio-envoy\") pod \"e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c\" (UID: \"60d27b1e-015d-423b-aec9-d18dfef9949e\") " pod="openshift-ingress/e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c"
Jul 23 14:18:04.524005 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:04.523971    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60d27b1e-015d-423b-aec9-d18dfef9949e-istio-podinfo\") pod \"e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c\" (UID: \"60d27b1e-015d-423b-aec9-d18dfef9949e\") " pod="openshift-ingress/e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c"
Jul 23 14:18:04.530821 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:04.530792    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fz8qw\" (UniqueName: \"kubernetes.io/projected/60d27b1e-015d-423b-aec9-d18dfef9949e-kube-api-access-fz8qw\") pod \"e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c\" (UID: \"60d27b1e-015d-423b-aec9-d18dfef9949e\") " pod="openshift-ingress/e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c"
Jul 23 14:18:04.530908 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:04.530822    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60d27b1e-015d-423b-aec9-d18dfef9949e-istio-token\") pod \"e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c\" (UID: \"60d27b1e-015d-423b-aec9-d18dfef9949e\") " pod="openshift-ingress/e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c"
Jul 23 14:18:04.569970 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:04.569937    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c"
Jul 23 14:18:04.571847 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:04.571823    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:18:04.726842 ip-10-0-140-103 kubenswrapper[2573]: W0723 14:18:04.726808    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60d27b1e_015d_423b_aec9_d18dfef9949e.slice/crio-9807f071886dc472cebe6152faaa10d5f7ed580ce80862f0b6a7a2e8213a2ff2 WatchSource:0}: Error finding container 9807f071886dc472cebe6152faaa10d5f7ed580ce80862f0b6a7a2e8213a2ff2: Status 404 returned error can't find the container with id 9807f071886dc472cebe6152faaa10d5f7ed580ce80862f0b6a7a2e8213a2ff2
Jul 23 14:18:04.727234 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:04.727211    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c"]
Jul 23 14:18:04.729099 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:04.729062    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 14:18:04.729196 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:04.729131    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 14:18:04.729196 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:04.729168    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 14:18:04.877675 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:04.877632    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c" event={"ID":"60d27b1e-015d-423b-aec9-d18dfef9949e","Type":"ContainerStarted","Data":"1787eb328c2a9cef5ec010c53b12e019aa8db5865cd9a7f50241045e84f63646"}
Jul 23 14:18:04.877845 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:04.877699    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c" event={"ID":"60d27b1e-015d-423b-aec9-d18dfef9949e","Type":"ContainerStarted","Data":"9807f071886dc472cebe6152faaa10d5f7ed580ce80862f0b6a7a2e8213a2ff2"}
Jul 23 14:18:04.906465 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:04.906413    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c" podStartSLOduration=0.906396712 podStartE2EDuration="906.396712ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 14:18:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 14:18:04.904716968 +0000 UTC m=+2256.344217924" watchObservedRunningTime="2026-07-23 14:18:04.906396712 +0000 UTC m=+2256.345897631"
Jul 23 14:18:04.948912 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:04.948876    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:18:05.570724 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:05.570681    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c"
Jul 23 14:18:05.575607 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:05.575583    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c"
Jul 23 14:18:05.883385 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:05.883292    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c"
Jul 23 14:18:05.884372 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:05.884352    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c"
Jul 23 14:18:06.969729 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:06.969697    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:18:07.099384 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:07.099352    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:18:07.210895 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:07.210862    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:18:07.329973 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:07.329938    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:18:07.819782 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:07.819748    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:18:07.917038 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:07.916989    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:18:11.460286 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:11.460246    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:18:11.814822 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:11.814793    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:18:12.159981 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:12.159884    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k"]
Jul 23 14:18:12.161037 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:12.160986    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="eac7230b-154f-4b4b-9599-b92e7a043a93" containerName="istio-proxy"
Jul 23 14:18:12.165083 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:12.165052    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k"
Jul 23 14:18:12.168760 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:12.168737    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-80e3ed-openshift-default-dockercfg-wl6m4\""
Jul 23 14:18:12.183492 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:12.183470    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k"]
Jul 23 14:18:12.187786 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:12.187759    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e384f45b-51aa-44cf-ae96-77cb11e89a28-istio-podinfo\") pod \"e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k\" (UID: \"e384f45b-51aa-44cf-ae96-77cb11e89a28\") " pod="openshift-ingress/e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k"
Jul 23 14:18:12.187905 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:12.187796    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e384f45b-51aa-44cf-ae96-77cb11e89a28-credential-socket\") pod \"e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k\" (UID: \"e384f45b-51aa-44cf-ae96-77cb11e89a28\") " pod="openshift-ingress/e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k"
Jul 23 14:18:12.187905 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:12.187827    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e384f45b-51aa-44cf-ae96-77cb11e89a28-istio-data\") pod \"e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k\" (UID: \"e384f45b-51aa-44cf-ae96-77cb11e89a28\") " pod="openshift-ingress/e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k"
Jul 23 14:18:12.187905 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:12.187859    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e384f45b-51aa-44cf-ae96-77cb11e89a28-istiod-ca-cert\") pod \"e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k\" (UID: \"e384f45b-51aa-44cf-ae96-77cb11e89a28\") " pod="openshift-ingress/e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k"
Jul 23 14:18:12.187905 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:12.187879    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e384f45b-51aa-44cf-ae96-77cb11e89a28-istio-envoy\") pod \"e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k\" (UID: \"e384f45b-51aa-44cf-ae96-77cb11e89a28\") " pod="openshift-ingress/e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k"
Jul 23 14:18:12.188079 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:12.187904    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tnwg\" (UniqueName: \"kubernetes.io/projected/e384f45b-51aa-44cf-ae96-77cb11e89a28-kube-api-access-5tnwg\") pod \"e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k\" (UID: \"e384f45b-51aa-44cf-ae96-77cb11e89a28\") " pod="openshift-ingress/e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k"
Jul 23 14:18:12.188079 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:12.188033    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e384f45b-51aa-44cf-ae96-77cb11e89a28-istio-token\") pod \"e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k\" (UID: \"e384f45b-51aa-44cf-ae96-77cb11e89a28\") " pod="openshift-ingress/e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k"
Jul 23 14:18:12.188156 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:12.188081    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e384f45b-51aa-44cf-ae96-77cb11e89a28-workload-certs\") pod \"e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k\" (UID: \"e384f45b-51aa-44cf-ae96-77cb11e89a28\") " pod="openshift-ingress/e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k"
Jul 23 14:18:12.188156 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:12.188120    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e384f45b-51aa-44cf-ae96-77cb11e89a28-workload-socket\") pod \"e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k\" (UID: \"e384f45b-51aa-44cf-ae96-77cb11e89a28\") " pod="openshift-ingress/e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k"
Jul 23 14:18:12.211742 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:12.211706    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:18:12.288697 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:12.288658    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e384f45b-51aa-44cf-ae96-77cb11e89a28-istio-podinfo\") pod \"e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k\" (UID: \"e384f45b-51aa-44cf-ae96-77cb11e89a28\") " pod="openshift-ingress/e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k"
Jul 23 14:18:12.288884 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:12.288704    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e384f45b-51aa-44cf-ae96-77cb11e89a28-credential-socket\") pod \"e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k\" (UID: \"e384f45b-51aa-44cf-ae96-77cb11e89a28\") " pod="openshift-ingress/e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k"
Jul 23 14:18:12.288884 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:12.288743    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e384f45b-51aa-44cf-ae96-77cb11e89a28-istio-data\") pod \"e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k\" (UID: \"e384f45b-51aa-44cf-ae96-77cb11e89a28\") " pod="openshift-ingress/e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k"
Jul 23 14:18:12.288884 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:12.288775    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e384f45b-51aa-44cf-ae96-77cb11e89a28-istiod-ca-cert\") pod \"e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k\" (UID: \"e384f45b-51aa-44cf-ae96-77cb11e89a28\") " pod="openshift-ingress/e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k"
Jul 23 14:18:12.288884 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:12.288802    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e384f45b-51aa-44cf-ae96-77cb11e89a28-istio-envoy\") pod \"e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k\" (UID: \"e384f45b-51aa-44cf-ae96-77cb11e89a28\") " pod="openshift-ingress/e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k"
Jul 23 14:18:12.288884 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:12.288832    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tnwg\" (UniqueName: \"kubernetes.io/projected/e384f45b-51aa-44cf-ae96-77cb11e89a28-kube-api-access-5tnwg\") pod \"e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k\" (UID: \"e384f45b-51aa-44cf-ae96-77cb11e89a28\") " pod="openshift-ingress/e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k"
Jul 23 14:18:12.289112 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:12.288905    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e384f45b-51aa-44cf-ae96-77cb11e89a28-istio-token\") pod \"e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k\" (UID: \"e384f45b-51aa-44cf-ae96-77cb11e89a28\") " pod="openshift-ingress/e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k"
Jul 23 14:18:12.289112 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:12.288942    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e384f45b-51aa-44cf-ae96-77cb11e89a28-workload-certs\") pod \"e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k\" (UID: \"e384f45b-51aa-44cf-ae96-77cb11e89a28\") " pod="openshift-ingress/e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k"
Jul 23 14:18:12.289112 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:12.288980    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e384f45b-51aa-44cf-ae96-77cb11e89a28-workload-socket\") pod \"e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k\" (UID: \"e384f45b-51aa-44cf-ae96-77cb11e89a28\") " pod="openshift-ingress/e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k"
Jul 23 14:18:12.289527 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:12.289345    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e384f45b-51aa-44cf-ae96-77cb11e89a28-istio-data\") pod \"e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k\" (UID: \"e384f45b-51aa-44cf-ae96-77cb11e89a28\") " pod="openshift-ingress/e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k"
Jul 23 14:18:12.289527 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:12.289406    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e384f45b-51aa-44cf-ae96-77cb11e89a28-workload-socket\") pod \"e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k\" (UID: \"e384f45b-51aa-44cf-ae96-77cb11e89a28\") " pod="openshift-ingress/e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k"
Jul 23 14:18:12.289700 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:12.289645    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e384f45b-51aa-44cf-ae96-77cb11e89a28-istiod-ca-cert\") pod \"e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k\" (UID: \"e384f45b-51aa-44cf-ae96-77cb11e89a28\") " pod="openshift-ingress/e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k"
Jul 23 14:18:12.289700 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:12.289673    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e384f45b-51aa-44cf-ae96-77cb11e89a28-workload-certs\") pod \"e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k\" (UID: \"e384f45b-51aa-44cf-ae96-77cb11e89a28\") " pod="openshift-ingress/e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k"
Jul 23 14:18:12.289820 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:12.289789    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e384f45b-51aa-44cf-ae96-77cb11e89a28-credential-socket\") pod \"e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k\" (UID: \"e384f45b-51aa-44cf-ae96-77cb11e89a28\") " pod="openshift-ingress/e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k"
Jul 23 14:18:12.291702 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:12.291677    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e384f45b-51aa-44cf-ae96-77cb11e89a28-istio-envoy\") pod \"e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k\" (UID: \"e384f45b-51aa-44cf-ae96-77cb11e89a28\") " pod="openshift-ingress/e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k"
Jul 23 14:18:12.291956 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:12.291932    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e384f45b-51aa-44cf-ae96-77cb11e89a28-istio-podinfo\") pod \"e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k\" (UID: \"e384f45b-51aa-44cf-ae96-77cb11e89a28\") " pod="openshift-ingress/e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k"
Jul 23 14:18:12.299208 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:12.299181    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e384f45b-51aa-44cf-ae96-77cb11e89a28-istio-token\") pod \"e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k\" (UID: \"e384f45b-51aa-44cf-ae96-77cb11e89a28\") " pod="openshift-ingress/e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k"
Jul 23 14:18:12.299398 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:12.299378    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tnwg\" (UniqueName: \"kubernetes.io/projected/e384f45b-51aa-44cf-ae96-77cb11e89a28-kube-api-access-5tnwg\") pod \"e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k\" (UID: \"e384f45b-51aa-44cf-ae96-77cb11e89a28\") " pod="openshift-ingress/e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k"
Jul 23 14:18:12.420669 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:12.420579    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:18:12.476083 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:12.476041    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k"
Jul 23 14:18:12.671836 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:12.671812    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k"]
Jul 23 14:18:12.674527 ip-10-0-140-103 kubenswrapper[2573]: W0723 14:18:12.674497    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode384f45b_51aa_44cf_ae96_77cb11e89a28.slice/crio-4c61e952ad53c483f508620fa8e8072e6123752881c4fb4d377be4d5237dcd36 WatchSource:0}: Error finding container 4c61e952ad53c483f508620fa8e8072e6123752881c4fb4d377be4d5237dcd36: Status 404 returned error can't find the container with id 4c61e952ad53c483f508620fa8e8072e6123752881c4fb4d377be4d5237dcd36
Jul 23 14:18:12.676761 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:12.676727    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 14:18:12.676874 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:12.676801    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 14:18:12.676874 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:12.676832    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 14:18:12.927451 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:12.927345    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k" event={"ID":"e384f45b-51aa-44cf-ae96-77cb11e89a28","Type":"ContainerStarted","Data":"240e6877b1984f5725bae460aaa0d8232a32903d58a2fa2389eb735270220053"}
Jul 23 14:18:12.927451 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:12.927419    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k" event={"ID":"e384f45b-51aa-44cf-ae96-77cb11e89a28","Type":"ContainerStarted","Data":"4c61e952ad53c483f508620fa8e8072e6123752881c4fb4d377be4d5237dcd36"}
Jul 23 14:18:12.955676 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:12.955615    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k" podStartSLOduration=0.955594802 podStartE2EDuration="955.594802ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 14:18:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 14:18:12.951463541 +0000 UTC m=+2264.390964461" watchObservedRunningTime="2026-07-23 14:18:12.955594802 +0000 UTC m=+2264.395095723"
Jul 23 14:18:13.476201 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:13.476163    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k"
Jul 23 14:18:13.481552 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:13.481526    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k"
Jul 23 14:18:13.938335 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:13.938304    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k"
Jul 23 14:18:13.943511 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:13.943485    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k"
Jul 23 14:18:14.946180 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:14.946144    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:18:15.047033 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:15.046940    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:18:15.239974 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:15.239877    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:18:15.380294 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:15.380258    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:18:15.862068 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:15.861960    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:18:15.961698 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:15.961662    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:18:18.976275 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:18.976240    2573 generic.go:356] "Generic (PLEG): container finished" podID="60d27b1e-015d-423b-aec9-d18dfef9949e" containerID="1787eb328c2a9cef5ec010c53b12e019aa8db5865cd9a7f50241045e84f63646" exitCode=0
Jul 23 14:18:18.976692 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:18.976318    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c" event={"ID":"60d27b1e-015d-423b-aec9-d18dfef9949e","Type":"ContainerDied","Data":"1787eb328c2a9cef5ec010c53b12e019aa8db5865cd9a7f50241045e84f63646"}
Jul 23 14:18:18.976788 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:18.976771    2573 scope.go:117] "RemoveContainer" containerID="1787eb328c2a9cef5ec010c53b12e019aa8db5865cd9a7f50241045e84f63646"
Jul 23 14:18:18.977949 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:18.977918    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 14:18:18.978036 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:18.977990    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 14:18:18.978078 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:18.978037    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 14:18:19.405399 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:19.405366    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:18:19.985587 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:19.985544    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c" event={"ID":"60d27b1e-015d-423b-aec9-d18dfef9949e","Type":"ContainerStarted","Data":"d1145d29ab594b535efe9142129a69291df0dcb896b6226c2fe80e532792968c"}
Jul 23 14:18:20.571089 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:20.571052    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c"
Jul 23 14:18:20.572234 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:20.572205    2573 patch_prober.go:28] interesting pod/e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Jul 23 14:18:20.572378 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:20.572292    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c" podUID="60d27b1e-015d-423b-aec9-d18dfef9949e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Jul 23 14:18:20.884057 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:20.883919    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c"
Jul 23 14:18:21.571072 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:21.571030    2573 patch_prober.go:28] interesting pod/e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Jul 23 14:18:21.572137 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:21.571676    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c" podUID="60d27b1e-015d-423b-aec9-d18dfef9949e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Jul 23 14:18:22.573464 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:22.573425    2573 patch_prober.go:28] interesting pod/e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Jul 23 14:18:22.574078 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:22.574044    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c" podUID="60d27b1e-015d-423b-aec9-d18dfef9949e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Jul 23 14:18:23.571378 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:23.571342    2573 patch_prober.go:28] interesting pod/e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Jul 23 14:18:23.571699 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:23.571664    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c" podUID="60d27b1e-015d-423b-aec9-d18dfef9949e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Jul 23 14:18:24.575091 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:24.575054    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c"
Jul 23 14:18:24.575940 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:24.575917    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c"
Jul 23 14:18:27.013031 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:27.012977    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:18:28.043093 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:28.043060    2573 generic.go:356] "Generic (PLEG): container finished" podID="e384f45b-51aa-44cf-ae96-77cb11e89a28" containerID="240e6877b1984f5725bae460aaa0d8232a32903d58a2fa2389eb735270220053" exitCode=0
Jul 23 14:18:28.043572 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:28.043137    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k" event={"ID":"e384f45b-51aa-44cf-ae96-77cb11e89a28","Type":"ContainerDied","Data":"240e6877b1984f5725bae460aaa0d8232a32903d58a2fa2389eb735270220053"}
Jul 23 14:18:28.043572 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:28.043509    2573 scope.go:117] "RemoveContainer" containerID="240e6877b1984f5725bae460aaa0d8232a32903d58a2fa2389eb735270220053"
Jul 23 14:18:28.044491 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:28.044465    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 14:18:28.044587 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:28.044527    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 14:18:28.044587 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:28.044559    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 14:18:28.938495 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:28.938449    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k"
Jul 23 14:18:29.057307 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:29.057269    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k" event={"ID":"e384f45b-51aa-44cf-ae96-77cb11e89a28","Type":"ContainerStarted","Data":"1816764f95ab81e07c337d91ecf31e78401c616fcfe3c2f5d55303c09de83ea3"}
Jul 23 14:18:29.476983 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:29.476940    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k"
Jul 23 14:18:29.478222 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:29.478189    2573 patch_prober.go:28] interesting pod/e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Jul 23 14:18:29.478358 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:29.478257    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k" podUID="e384f45b-51aa-44cf-ae96-77cb11e89a28" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Jul 23 14:18:29.543834 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:29.543795    2573 scope.go:117] "RemoveContainer" containerID="7c67f578cfad282b8ef80b3a6ed775074eeddfda64c8eb8a41a9334bd08e9e56"
Jul 23 14:18:30.476773 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:30.476734    2573 patch_prober.go:28] interesting pod/e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Jul 23 14:18:30.477224 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:30.476804    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k" podUID="e384f45b-51aa-44cf-ae96-77cb11e89a28" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Jul 23 14:18:30.532196 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:30.532110    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:18:30.626095 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:30.625988    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:18:31.476895 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:31.476858    2573 patch_prober.go:28] interesting pod/e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Jul 23 14:18:31.477325 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:31.476917    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k" podUID="e384f45b-51aa-44cf-ae96-77cb11e89a28" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Jul 23 14:18:32.477183 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:32.477133    2573 patch_prober.go:28] interesting pod/e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Jul 23 14:18:32.477673 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:32.477226    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k" podUID="e384f45b-51aa-44cf-ae96-77cb11e89a28" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Jul 23 14:18:33.480678 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:33.480644    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k"
Jul 23 14:18:33.481071 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:33.480919    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k"
Jul 23 14:18:33.481703 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:33.481682    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k"
Jul 23 14:18:37.981330 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:37.981294    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:18:38.082901 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:18:38.082861    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:19:02.309540 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:19:02.309509    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:19:44.293852 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:19:44.293767    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:19:45.358150 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:19:45.358111    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:19:46.169092 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:19:46.169057    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:19:46.269043 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:19:46.268985    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:19:55.936229 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:19:55.936193    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:20:00.522281 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:00.522248    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:20:00.972846 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:00.972805    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:20:07.500166 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:07.500129    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:20:07.601278 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:07.601228    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:20:07.712661 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:07.712626    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c"]
Jul 23 14:20:07.712846 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:07.712824    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c" podUID="60d27b1e-015d-423b-aec9-d18dfef9949e" containerName="istio-proxy" containerID="cri-o://d1145d29ab594b535efe9142129a69291df0dcb896b6226c2fe80e532792968c" gracePeriod=30
Jul 23 14:20:07.729370 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:07.729332    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:20:07.959759 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:07.959693    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:20:08.796212 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:08.796178    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:20:08.890741 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:08.890704    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:20:09.577492 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:09.577453    2573 patch_prober.go:28] interesting pod/e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 23 14:20:09.577661 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:09.577513    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c" podUID="60d27b1e-015d-423b-aec9-d18dfef9949e" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 23 14:20:12.969416 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:12.969386    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c"
Jul 23 14:20:13.041941 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:13.041913    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60d27b1e-015d-423b-aec9-d18dfef9949e-credential-socket\") pod \"60d27b1e-015d-423b-aec9-d18dfef9949e\" (UID: \"60d27b1e-015d-423b-aec9-d18dfef9949e\") "
Jul 23 14:20:13.042137 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:13.041951    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60d27b1e-015d-423b-aec9-d18dfef9949e-istio-podinfo\") pod \"60d27b1e-015d-423b-aec9-d18dfef9949e\" (UID: \"60d27b1e-015d-423b-aec9-d18dfef9949e\") "
Jul 23 14:20:13.042137 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:13.042041    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60d27b1e-015d-423b-aec9-d18dfef9949e-workload-certs\") pod \"60d27b1e-015d-423b-aec9-d18dfef9949e\" (UID: \"60d27b1e-015d-423b-aec9-d18dfef9949e\") "
Jul 23 14:20:13.042137 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:13.042090    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60d27b1e-015d-423b-aec9-d18dfef9949e-workload-socket\") pod \"60d27b1e-015d-423b-aec9-d18dfef9949e\" (UID: \"60d27b1e-015d-423b-aec9-d18dfef9949e\") "
Jul 23 14:20:13.042137 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:13.042115    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60d27b1e-015d-423b-aec9-d18dfef9949e-istio-token\") pod \"60d27b1e-015d-423b-aec9-d18dfef9949e\" (UID: \"60d27b1e-015d-423b-aec9-d18dfef9949e\") "
Jul 23 14:20:13.042365 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:13.042137    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60d27b1e-015d-423b-aec9-d18dfef9949e-istio-envoy\") pod \"60d27b1e-015d-423b-aec9-d18dfef9949e\" (UID: \"60d27b1e-015d-423b-aec9-d18dfef9949e\") "
Jul 23 14:20:13.042365 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:13.042199    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60d27b1e-015d-423b-aec9-d18dfef9949e-istio-data\") pod \"60d27b1e-015d-423b-aec9-d18dfef9949e\" (UID: \"60d27b1e-015d-423b-aec9-d18dfef9949e\") "
Jul 23 14:20:13.042365 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:13.042227    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60d27b1e-015d-423b-aec9-d18dfef9949e-istiod-ca-cert\") pod \"60d27b1e-015d-423b-aec9-d18dfef9949e\" (UID: \"60d27b1e-015d-423b-aec9-d18dfef9949e\") "
Jul 23 14:20:13.042365 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:13.042227    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60d27b1e-015d-423b-aec9-d18dfef9949e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "60d27b1e-015d-423b-aec9-d18dfef9949e" (UID: "60d27b1e-015d-423b-aec9-d18dfef9949e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 14:20:13.042365 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:13.042263    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fz8qw\" (UniqueName: \"kubernetes.io/projected/60d27b1e-015d-423b-aec9-d18dfef9949e-kube-api-access-fz8qw\") pod \"60d27b1e-015d-423b-aec9-d18dfef9949e\" (UID: \"60d27b1e-015d-423b-aec9-d18dfef9949e\") "
Jul 23 14:20:13.042615 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:13.042412    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60d27b1e-015d-423b-aec9-d18dfef9949e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "60d27b1e-015d-423b-aec9-d18dfef9949e" (UID: "60d27b1e-015d-423b-aec9-d18dfef9949e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 14:20:13.042615 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:13.042422    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60d27b1e-015d-423b-aec9-d18dfef9949e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "60d27b1e-015d-423b-aec9-d18dfef9949e" (UID: "60d27b1e-015d-423b-aec9-d18dfef9949e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 14:20:13.042729 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:13.042632    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60d27b1e-015d-423b-aec9-d18dfef9949e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "60d27b1e-015d-423b-aec9-d18dfef9949e" (UID: "60d27b1e-015d-423b-aec9-d18dfef9949e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 14:20:13.042729 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:13.042685    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60d27b1e-015d-423b-aec9-d18dfef9949e-credential-socket\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:20:13.042729 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:13.042704    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60d27b1e-015d-423b-aec9-d18dfef9949e-workload-certs\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:20:13.042729 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:13.042719    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60d27b1e-015d-423b-aec9-d18dfef9949e-workload-socket\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:20:13.043202 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:13.043178    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60d27b1e-015d-423b-aec9-d18dfef9949e-istio-data" (OuterVolumeSpecName: "istio-data") pod "60d27b1e-015d-423b-aec9-d18dfef9949e" (UID: "60d27b1e-015d-423b-aec9-d18dfef9949e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 14:20:13.044488 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:13.044466    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60d27b1e-015d-423b-aec9-d18dfef9949e-kube-api-access-fz8qw" (OuterVolumeSpecName: "kube-api-access-fz8qw") pod "60d27b1e-015d-423b-aec9-d18dfef9949e" (UID: "60d27b1e-015d-423b-aec9-d18dfef9949e"). InnerVolumeSpecName "kube-api-access-fz8qw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 14:20:13.044583 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:13.044497    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60d27b1e-015d-423b-aec9-d18dfef9949e-istio-token" (OuterVolumeSpecName: "istio-token") pod "60d27b1e-015d-423b-aec9-d18dfef9949e" (UID: "60d27b1e-015d-423b-aec9-d18dfef9949e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 14:20:13.044707 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:13.044692    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/60d27b1e-015d-423b-aec9-d18dfef9949e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "60d27b1e-015d-423b-aec9-d18dfef9949e" (UID: "60d27b1e-015d-423b-aec9-d18dfef9949e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 14:20:13.044769 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:13.044719    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60d27b1e-015d-423b-aec9-d18dfef9949e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "60d27b1e-015d-423b-aec9-d18dfef9949e" (UID: "60d27b1e-015d-423b-aec9-d18dfef9949e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 14:20:13.143407 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:13.143373    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60d27b1e-015d-423b-aec9-d18dfef9949e-istio-podinfo\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:20:13.143407 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:13.143401    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60d27b1e-015d-423b-aec9-d18dfef9949e-istio-token\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:20:13.143407 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:13.143412    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60d27b1e-015d-423b-aec9-d18dfef9949e-istio-envoy\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:20:13.143620 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:13.143419    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60d27b1e-015d-423b-aec9-d18dfef9949e-istio-data\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:20:13.143620 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:13.143429    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60d27b1e-015d-423b-aec9-d18dfef9949e-istiod-ca-cert\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:20:13.143620 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:13.143436    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fz8qw\" (UniqueName: \"kubernetes.io/projected/60d27b1e-015d-423b-aec9-d18dfef9949e-kube-api-access-fz8qw\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:20:13.684139 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:13.684103    2573 generic.go:356] "Generic (PLEG): container finished" podID="60d27b1e-015d-423b-aec9-d18dfef9949e" containerID="d1145d29ab594b535efe9142129a69291df0dcb896b6226c2fe80e532792968c" exitCode=0
Jul 23 14:20:13.684312 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:13.684161    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c"
Jul 23 14:20:13.684312 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:13.684190    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c" event={"ID":"60d27b1e-015d-423b-aec9-d18dfef9949e","Type":"ContainerDied","Data":"d1145d29ab594b535efe9142129a69291df0dcb896b6226c2fe80e532792968c"}
Jul 23 14:20:13.684312 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:13.684250    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c" event={"ID":"60d27b1e-015d-423b-aec9-d18dfef9949e","Type":"ContainerDied","Data":"9807f071886dc472cebe6152faaa10d5f7ed580ce80862f0b6a7a2e8213a2ff2"}
Jul 23 14:20:13.684312 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:13.684281    2573 scope.go:117] "RemoveContainer" containerID="d1145d29ab594b535efe9142129a69291df0dcb896b6226c2fe80e532792968c"
Jul 23 14:20:13.693619 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:13.693598    2573 scope.go:117] "RemoveContainer" containerID="1787eb328c2a9cef5ec010c53b12e019aa8db5865cd9a7f50241045e84f63646"
Jul 23 14:20:13.701990 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:13.701971    2573 scope.go:117] "RemoveContainer" containerID="d1145d29ab594b535efe9142129a69291df0dcb896b6226c2fe80e532792968c"
Jul 23 14:20:13.702363 ip-10-0-140-103 kubenswrapper[2573]: E0723 14:20:13.702343    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1145d29ab594b535efe9142129a69291df0dcb896b6226c2fe80e532792968c\": container with ID starting with d1145d29ab594b535efe9142129a69291df0dcb896b6226c2fe80e532792968c not found: ID does not exist" containerID="d1145d29ab594b535efe9142129a69291df0dcb896b6226c2fe80e532792968c"
Jul 23 14:20:13.702442 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:13.702375    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1145d29ab594b535efe9142129a69291df0dcb896b6226c2fe80e532792968c"} err="failed to get container status \"d1145d29ab594b535efe9142129a69291df0dcb896b6226c2fe80e532792968c\": rpc error: code = NotFound desc = could not find container \"d1145d29ab594b535efe9142129a69291df0dcb896b6226c2fe80e532792968c\": container with ID starting with d1145d29ab594b535efe9142129a69291df0dcb896b6226c2fe80e532792968c not found: ID does not exist"
Jul 23 14:20:13.702442 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:13.702411    2573 scope.go:117] "RemoveContainer" containerID="1787eb328c2a9cef5ec010c53b12e019aa8db5865cd9a7f50241045e84f63646"
Jul 23 14:20:13.702687 ip-10-0-140-103 kubenswrapper[2573]: E0723 14:20:13.702667    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1787eb328c2a9cef5ec010c53b12e019aa8db5865cd9a7f50241045e84f63646\": container with ID starting with 1787eb328c2a9cef5ec010c53b12e019aa8db5865cd9a7f50241045e84f63646 not found: ID does not exist" containerID="1787eb328c2a9cef5ec010c53b12e019aa8db5865cd9a7f50241045e84f63646"
Jul 23 14:20:13.702728 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:13.702694    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1787eb328c2a9cef5ec010c53b12e019aa8db5865cd9a7f50241045e84f63646"} err="failed to get container status \"1787eb328c2a9cef5ec010c53b12e019aa8db5865cd9a7f50241045e84f63646\": rpc error: code = NotFound desc = could not find container \"1787eb328c2a9cef5ec010c53b12e019aa8db5865cd9a7f50241045e84f63646\": container with ID starting with 1787eb328c2a9cef5ec010c53b12e019aa8db5865cd9a7f50241045e84f63646 not found: ID does not exist"
Jul 23 14:20:13.710214 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:13.710195    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c"]
Jul 23 14:20:13.717879 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:13.717859    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-23f4ff-openshift-default-85776b8cc9-sb58c"]
Jul 23 14:20:15.068972 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:15.068936    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60d27b1e-015d-423b-aec9-d18dfef9949e" path="/var/lib/kubelet/pods/60d27b1e-015d-423b-aec9-d18dfef9949e/volumes"
Jul 23 14:20:18.854817 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:18.854782    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:20:23.142145 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:23.142105    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:20:23.557103 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:23.557063    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:20:29.241777 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:29.241746    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-vh5dp_2d624703-978f-48c2-b02d-9af8fd337236/console-operator/1.log"
Jul 23 14:20:29.251185 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:29.251160    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-vh5dp_2d624703-978f-48c2-b02d-9af8fd337236/console-operator/1.log"
Jul 23 14:20:29.579192 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:29.579162    2573 scope.go:117] "RemoveContainer" containerID="1403d0512ff7f23aada54df65155d53acb83c9dc639611d480cb1d9249b5da5a"
Jul 23 14:20:29.716214 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:29.716177    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:20:29.821995 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:29.821959    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:20:29.976568 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:29.976486    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k"]
Jul 23 14:20:29.976755 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:29.976727    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k" podUID="e384f45b-51aa-44cf-ae96-77cb11e89a28" containerName="istio-proxy" containerID="cri-o://1816764f95ab81e07c337d91ecf31e78401c616fcfe3c2f5d55303c09de83ea3" gracePeriod=30
Jul 23 14:20:30.005127 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:30.005101    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:20:30.235180 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:30.235102    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:20:30.592020 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:30.591990    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:20:30.894292 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:30.894217    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl"]
Jul 23 14:20:30.894664 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:30.894651    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60d27b1e-015d-423b-aec9-d18dfef9949e" containerName="istio-proxy"
Jul 23 14:20:30.894714 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:30.894665    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="60d27b1e-015d-423b-aec9-d18dfef9949e" containerName="istio-proxy"
Jul 23 14:20:30.894714 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:30.894682    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60d27b1e-015d-423b-aec9-d18dfef9949e" containerName="istio-proxy"
Jul 23 14:20:30.894714 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:30.894688    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="60d27b1e-015d-423b-aec9-d18dfef9949e" containerName="istio-proxy"
Jul 23 14:20:30.894866 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:30.894750    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="60d27b1e-015d-423b-aec9-d18dfef9949e" containerName="istio-proxy"
Jul 23 14:20:30.894866 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:30.894761    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="60d27b1e-015d-423b-aec9-d18dfef9949e" containerName="istio-proxy"
Jul 23 14:20:30.899376 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:30.899356    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl"
Jul 23 14:20:30.902034 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:30.901999    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-e8799a-openshift-default-dockercfg-mx48b\""
Jul 23 14:20:30.912453 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:30.912426    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl"]
Jul 23 14:20:30.916376 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:30.916351    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64d1df78-c7d7-454a-8c45-b73a71e8c8bc-credential-socket\") pod \"e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl\" (UID: \"64d1df78-c7d7-454a-8c45-b73a71e8c8bc\") " pod="openshift-ingress/e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl"
Jul 23 14:20:30.916491 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:30.916392    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64d1df78-c7d7-454a-8c45-b73a71e8c8bc-istiod-ca-cert\") pod \"e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl\" (UID: \"64d1df78-c7d7-454a-8c45-b73a71e8c8bc\") " pod="openshift-ingress/e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl"
Jul 23 14:20:30.916491 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:30.916412    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64d1df78-c7d7-454a-8c45-b73a71e8c8bc-workload-certs\") pod \"e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl\" (UID: \"64d1df78-c7d7-454a-8c45-b73a71e8c8bc\") " pod="openshift-ingress/e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl"
Jul 23 14:20:30.916491 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:30.916461    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhnxr\" (UniqueName: \"kubernetes.io/projected/64d1df78-c7d7-454a-8c45-b73a71e8c8bc-kube-api-access-qhnxr\") pod \"e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl\" (UID: \"64d1df78-c7d7-454a-8c45-b73a71e8c8bc\") " pod="openshift-ingress/e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl"
Jul 23 14:20:30.916605 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:30.916547    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64d1df78-c7d7-454a-8c45-b73a71e8c8bc-istio-podinfo\") pod \"e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl\" (UID: \"64d1df78-c7d7-454a-8c45-b73a71e8c8bc\") " pod="openshift-ingress/e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl"
Jul 23 14:20:30.916605 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:30.916575    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64d1df78-c7d7-454a-8c45-b73a71e8c8bc-istio-token\") pod \"e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl\" (UID: \"64d1df78-c7d7-454a-8c45-b73a71e8c8bc\") " pod="openshift-ingress/e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl"
Jul 23 14:20:30.916690 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:30.916644    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64d1df78-c7d7-454a-8c45-b73a71e8c8bc-istio-envoy\") pod \"e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl\" (UID: \"64d1df78-c7d7-454a-8c45-b73a71e8c8bc\") " pod="openshift-ingress/e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl"
Jul 23 14:20:30.916690 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:30.916668    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64d1df78-c7d7-454a-8c45-b73a71e8c8bc-istio-data\") pod \"e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl\" (UID: \"64d1df78-c7d7-454a-8c45-b73a71e8c8bc\") " pod="openshift-ingress/e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl"
Jul 23 14:20:30.916763 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:30.916724    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64d1df78-c7d7-454a-8c45-b73a71e8c8bc-workload-socket\") pod \"e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl\" (UID: \"64d1df78-c7d7-454a-8c45-b73a71e8c8bc\") " pod="openshift-ingress/e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl"
Jul 23 14:20:30.932131 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:30.932101    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:20:31.018252 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:31.018214    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64d1df78-c7d7-454a-8c45-b73a71e8c8bc-workload-socket\") pod \"e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl\" (UID: \"64d1df78-c7d7-454a-8c45-b73a71e8c8bc\") " pod="openshift-ingress/e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl"
Jul 23 14:20:31.018446 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:31.018260    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64d1df78-c7d7-454a-8c45-b73a71e8c8bc-credential-socket\") pod \"e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl\" (UID: \"64d1df78-c7d7-454a-8c45-b73a71e8c8bc\") " pod="openshift-ingress/e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl"
Jul 23 14:20:31.018446 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:31.018294    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64d1df78-c7d7-454a-8c45-b73a71e8c8bc-istiod-ca-cert\") pod \"e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl\" (UID: \"64d1df78-c7d7-454a-8c45-b73a71e8c8bc\") " pod="openshift-ingress/e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl"
Jul 23 14:20:31.018446 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:31.018313    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64d1df78-c7d7-454a-8c45-b73a71e8c8bc-workload-certs\") pod \"e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl\" (UID: \"64d1df78-c7d7-454a-8c45-b73a71e8c8bc\") " pod="openshift-ingress/e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl"
Jul 23 14:20:31.018446 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:31.018331    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhnxr\" (UniqueName: \"kubernetes.io/projected/64d1df78-c7d7-454a-8c45-b73a71e8c8bc-kube-api-access-qhnxr\") pod \"e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl\" (UID: \"64d1df78-c7d7-454a-8c45-b73a71e8c8bc\") " pod="openshift-ingress/e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl"
Jul 23 14:20:31.018446 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:31.018374    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64d1df78-c7d7-454a-8c45-b73a71e8c8bc-istio-podinfo\") pod \"e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl\" (UID: \"64d1df78-c7d7-454a-8c45-b73a71e8c8bc\") " pod="openshift-ingress/e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl"
Jul 23 14:20:31.018741 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:31.018526    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64d1df78-c7d7-454a-8c45-b73a71e8c8bc-istio-token\") pod \"e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl\" (UID: \"64d1df78-c7d7-454a-8c45-b73a71e8c8bc\") " pod="openshift-ingress/e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl"
Jul 23 14:20:31.018741 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:31.018607    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64d1df78-c7d7-454a-8c45-b73a71e8c8bc-istio-envoy\") pod \"e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl\" (UID: \"64d1df78-c7d7-454a-8c45-b73a71e8c8bc\") " pod="openshift-ingress/e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl"
Jul 23 14:20:31.018741 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:31.018635    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64d1df78-c7d7-454a-8c45-b73a71e8c8bc-istio-data\") pod \"e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl\" (UID: \"64d1df78-c7d7-454a-8c45-b73a71e8c8bc\") " pod="openshift-ingress/e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl"
Jul 23 14:20:31.018741 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:31.018642    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64d1df78-c7d7-454a-8c45-b73a71e8c8bc-workload-socket\") pod \"e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl\" (UID: \"64d1df78-c7d7-454a-8c45-b73a71e8c8bc\") " pod="openshift-ingress/e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl"
Jul 23 14:20:31.018741 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:31.018688    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64d1df78-c7d7-454a-8c45-b73a71e8c8bc-workload-certs\") pod \"e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl\" (UID: \"64d1df78-c7d7-454a-8c45-b73a71e8c8bc\") " pod="openshift-ingress/e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl"
Jul 23 14:20:31.018946 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:31.018779    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64d1df78-c7d7-454a-8c45-b73a71e8c8bc-credential-socket\") pod \"e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl\" (UID: \"64d1df78-c7d7-454a-8c45-b73a71e8c8bc\") " pod="openshift-ingress/e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl"
Jul 23 14:20:31.018994 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:31.018962    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64d1df78-c7d7-454a-8c45-b73a71e8c8bc-istio-data\") pod \"e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl\" (UID: \"64d1df78-c7d7-454a-8c45-b73a71e8c8bc\") " pod="openshift-ingress/e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl"
Jul 23 14:20:31.019102 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:31.019083    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64d1df78-c7d7-454a-8c45-b73a71e8c8bc-istiod-ca-cert\") pod \"e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl\" (UID: \"64d1df78-c7d7-454a-8c45-b73a71e8c8bc\") " pod="openshift-ingress/e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl"
Jul 23 14:20:31.020614 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:31.020585    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:20:31.020977 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:31.020957    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64d1df78-c7d7-454a-8c45-b73a71e8c8bc-istio-envoy\") pod \"e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl\" (UID: \"64d1df78-c7d7-454a-8c45-b73a71e8c8bc\") " pod="openshift-ingress/e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl"
Jul 23 14:20:31.021112 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:31.021095    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64d1df78-c7d7-454a-8c45-b73a71e8c8bc-istio-podinfo\") pod \"e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl\" (UID: \"64d1df78-c7d7-454a-8c45-b73a71e8c8bc\") " pod="openshift-ingress/e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl"
Jul 23 14:20:31.028224 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:31.028199    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64d1df78-c7d7-454a-8c45-b73a71e8c8bc-istio-token\") pod \"e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl\" (UID: \"64d1df78-c7d7-454a-8c45-b73a71e8c8bc\") " pod="openshift-ingress/e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl"
Jul 23 14:20:31.028989 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:31.028970    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhnxr\" (UniqueName: \"kubernetes.io/projected/64d1df78-c7d7-454a-8c45-b73a71e8c8bc-kube-api-access-qhnxr\") pod \"e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl\" (UID: \"64d1df78-c7d7-454a-8c45-b73a71e8c8bc\") " pod="openshift-ingress/e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl"
Jul 23 14:20:31.211466 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:31.211379    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl"
Jul 23 14:20:31.358657 ip-10-0-140-103 kubenswrapper[2573]: W0723 14:20:31.358626    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64d1df78_c7d7_454a_8c45_b73a71e8c8bc.slice/crio-f9d51f4df6dacb9eccdffdd131bff7a1a4e7245b1e10b91e9753eecc679f535b WatchSource:0}: Error finding container f9d51f4df6dacb9eccdffdd131bff7a1a4e7245b1e10b91e9753eecc679f535b: Status 404 returned error can't find the container with id f9d51f4df6dacb9eccdffdd131bff7a1a4e7245b1e10b91e9753eecc679f535b
Jul 23 14:20:31.359613 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:31.359587    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl"]
Jul 23 14:20:31.360959 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:31.360930    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 14:20:31.361003 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:31.360994    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 14:20:31.361057 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:31.361045    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 14:20:31.802580 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:31.802548    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl" event={"ID":"64d1df78-c7d7-454a-8c45-b73a71e8c8bc","Type":"ContainerStarted","Data":"86faeddd59ebc3c06be24c682dab8b37cc7ff836518b19c6c9ee98a0f92cd8a8"}
Jul 23 14:20:31.802945 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:31.802600    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl" event={"ID":"64d1df78-c7d7-454a-8c45-b73a71e8c8bc","Type":"ContainerStarted","Data":"f9d51f4df6dacb9eccdffdd131bff7a1a4e7245b1e10b91e9753eecc679f535b"}
Jul 23 14:20:31.833828 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:31.833778    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl" podStartSLOduration=1.833764393 podStartE2EDuration="1.833764393s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 14:20:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 14:20:31.8317797 +0000 UTC m=+2403.271280619" watchObservedRunningTime="2026-07-23 14:20:31.833764393 +0000 UTC m=+2403.273265312"
Jul 23 14:20:32.212227 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:32.212142    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl"
Jul 23 14:20:32.217148 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:32.217117    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl"
Jul 23 14:20:32.809222 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:32.809189    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl"
Jul 23 14:20:32.810138 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:32.810115    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl"
Jul 23 14:20:33.483433 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:33.483399    2573 patch_prober.go:28] interesting pod/e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 23 14:20:33.483605 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:33.483454    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k" podUID="e384f45b-51aa-44cf-ae96-77cb11e89a28" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 23 14:20:33.889655 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:33.889616    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:20:33.989697 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:33.989634    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:20:34.090845 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:34.090811    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:20:34.598117 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:34.598080    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:20:34.698328 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:34.698290    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:20:35.240305 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:35.240242    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k"
Jul 23 14:20:35.259792 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:35.259760    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e384f45b-51aa-44cf-ae96-77cb11e89a28-istiod-ca-cert\") pod \"e384f45b-51aa-44cf-ae96-77cb11e89a28\" (UID: \"e384f45b-51aa-44cf-ae96-77cb11e89a28\") "
Jul 23 14:20:35.259990 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:35.259811    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e384f45b-51aa-44cf-ae96-77cb11e89a28-workload-certs\") pod \"e384f45b-51aa-44cf-ae96-77cb11e89a28\" (UID: \"e384f45b-51aa-44cf-ae96-77cb11e89a28\") "
Jul 23 14:20:35.259990 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:35.259835    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e384f45b-51aa-44cf-ae96-77cb11e89a28-istio-token\") pod \"e384f45b-51aa-44cf-ae96-77cb11e89a28\" (UID: \"e384f45b-51aa-44cf-ae96-77cb11e89a28\") "
Jul 23 14:20:35.259990 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:35.259899    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e384f45b-51aa-44cf-ae96-77cb11e89a28-credential-socket\") pod \"e384f45b-51aa-44cf-ae96-77cb11e89a28\" (UID: \"e384f45b-51aa-44cf-ae96-77cb11e89a28\") "
Jul 23 14:20:35.259990 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:35.259942    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e384f45b-51aa-44cf-ae96-77cb11e89a28-istio-data\") pod \"e384f45b-51aa-44cf-ae96-77cb11e89a28\" (UID: \"e384f45b-51aa-44cf-ae96-77cb11e89a28\") "
Jul 23 14:20:35.260281 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:35.259996    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5tnwg\" (UniqueName: \"kubernetes.io/projected/e384f45b-51aa-44cf-ae96-77cb11e89a28-kube-api-access-5tnwg\") pod \"e384f45b-51aa-44cf-ae96-77cb11e89a28\" (UID: \"e384f45b-51aa-44cf-ae96-77cb11e89a28\") "
Jul 23 14:20:35.260281 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:35.260050    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e384f45b-51aa-44cf-ae96-77cb11e89a28-workload-socket\") pod \"e384f45b-51aa-44cf-ae96-77cb11e89a28\" (UID: \"e384f45b-51aa-44cf-ae96-77cb11e89a28\") "
Jul 23 14:20:35.260281 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:35.260127    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e384f45b-51aa-44cf-ae96-77cb11e89a28-istio-envoy\") pod \"e384f45b-51aa-44cf-ae96-77cb11e89a28\" (UID: \"e384f45b-51aa-44cf-ae96-77cb11e89a28\") "
Jul 23 14:20:35.260281 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:35.260149    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e384f45b-51aa-44cf-ae96-77cb11e89a28-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e384f45b-51aa-44cf-ae96-77cb11e89a28" (UID: "e384f45b-51aa-44cf-ae96-77cb11e89a28"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 14:20:35.260281 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:35.260157    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e384f45b-51aa-44cf-ae96-77cb11e89a28-istio-podinfo\") pod \"e384f45b-51aa-44cf-ae96-77cb11e89a28\" (UID: \"e384f45b-51aa-44cf-ae96-77cb11e89a28\") "
Jul 23 14:20:35.260281 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:35.260220    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e384f45b-51aa-44cf-ae96-77cb11e89a28-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e384f45b-51aa-44cf-ae96-77cb11e89a28" (UID: "e384f45b-51aa-44cf-ae96-77cb11e89a28"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 14:20:35.260281 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:35.260263    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e384f45b-51aa-44cf-ae96-77cb11e89a28-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e384f45b-51aa-44cf-ae96-77cb11e89a28" (UID: "e384f45b-51aa-44cf-ae96-77cb11e89a28"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 14:20:35.260620 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:35.260482    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e384f45b-51aa-44cf-ae96-77cb11e89a28-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e384f45b-51aa-44cf-ae96-77cb11e89a28" (UID: "e384f45b-51aa-44cf-ae96-77cb11e89a28"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 14:20:35.260620 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:35.260517    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e384f45b-51aa-44cf-ae96-77cb11e89a28-workload-certs\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:20:35.260620 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:35.260536    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e384f45b-51aa-44cf-ae96-77cb11e89a28-credential-socket\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:20:35.260620 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:35.260549    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e384f45b-51aa-44cf-ae96-77cb11e89a28-istiod-ca-cert\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:20:35.261275 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:35.261247    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e384f45b-51aa-44cf-ae96-77cb11e89a28-istio-data" (OuterVolumeSpecName: "istio-data") pod "e384f45b-51aa-44cf-ae96-77cb11e89a28" (UID: "e384f45b-51aa-44cf-ae96-77cb11e89a28"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 14:20:35.262206 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:35.262182    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e384f45b-51aa-44cf-ae96-77cb11e89a28-istio-token" (OuterVolumeSpecName: "istio-token") pod "e384f45b-51aa-44cf-ae96-77cb11e89a28" (UID: "e384f45b-51aa-44cf-ae96-77cb11e89a28"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 14:20:35.262326 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:35.262309    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e384f45b-51aa-44cf-ae96-77cb11e89a28-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e384f45b-51aa-44cf-ae96-77cb11e89a28" (UID: "e384f45b-51aa-44cf-ae96-77cb11e89a28"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 14:20:35.262380 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:35.262365    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e384f45b-51aa-44cf-ae96-77cb11e89a28-kube-api-access-5tnwg" (OuterVolumeSpecName: "kube-api-access-5tnwg") pod "e384f45b-51aa-44cf-ae96-77cb11e89a28" (UID: "e384f45b-51aa-44cf-ae96-77cb11e89a28"). InnerVolumeSpecName "kube-api-access-5tnwg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 14:20:35.262584 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:35.262559    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e384f45b-51aa-44cf-ae96-77cb11e89a28-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e384f45b-51aa-44cf-ae96-77cb11e89a28" (UID: "e384f45b-51aa-44cf-ae96-77cb11e89a28"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 14:20:35.361376 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:35.361343    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e384f45b-51aa-44cf-ae96-77cb11e89a28-istio-data\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:20:35.361376 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:35.361372    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5tnwg\" (UniqueName: \"kubernetes.io/projected/e384f45b-51aa-44cf-ae96-77cb11e89a28-kube-api-access-5tnwg\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:20:35.361376 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:35.361382    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e384f45b-51aa-44cf-ae96-77cb11e89a28-workload-socket\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:20:35.361619 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:35.361391    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e384f45b-51aa-44cf-ae96-77cb11e89a28-istio-envoy\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:20:35.361619 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:35.361400    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e384f45b-51aa-44cf-ae96-77cb11e89a28-istio-podinfo\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:20:35.361619 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:35.361408    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e384f45b-51aa-44cf-ae96-77cb11e89a28-istio-token\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:20:35.829725 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:35.829693    2573 generic.go:356] "Generic (PLEG): container finished" podID="e384f45b-51aa-44cf-ae96-77cb11e89a28" containerID="1816764f95ab81e07c337d91ecf31e78401c616fcfe3c2f5d55303c09de83ea3" exitCode=0
Jul 23 14:20:35.829927 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:35.829744    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k"
Jul 23 14:20:35.829927 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:35.829781    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k" event={"ID":"e384f45b-51aa-44cf-ae96-77cb11e89a28","Type":"ContainerDied","Data":"1816764f95ab81e07c337d91ecf31e78401c616fcfe3c2f5d55303c09de83ea3"}
Jul 23 14:20:35.829927 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:35.829837    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k" event={"ID":"e384f45b-51aa-44cf-ae96-77cb11e89a28","Type":"ContainerDied","Data":"4c61e952ad53c483f508620fa8e8072e6123752881c4fb4d377be4d5237dcd36"}
Jul 23 14:20:35.829927 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:35.829859    2573 scope.go:117] "RemoveContainer" containerID="1816764f95ab81e07c337d91ecf31e78401c616fcfe3c2f5d55303c09de83ea3"
Jul 23 14:20:35.850242 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:35.850216    2573 scope.go:117] "RemoveContainer" containerID="240e6877b1984f5725bae460aaa0d8232a32903d58a2fa2389eb735270220053"
Jul 23 14:20:35.859137 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:35.859117    2573 scope.go:117] "RemoveContainer" containerID="1816764f95ab81e07c337d91ecf31e78401c616fcfe3c2f5d55303c09de83ea3"
Jul 23 14:20:35.859420 ip-10-0-140-103 kubenswrapper[2573]: E0723 14:20:35.859402    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1816764f95ab81e07c337d91ecf31e78401c616fcfe3c2f5d55303c09de83ea3\": container with ID starting with 1816764f95ab81e07c337d91ecf31e78401c616fcfe3c2f5d55303c09de83ea3 not found: ID does not exist" containerID="1816764f95ab81e07c337d91ecf31e78401c616fcfe3c2f5d55303c09de83ea3"
Jul 23 14:20:35.859481 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:35.859427    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1816764f95ab81e07c337d91ecf31e78401c616fcfe3c2f5d55303c09de83ea3"} err="failed to get container status \"1816764f95ab81e07c337d91ecf31e78401c616fcfe3c2f5d55303c09de83ea3\": rpc error: code = NotFound desc = could not find container \"1816764f95ab81e07c337d91ecf31e78401c616fcfe3c2f5d55303c09de83ea3\": container with ID starting with 1816764f95ab81e07c337d91ecf31e78401c616fcfe3c2f5d55303c09de83ea3 not found: ID does not exist"
Jul 23 14:20:35.859481 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:35.859444    2573 scope.go:117] "RemoveContainer" containerID="240e6877b1984f5725bae460aaa0d8232a32903d58a2fa2389eb735270220053"
Jul 23 14:20:35.859680 ip-10-0-140-103 kubenswrapper[2573]: E0723 14:20:35.859661    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"240e6877b1984f5725bae460aaa0d8232a32903d58a2fa2389eb735270220053\": container with ID starting with 240e6877b1984f5725bae460aaa0d8232a32903d58a2fa2389eb735270220053 not found: ID does not exist" containerID="240e6877b1984f5725bae460aaa0d8232a32903d58a2fa2389eb735270220053"
Jul 23 14:20:35.859731 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:35.859685    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"240e6877b1984f5725bae460aaa0d8232a32903d58a2fa2389eb735270220053"} err="failed to get container status \"240e6877b1984f5725bae460aaa0d8232a32903d58a2fa2389eb735270220053\": rpc error: code = NotFound desc = could not find container \"240e6877b1984f5725bae460aaa0d8232a32903d58a2fa2389eb735270220053\": container with ID starting with 240e6877b1984f5725bae460aaa0d8232a32903d58a2fa2389eb735270220053 not found: ID does not exist"
Jul 23 14:20:35.861948 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:35.861926    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k"]
Jul 23 14:20:35.865537 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:35.865515    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-80e3ed-openshift-default-79b79fd9b5-v699k"]
Jul 23 14:20:37.068262 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:37.068228    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e384f45b-51aa-44cf-ae96-77cb11e89a28" path="/var/lib/kubelet/pods/e384f45b-51aa-44cf-ae96-77cb11e89a28/volumes"
Jul 23 14:20:38.336004 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:38.335957    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:20:38.810310 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:38.810273    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:20:39.105869 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:39.105786    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-636249-openshift-default-9bd85997-rlswr"]
Jul 23 14:20:39.106333 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:39.106315    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e384f45b-51aa-44cf-ae96-77cb11e89a28" containerName="istio-proxy"
Jul 23 14:20:39.106442 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:39.106335    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e384f45b-51aa-44cf-ae96-77cb11e89a28" containerName="istio-proxy"
Jul 23 14:20:39.106442 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:39.106365    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e384f45b-51aa-44cf-ae96-77cb11e89a28" containerName="istio-proxy"
Jul 23 14:20:39.106442 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:39.106373    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e384f45b-51aa-44cf-ae96-77cb11e89a28" containerName="istio-proxy"
Jul 23 14:20:39.106602 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:39.106480    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="e384f45b-51aa-44cf-ae96-77cb11e89a28" containerName="istio-proxy"
Jul 23 14:20:39.111118 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:39.111097    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-636249-openshift-default-9bd85997-rlswr"
Jul 23 14:20:39.115658 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:39.115633    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-636249-openshift-default-dockercfg-stdk5\""
Jul 23 14:20:39.123678 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:39.123654    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-636249-openshift-default-9bd85997-rlswr"]
Jul 23 14:20:39.136573 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:39.136541    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:20:39.196627 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:39.196586    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/433b882b-7f32-4b90-95a6-d48af7c2c7fa-credential-socket\") pod \"e2e-api-b-636249-openshift-default-9bd85997-rlswr\" (UID: \"433b882b-7f32-4b90-95a6-d48af7c2c7fa\") " pod="openshift-ingress/e2e-api-b-636249-openshift-default-9bd85997-rlswr"
Jul 23 14:20:39.196831 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:39.196651    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsc5s\" (UniqueName: \"kubernetes.io/projected/433b882b-7f32-4b90-95a6-d48af7c2c7fa-kube-api-access-bsc5s\") pod \"e2e-api-b-636249-openshift-default-9bd85997-rlswr\" (UID: \"433b882b-7f32-4b90-95a6-d48af7c2c7fa\") " pod="openshift-ingress/e2e-api-b-636249-openshift-default-9bd85997-rlswr"
Jul 23 14:20:39.196831 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:39.196703    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/433b882b-7f32-4b90-95a6-d48af7c2c7fa-istio-podinfo\") pod \"e2e-api-b-636249-openshift-default-9bd85997-rlswr\" (UID: \"433b882b-7f32-4b90-95a6-d48af7c2c7fa\") " pod="openshift-ingress/e2e-api-b-636249-openshift-default-9bd85997-rlswr"
Jul 23 14:20:39.196831 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:39.196733    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/433b882b-7f32-4b90-95a6-d48af7c2c7fa-workload-certs\") pod \"e2e-api-b-636249-openshift-default-9bd85997-rlswr\" (UID: \"433b882b-7f32-4b90-95a6-d48af7c2c7fa\") " pod="openshift-ingress/e2e-api-b-636249-openshift-default-9bd85997-rlswr"
Jul 23 14:20:39.196831 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:39.196781    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/433b882b-7f32-4b90-95a6-d48af7c2c7fa-istio-token\") pod \"e2e-api-b-636249-openshift-default-9bd85997-rlswr\" (UID: \"433b882b-7f32-4b90-95a6-d48af7c2c7fa\") " pod="openshift-ingress/e2e-api-b-636249-openshift-default-9bd85997-rlswr"
Jul 23 14:20:39.196831 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:39.196808    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/433b882b-7f32-4b90-95a6-d48af7c2c7fa-workload-socket\") pod \"e2e-api-b-636249-openshift-default-9bd85997-rlswr\" (UID: \"433b882b-7f32-4b90-95a6-d48af7c2c7fa\") " pod="openshift-ingress/e2e-api-b-636249-openshift-default-9bd85997-rlswr"
Jul 23 14:20:39.197072 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:39.196845    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/433b882b-7f32-4b90-95a6-d48af7c2c7fa-istio-data\") pod \"e2e-api-b-636249-openshift-default-9bd85997-rlswr\" (UID: \"433b882b-7f32-4b90-95a6-d48af7c2c7fa\") " pod="openshift-ingress/e2e-api-b-636249-openshift-default-9bd85997-rlswr"
Jul 23 14:20:39.197072 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:39.196971    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/433b882b-7f32-4b90-95a6-d48af7c2c7fa-istiod-ca-cert\") pod \"e2e-api-b-636249-openshift-default-9bd85997-rlswr\" (UID: \"433b882b-7f32-4b90-95a6-d48af7c2c7fa\") " pod="openshift-ingress/e2e-api-b-636249-openshift-default-9bd85997-rlswr"
Jul 23 14:20:39.197172 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:39.197072    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/433b882b-7f32-4b90-95a6-d48af7c2c7fa-istio-envoy\") pod \"e2e-api-b-636249-openshift-default-9bd85997-rlswr\" (UID: \"433b882b-7f32-4b90-95a6-d48af7c2c7fa\") " pod="openshift-ingress/e2e-api-b-636249-openshift-default-9bd85997-rlswr"
Jul 23 14:20:39.298079 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:39.298038    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/433b882b-7f32-4b90-95a6-d48af7c2c7fa-workload-certs\") pod \"e2e-api-b-636249-openshift-default-9bd85997-rlswr\" (UID: \"433b882b-7f32-4b90-95a6-d48af7c2c7fa\") " pod="openshift-ingress/e2e-api-b-636249-openshift-default-9bd85997-rlswr"
Jul 23 14:20:39.298267 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:39.298176    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/433b882b-7f32-4b90-95a6-d48af7c2c7fa-istio-token\") pod \"e2e-api-b-636249-openshift-default-9bd85997-rlswr\" (UID: \"433b882b-7f32-4b90-95a6-d48af7c2c7fa\") " pod="openshift-ingress/e2e-api-b-636249-openshift-default-9bd85997-rlswr"
Jul 23 14:20:39.298267 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:39.298209    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/433b882b-7f32-4b90-95a6-d48af7c2c7fa-workload-socket\") pod \"e2e-api-b-636249-openshift-default-9bd85997-rlswr\" (UID: \"433b882b-7f32-4b90-95a6-d48af7c2c7fa\") " pod="openshift-ingress/e2e-api-b-636249-openshift-default-9bd85997-rlswr"
Jul 23 14:20:39.298267 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:39.298237    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/433b882b-7f32-4b90-95a6-d48af7c2c7fa-istio-data\") pod \"e2e-api-b-636249-openshift-default-9bd85997-rlswr\" (UID: \"433b882b-7f32-4b90-95a6-d48af7c2c7fa\") " pod="openshift-ingress/e2e-api-b-636249-openshift-default-9bd85997-rlswr"
Jul 23 14:20:39.298445 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:39.298297    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/433b882b-7f32-4b90-95a6-d48af7c2c7fa-istiod-ca-cert\") pod \"e2e-api-b-636249-openshift-default-9bd85997-rlswr\" (UID: \"433b882b-7f32-4b90-95a6-d48af7c2c7fa\") " pod="openshift-ingress/e2e-api-b-636249-openshift-default-9bd85997-rlswr"
Jul 23 14:20:39.298445 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:39.298422    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/433b882b-7f32-4b90-95a6-d48af7c2c7fa-istio-envoy\") pod \"e2e-api-b-636249-openshift-default-9bd85997-rlswr\" (UID: \"433b882b-7f32-4b90-95a6-d48af7c2c7fa\") " pod="openshift-ingress/e2e-api-b-636249-openshift-default-9bd85997-rlswr"
Jul 23 14:20:39.298564 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:39.298463    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/433b882b-7f32-4b90-95a6-d48af7c2c7fa-credential-socket\") pod \"e2e-api-b-636249-openshift-default-9bd85997-rlswr\" (UID: \"433b882b-7f32-4b90-95a6-d48af7c2c7fa\") " pod="openshift-ingress/e2e-api-b-636249-openshift-default-9bd85997-rlswr"
Jul 23 14:20:39.298564 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:39.298471    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/433b882b-7f32-4b90-95a6-d48af7c2c7fa-workload-certs\") pod \"e2e-api-b-636249-openshift-default-9bd85997-rlswr\" (UID: \"433b882b-7f32-4b90-95a6-d48af7c2c7fa\") " pod="openshift-ingress/e2e-api-b-636249-openshift-default-9bd85997-rlswr"
Jul 23 14:20:39.298564 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:39.298510    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bsc5s\" (UniqueName: \"kubernetes.io/projected/433b882b-7f32-4b90-95a6-d48af7c2c7fa-kube-api-access-bsc5s\") pod \"e2e-api-b-636249-openshift-default-9bd85997-rlswr\" (UID: \"433b882b-7f32-4b90-95a6-d48af7c2c7fa\") " pod="openshift-ingress/e2e-api-b-636249-openshift-default-9bd85997-rlswr"
Jul 23 14:20:39.298564 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:39.298547    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/433b882b-7f32-4b90-95a6-d48af7c2c7fa-istio-podinfo\") pod \"e2e-api-b-636249-openshift-default-9bd85997-rlswr\" (UID: \"433b882b-7f32-4b90-95a6-d48af7c2c7fa\") " pod="openshift-ingress/e2e-api-b-636249-openshift-default-9bd85997-rlswr"
Jul 23 14:20:39.298863 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:39.298558    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/433b882b-7f32-4b90-95a6-d48af7c2c7fa-workload-socket\") pod \"e2e-api-b-636249-openshift-default-9bd85997-rlswr\" (UID: \"433b882b-7f32-4b90-95a6-d48af7c2c7fa\") " pod="openshift-ingress/e2e-api-b-636249-openshift-default-9bd85997-rlswr"
Jul 23 14:20:39.298863 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:39.298667    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/433b882b-7f32-4b90-95a6-d48af7c2c7fa-istio-data\") pod \"e2e-api-b-636249-openshift-default-9bd85997-rlswr\" (UID: \"433b882b-7f32-4b90-95a6-d48af7c2c7fa\") " pod="openshift-ingress/e2e-api-b-636249-openshift-default-9bd85997-rlswr"
Jul 23 14:20:39.298863 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:39.298735    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/433b882b-7f32-4b90-95a6-d48af7c2c7fa-credential-socket\") pod \"e2e-api-b-636249-openshift-default-9bd85997-rlswr\" (UID: \"433b882b-7f32-4b90-95a6-d48af7c2c7fa\") " pod="openshift-ingress/e2e-api-b-636249-openshift-default-9bd85997-rlswr"
Jul 23 14:20:39.299038 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:39.298965    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/433b882b-7f32-4b90-95a6-d48af7c2c7fa-istiod-ca-cert\") pod \"e2e-api-b-636249-openshift-default-9bd85997-rlswr\" (UID: \"433b882b-7f32-4b90-95a6-d48af7c2c7fa\") " pod="openshift-ingress/e2e-api-b-636249-openshift-default-9bd85997-rlswr"
Jul 23 14:20:39.300722 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:39.300699    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/433b882b-7f32-4b90-95a6-d48af7c2c7fa-istio-envoy\") pod \"e2e-api-b-636249-openshift-default-9bd85997-rlswr\" (UID: \"433b882b-7f32-4b90-95a6-d48af7c2c7fa\") " pod="openshift-ingress/e2e-api-b-636249-openshift-default-9bd85997-rlswr"
Jul 23 14:20:39.300861 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:39.300843    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/433b882b-7f32-4b90-95a6-d48af7c2c7fa-istio-podinfo\") pod \"e2e-api-b-636249-openshift-default-9bd85997-rlswr\" (UID: \"433b882b-7f32-4b90-95a6-d48af7c2c7fa\") " pod="openshift-ingress/e2e-api-b-636249-openshift-default-9bd85997-rlswr"
Jul 23 14:20:39.306633 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:39.306607    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/433b882b-7f32-4b90-95a6-d48af7c2c7fa-istio-token\") pod \"e2e-api-b-636249-openshift-default-9bd85997-rlswr\" (UID: \"433b882b-7f32-4b90-95a6-d48af7c2c7fa\") " pod="openshift-ingress/e2e-api-b-636249-openshift-default-9bd85997-rlswr"
Jul 23 14:20:39.306993 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:39.306977    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsc5s\" (UniqueName: \"kubernetes.io/projected/433b882b-7f32-4b90-95a6-d48af7c2c7fa-kube-api-access-bsc5s\") pod \"e2e-api-b-636249-openshift-default-9bd85997-rlswr\" (UID: \"433b882b-7f32-4b90-95a6-d48af7c2c7fa\") " pod="openshift-ingress/e2e-api-b-636249-openshift-default-9bd85997-rlswr"
Jul 23 14:20:39.326615 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:39.326584    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:20:39.422471 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:39.422378    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-636249-openshift-default-9bd85997-rlswr"
Jul 23 14:20:39.590840 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:39.590813    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-636249-openshift-default-9bd85997-rlswr"]
Jul 23 14:20:39.591847 ip-10-0-140-103 kubenswrapper[2573]: W0723 14:20:39.591821    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod433b882b_7f32_4b90_95a6_d48af7c2c7fa.slice/crio-6f52350303eac75ffb821bea6f73cb885114bd961ab1d4484ed449463f58b645 WatchSource:0}: Error finding container 6f52350303eac75ffb821bea6f73cb885114bd961ab1d4484ed449463f58b645: Status 404 returned error can't find the container with id 6f52350303eac75ffb821bea6f73cb885114bd961ab1d4484ed449463f58b645
Jul 23 14:20:39.594146 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:39.594108    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 14:20:39.594243 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:39.594187    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 14:20:39.594243 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:39.594232    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 14:20:39.856465 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:39.856433    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-636249-openshift-default-9bd85997-rlswr" event={"ID":"433b882b-7f32-4b90-95a6-d48af7c2c7fa","Type":"ContainerStarted","Data":"2b4676f7d6837ac006b036b808908047038b0710a8fb89182ca4beaa4f697e28"}
Jul 23 14:20:39.856639 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:39.856490    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-636249-openshift-default-9bd85997-rlswr" event={"ID":"433b882b-7f32-4b90-95a6-d48af7c2c7fa","Type":"ContainerStarted","Data":"6f52350303eac75ffb821bea6f73cb885114bd961ab1d4484ed449463f58b645"}
Jul 23 14:20:39.886993 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:39.886931    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-636249-openshift-default-9bd85997-rlswr" podStartSLOduration=0.886911691 podStartE2EDuration="886.911691ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 14:20:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 14:20:39.886094763 +0000 UTC m=+2411.325595681" watchObservedRunningTime="2026-07-23 14:20:39.886911691 +0000 UTC m=+2411.326412610"
Jul 23 14:20:40.422877 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:40.422843    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-636249-openshift-default-9bd85997-rlswr"
Jul 23 14:20:40.427945 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:40.427916    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-636249-openshift-default-9bd85997-rlswr"
Jul 23 14:20:40.862545 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:40.862506    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-636249-openshift-default-9bd85997-rlswr"
Jul 23 14:20:40.863452 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:40.863432    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-636249-openshift-default-9bd85997-rlswr"
Jul 23 14:20:41.985685 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:41.985647    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:20:42.074819 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:42.074787    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:20:42.270144 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:42.270053    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:20:42.634166 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:42.634079    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:20:42.874405 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:42.874347    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:20:42.974245 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:42.974121    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:20:46.412626 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:46.412566    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:20:48.851187 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:48.851143    2573 patch_prober.go:28] interesting pod/e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 23 14:20:48.851665 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:48.851226    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl" podUID="64d1df78-c7d7-454a-8c45-b73a71e8c8bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 23 14:20:49.920350 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:49.920313    2573 generic.go:356] "Generic (PLEG): container finished" podID="64d1df78-c7d7-454a-8c45-b73a71e8c8bc" containerID="86faeddd59ebc3c06be24c682dab8b37cc7ff836518b19c6c9ee98a0f92cd8a8" exitCode=0
Jul 23 14:20:49.920899 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:49.920367    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl" event={"ID":"64d1df78-c7d7-454a-8c45-b73a71e8c8bc","Type":"ContainerDied","Data":"86faeddd59ebc3c06be24c682dab8b37cc7ff836518b19c6c9ee98a0f92cd8a8"}
Jul 23 14:20:49.920967 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:49.920924    2573 scope.go:117] "RemoveContainer" containerID="86faeddd59ebc3c06be24c682dab8b37cc7ff836518b19c6c9ee98a0f92cd8a8"
Jul 23 14:20:49.921995 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:49.921965    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 14:20:49.922089 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:49.922050    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 14:20:49.922132 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:49.922100    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 14:20:50.929297 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:50.929190    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl" event={"ID":"64d1df78-c7d7-454a-8c45-b73a71e8c8bc","Type":"ContainerStarted","Data":"f9a395886aa8820af1b4e2d11f55d23efc90b1fd7e8f3a89f9941aa4c562e014"}
Jul 23 14:20:51.212057 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:51.211958    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl"
Jul 23 14:20:51.212290 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:51.212267    2573 patch_prober.go:28] interesting pod/e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Jul 23 14:20:51.212427 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:51.212408    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl" podUID="64d1df78-c7d7-454a-8c45-b73a71e8c8bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Jul 23 14:20:52.212348 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:52.212305    2573 patch_prober.go:28] interesting pod/e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Jul 23 14:20:52.212742 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:52.212361    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl" podUID="64d1df78-c7d7-454a-8c45-b73a71e8c8bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Jul 23 14:20:53.212526 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:53.212488    2573 patch_prober.go:28] interesting pod/e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Jul 23 14:20:53.212917 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:53.212552    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl" podUID="64d1df78-c7d7-454a-8c45-b73a71e8c8bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Jul 23 14:20:54.212369 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:54.212321    2573 patch_prober.go:28] interesting pod/e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Jul 23 14:20:54.212545 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:54.212405    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl" podUID="64d1df78-c7d7-454a-8c45-b73a71e8c8bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Jul 23 14:20:55.132234 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:55.132199    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:20:55.210864 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:55.210823    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:20:55.215335 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:55.215311    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl"
Jul 23 14:20:55.215811 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:55.215787    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl"
Jul 23 14:20:55.216532 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:55.216512    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl"
Jul 23 14:20:56.428409 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:56.427522    2573 patch_prober.go:28] interesting pod/e2e-api-b-636249-openshift-default-9bd85997-rlswr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": read tcp 10.132.0.2:36900->10.132.0.82:15021: read: connection reset by peer" start-of-body=
Jul 23 14:20:56.428409 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:56.427583    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-636249-openshift-default-9bd85997-rlswr" podUID="433b882b-7f32-4b90-95a6-d48af7c2c7fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": read tcp 10.132.0.2:36900->10.132.0.82:15021: read: connection reset by peer"
Jul 23 14:20:56.993817 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:56.993780    2573 generic.go:356] "Generic (PLEG): container finished" podID="433b882b-7f32-4b90-95a6-d48af7c2c7fa" containerID="2b4676f7d6837ac006b036b808908047038b0710a8fb89182ca4beaa4f697e28" exitCode=0
Jul 23 14:20:56.994001 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:56.993837    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-636249-openshift-default-9bd85997-rlswr" event={"ID":"433b882b-7f32-4b90-95a6-d48af7c2c7fa","Type":"ContainerDied","Data":"2b4676f7d6837ac006b036b808908047038b0710a8fb89182ca4beaa4f697e28"}
Jul 23 14:20:56.994278 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:56.994263    2573 scope.go:117] "RemoveContainer" containerID="2b4676f7d6837ac006b036b808908047038b0710a8fb89182ca4beaa4f697e28"
Jul 23 14:20:56.995351 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:56.995322    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 14:20:56.995429 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:56.995412    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 14:20:56.995483 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:56.995468    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 14:20:58.001808 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:58.001771    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-636249-openshift-default-9bd85997-rlswr" event={"ID":"433b882b-7f32-4b90-95a6-d48af7c2c7fa","Type":"ContainerStarted","Data":"e4b4bd44c2c4ec28cafc18353976f7a86a30141454ed79627bd4e4528c307f12"}
Jul 23 14:20:58.423433 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:58.423390    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-636249-openshift-default-9bd85997-rlswr"
Jul 23 14:20:58.423661 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:58.423634    2573 patch_prober.go:28] interesting pod/e2e-api-b-636249-openshift-default-9bd85997-rlswr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Jul 23 14:20:58.423755 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:58.423695    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-636249-openshift-default-9bd85997-rlswr" podUID="433b882b-7f32-4b90-95a6-d48af7c2c7fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Jul 23 14:20:59.423167 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:59.423120    2573 patch_prober.go:28] interesting pod/e2e-api-b-636249-openshift-default-9bd85997-rlswr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Jul 23 14:20:59.423571 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:20:59.423185    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-636249-openshift-default-9bd85997-rlswr" podUID="433b882b-7f32-4b90-95a6-d48af7c2c7fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Jul 23 14:21:00.423570 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:00.423529    2573 patch_prober.go:28] interesting pod/e2e-api-b-636249-openshift-default-9bd85997-rlswr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Jul 23 14:21:00.424171 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:00.423599    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-636249-openshift-default-9bd85997-rlswr" podUID="433b882b-7f32-4b90-95a6-d48af7c2c7fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Jul 23 14:21:00.827352 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:00.827308    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:21:00.928965 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:00.928930    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:21:01.423191 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:01.423149    2573 patch_prober.go:28] interesting pod/e2e-api-b-636249-openshift-default-9bd85997-rlswr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Jul 23 14:21:01.423383 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:01.423211    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-636249-openshift-default-9bd85997-rlswr" podUID="433b882b-7f32-4b90-95a6-d48af7c2c7fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Jul 23 14:21:02.427284 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:02.427251    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-636249-openshift-default-9bd85997-rlswr"
Jul 23 14:21:02.427766 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:02.427719    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-636249-openshift-default-9bd85997-rlswr"
Jul 23 14:21:02.428679 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:02.428659    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-636249-openshift-default-9bd85997-rlswr"
Jul 23 14:21:03.697202 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:03.697165    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:21:03.800193 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:03.800161    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:21:05.237446 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:05.237414    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:21:05.338669 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:05.338630    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:21:10.531489 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:10.531422    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:21:15.682052 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:15.681989    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:21:15.749398 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:15.749364    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:21:21.184962 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:21.184925    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:21:21.263449 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:21.263417    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:21:21.439988 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:21.439906    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl"]
Jul 23 14:21:21.440186 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:21.440159    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl" podUID="64d1df78-c7d7-454a-8c45-b73a71e8c8bc" containerName="istio-proxy" containerID="cri-o://f9a395886aa8820af1b4e2d11f55d23efc90b1fd7e8f3a89f9941aa4c562e014" gracePeriod=30
Jul 23 14:21:21.464298 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:21.464266    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:21:21.721619 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:21.721530    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:21:22.381419 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:22.381388    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:21:22.481467 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:22.481433    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:21:25.218109 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:25.218072    2573 patch_prober.go:28] interesting pod/e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 23 14:21:25.218535 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:25.218146    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl" podUID="64d1df78-c7d7-454a-8c45-b73a71e8c8bc" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 23 14:21:26.691986 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:26.691959    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl"
Jul 23 14:21:26.787891 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:26.787863    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64d1df78-c7d7-454a-8c45-b73a71e8c8bc-istio-token\") pod \"64d1df78-c7d7-454a-8c45-b73a71e8c8bc\" (UID: \"64d1df78-c7d7-454a-8c45-b73a71e8c8bc\") "
Jul 23 14:21:26.788088 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:26.787923    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64d1df78-c7d7-454a-8c45-b73a71e8c8bc-workload-certs\") pod \"64d1df78-c7d7-454a-8c45-b73a71e8c8bc\" (UID: \"64d1df78-c7d7-454a-8c45-b73a71e8c8bc\") "
Jul 23 14:21:26.788088 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:26.787947    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64d1df78-c7d7-454a-8c45-b73a71e8c8bc-istiod-ca-cert\") pod \"64d1df78-c7d7-454a-8c45-b73a71e8c8bc\" (UID: \"64d1df78-c7d7-454a-8c45-b73a71e8c8bc\") "
Jul 23 14:21:26.788088 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:26.787962    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64d1df78-c7d7-454a-8c45-b73a71e8c8bc-workload-socket\") pod \"64d1df78-c7d7-454a-8c45-b73a71e8c8bc\" (UID: \"64d1df78-c7d7-454a-8c45-b73a71e8c8bc\") "
Jul 23 14:21:26.788088 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:26.787987    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64d1df78-c7d7-454a-8c45-b73a71e8c8bc-istio-podinfo\") pod \"64d1df78-c7d7-454a-8c45-b73a71e8c8bc\" (UID: \"64d1df78-c7d7-454a-8c45-b73a71e8c8bc\") "
Jul 23 14:21:26.788088 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:26.788053    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qhnxr\" (UniqueName: \"kubernetes.io/projected/64d1df78-c7d7-454a-8c45-b73a71e8c8bc-kube-api-access-qhnxr\") pod \"64d1df78-c7d7-454a-8c45-b73a71e8c8bc\" (UID: \"64d1df78-c7d7-454a-8c45-b73a71e8c8bc\") "
Jul 23 14:21:26.788088 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:26.788080    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64d1df78-c7d7-454a-8c45-b73a71e8c8bc-credential-socket\") pod \"64d1df78-c7d7-454a-8c45-b73a71e8c8bc\" (UID: \"64d1df78-c7d7-454a-8c45-b73a71e8c8bc\") "
Jul 23 14:21:26.788428 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:26.788136    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64d1df78-c7d7-454a-8c45-b73a71e8c8bc-istio-data\") pod \"64d1df78-c7d7-454a-8c45-b73a71e8c8bc\" (UID: \"64d1df78-c7d7-454a-8c45-b73a71e8c8bc\") "
Jul 23 14:21:26.788428 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:26.788161    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64d1df78-c7d7-454a-8c45-b73a71e8c8bc-istio-envoy\") pod \"64d1df78-c7d7-454a-8c45-b73a71e8c8bc\" (UID: \"64d1df78-c7d7-454a-8c45-b73a71e8c8bc\") "
Jul 23 14:21:26.788428 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:26.788367    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64d1df78-c7d7-454a-8c45-b73a71e8c8bc-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "64d1df78-c7d7-454a-8c45-b73a71e8c8bc" (UID: "64d1df78-c7d7-454a-8c45-b73a71e8c8bc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 14:21:26.788428 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:26.788377    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64d1df78-c7d7-454a-8c45-b73a71e8c8bc-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "64d1df78-c7d7-454a-8c45-b73a71e8c8bc" (UID: "64d1df78-c7d7-454a-8c45-b73a71e8c8bc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 14:21:26.788428 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:26.788396    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64d1df78-c7d7-454a-8c45-b73a71e8c8bc-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "64d1df78-c7d7-454a-8c45-b73a71e8c8bc" (UID: "64d1df78-c7d7-454a-8c45-b73a71e8c8bc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 14:21:26.788700 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:26.788526    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64d1df78-c7d7-454a-8c45-b73a71e8c8bc-workload-certs\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:21:26.788700 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:26.788544    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64d1df78-c7d7-454a-8c45-b73a71e8c8bc-istiod-ca-cert\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:21:26.788700 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:26.788556    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64d1df78-c7d7-454a-8c45-b73a71e8c8bc-workload-socket\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:21:26.788700 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:26.788571    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64d1df78-c7d7-454a-8c45-b73a71e8c8bc-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "64d1df78-c7d7-454a-8c45-b73a71e8c8bc" (UID: "64d1df78-c7d7-454a-8c45-b73a71e8c8bc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 14:21:26.789345 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:26.789317    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64d1df78-c7d7-454a-8c45-b73a71e8c8bc-istio-data" (OuterVolumeSpecName: "istio-data") pod "64d1df78-c7d7-454a-8c45-b73a71e8c8bc" (UID: "64d1df78-c7d7-454a-8c45-b73a71e8c8bc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 14:21:26.790291 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:26.790269    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64d1df78-c7d7-454a-8c45-b73a71e8c8bc-istio-token" (OuterVolumeSpecName: "istio-token") pod "64d1df78-c7d7-454a-8c45-b73a71e8c8bc" (UID: "64d1df78-c7d7-454a-8c45-b73a71e8c8bc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 14:21:26.790378 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:26.790332    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/64d1df78-c7d7-454a-8c45-b73a71e8c8bc-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "64d1df78-c7d7-454a-8c45-b73a71e8c8bc" (UID: "64d1df78-c7d7-454a-8c45-b73a71e8c8bc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 14:21:26.790378 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:26.790340    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64d1df78-c7d7-454a-8c45-b73a71e8c8bc-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "64d1df78-c7d7-454a-8c45-b73a71e8c8bc" (UID: "64d1df78-c7d7-454a-8c45-b73a71e8c8bc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 14:21:26.790451 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:26.790377    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64d1df78-c7d7-454a-8c45-b73a71e8c8bc-kube-api-access-qhnxr" (OuterVolumeSpecName: "kube-api-access-qhnxr") pod "64d1df78-c7d7-454a-8c45-b73a71e8c8bc" (UID: "64d1df78-c7d7-454a-8c45-b73a71e8c8bc"). InnerVolumeSpecName "kube-api-access-qhnxr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 14:21:26.889350 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:26.889308    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qhnxr\" (UniqueName: \"kubernetes.io/projected/64d1df78-c7d7-454a-8c45-b73a71e8c8bc-kube-api-access-qhnxr\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:21:26.889350 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:26.889342    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64d1df78-c7d7-454a-8c45-b73a71e8c8bc-credential-socket\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:21:26.889350 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:26.889353    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64d1df78-c7d7-454a-8c45-b73a71e8c8bc-istio-data\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:21:26.889594 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:26.889363    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64d1df78-c7d7-454a-8c45-b73a71e8c8bc-istio-envoy\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:21:26.889594 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:26.889371    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64d1df78-c7d7-454a-8c45-b73a71e8c8bc-istio-token\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:21:26.889594 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:26.889379    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64d1df78-c7d7-454a-8c45-b73a71e8c8bc-istio-podinfo\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:21:27.179150 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:27.179114    2573 generic.go:356] "Generic (PLEG): container finished" podID="64d1df78-c7d7-454a-8c45-b73a71e8c8bc" containerID="f9a395886aa8820af1b4e2d11f55d23efc90b1fd7e8f3a89f9941aa4c562e014" exitCode=0
Jul 23 14:21:27.179322 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:27.179163    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl"
Jul 23 14:21:27.179322 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:27.179197    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl" event={"ID":"64d1df78-c7d7-454a-8c45-b73a71e8c8bc","Type":"ContainerDied","Data":"f9a395886aa8820af1b4e2d11f55d23efc90b1fd7e8f3a89f9941aa4c562e014"}
Jul 23 14:21:27.179322 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:27.179251    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl" event={"ID":"64d1df78-c7d7-454a-8c45-b73a71e8c8bc","Type":"ContainerDied","Data":"f9d51f4df6dacb9eccdffdd131bff7a1a4e7245b1e10b91e9753eecc679f535b"}
Jul 23 14:21:27.179322 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:27.179275    2573 scope.go:117] "RemoveContainer" containerID="f9a395886aa8820af1b4e2d11f55d23efc90b1fd7e8f3a89f9941aa4c562e014"
Jul 23 14:21:27.188974 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:27.188957    2573 scope.go:117] "RemoveContainer" containerID="86faeddd59ebc3c06be24c682dab8b37cc7ff836518b19c6c9ee98a0f92cd8a8"
Jul 23 14:21:27.198202 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:27.198176    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl"]
Jul 23 14:21:27.198629 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:27.198612    2573 scope.go:117] "RemoveContainer" containerID="f9a395886aa8820af1b4e2d11f55d23efc90b1fd7e8f3a89f9941aa4c562e014"
Jul 23 14:21:27.198971 ip-10-0-140-103 kubenswrapper[2573]: E0723 14:21:27.198930    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9a395886aa8820af1b4e2d11f55d23efc90b1fd7e8f3a89f9941aa4c562e014\": container with ID starting with f9a395886aa8820af1b4e2d11f55d23efc90b1fd7e8f3a89f9941aa4c562e014 not found: ID does not exist" containerID="f9a395886aa8820af1b4e2d11f55d23efc90b1fd7e8f3a89f9941aa4c562e014"
Jul 23 14:21:27.198971 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:27.198961    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9a395886aa8820af1b4e2d11f55d23efc90b1fd7e8f3a89f9941aa4c562e014"} err="failed to get container status \"f9a395886aa8820af1b4e2d11f55d23efc90b1fd7e8f3a89f9941aa4c562e014\": rpc error: code = NotFound desc = could not find container \"f9a395886aa8820af1b4e2d11f55d23efc90b1fd7e8f3a89f9941aa4c562e014\": container with ID starting with f9a395886aa8820af1b4e2d11f55d23efc90b1fd7e8f3a89f9941aa4c562e014 not found: ID does not exist"
Jul 23 14:21:27.199262 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:27.198977    2573 scope.go:117] "RemoveContainer" containerID="86faeddd59ebc3c06be24c682dab8b37cc7ff836518b19c6c9ee98a0f92cd8a8"
Jul 23 14:21:27.199693 ip-10-0-140-103 kubenswrapper[2573]: E0723 14:21:27.199665    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86faeddd59ebc3c06be24c682dab8b37cc7ff836518b19c6c9ee98a0f92cd8a8\": container with ID starting with 86faeddd59ebc3c06be24c682dab8b37cc7ff836518b19c6c9ee98a0f92cd8a8 not found: ID does not exist" containerID="86faeddd59ebc3c06be24c682dab8b37cc7ff836518b19c6c9ee98a0f92cd8a8"
Jul 23 14:21:27.199775 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:27.199700    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86faeddd59ebc3c06be24c682dab8b37cc7ff836518b19c6c9ee98a0f92cd8a8"} err="failed to get container status \"86faeddd59ebc3c06be24c682dab8b37cc7ff836518b19c6c9ee98a0f92cd8a8\": rpc error: code = NotFound desc = could not find container \"86faeddd59ebc3c06be24c682dab8b37cc7ff836518b19c6c9ee98a0f92cd8a8\": container with ID starting with 86faeddd59ebc3c06be24c682dab8b37cc7ff836518b19c6c9ee98a0f92cd8a8 not found: ID does not exist"
Jul 23 14:21:27.202470 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:27.202446    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-e8799a-openshift-default-5fd8d49b9c-dw8dl"]
Jul 23 14:21:29.068631 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:29.068597    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64d1df78-c7d7-454a-8c45-b73a71e8c8bc" path="/var/lib/kubelet/pods/64d1df78-c7d7-454a-8c45-b73a71e8c8bc/volumes"
Jul 23 14:21:29.606372 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:29.606337    2573 scope.go:117] "RemoveContainer" containerID="568fed2bf5090838690ade96d3996ae235ca0b33531c7d9d28a40ba7c3f0fd30"
Jul 23 14:21:37.401644 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:37.401605    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:21:41.940035 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:41.939978    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:21:42.333591 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:42.333551    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:21:48.322048 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:48.321983    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:21:48.424887 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:48.424853    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:21:48.574917 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:48.574835    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-636249-openshift-default-9bd85997-rlswr"]
Jul 23 14:21:48.575096 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:48.575066    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-636249-openshift-default-9bd85997-rlswr" podUID="433b882b-7f32-4b90-95a6-d48af7c2c7fa" containerName="istio-proxy" containerID="cri-o://e4b4bd44c2c4ec28cafc18353976f7a86a30141454ed79627bd4e4528c307f12" gracePeriod=30
Jul 23 14:21:48.688219 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:48.688189    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:21:48.853311 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:48.853199    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:21:49.251526 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:49.251399    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:21:49.555608 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:49.555568    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8"]
Jul 23 14:21:49.556569 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:49.556309    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64d1df78-c7d7-454a-8c45-b73a71e8c8bc" containerName="istio-proxy"
Jul 23 14:21:49.556569 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:49.556331    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="64d1df78-c7d7-454a-8c45-b73a71e8c8bc" containerName="istio-proxy"
Jul 23 14:21:49.556569 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:49.556363    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64d1df78-c7d7-454a-8c45-b73a71e8c8bc" containerName="istio-proxy"
Jul 23 14:21:49.556569 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:49.556372    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="64d1df78-c7d7-454a-8c45-b73a71e8c8bc" containerName="istio-proxy"
Jul 23 14:21:49.556569 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:49.556478    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="64d1df78-c7d7-454a-8c45-b73a71e8c8bc" containerName="istio-proxy"
Jul 23 14:21:49.556569 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:49.556494    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="e384f45b-51aa-44cf-ae96-77cb11e89a28" containerName="istio-proxy"
Jul 23 14:21:49.560673 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:49.560646    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8"
Jul 23 14:21:49.560875 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:49.560850    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8"]
Jul 23 14:21:49.563251 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:49.563227    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-42e993-openshift-default-dockercfg-6vrm9\""
Jul 23 14:21:49.567268 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:49.567247    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:21:49.612589 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:49.612547    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8572b121-8904-4de7-928f-418a70aca39a-istio-token\") pod \"e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8\" (UID: \"8572b121-8904-4de7-928f-418a70aca39a\") " pod="openshift-ingress/e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8"
Jul 23 14:21:49.612788 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:49.612609    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8572b121-8904-4de7-928f-418a70aca39a-istiod-ca-cert\") pod \"e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8\" (UID: \"8572b121-8904-4de7-928f-418a70aca39a\") " pod="openshift-ingress/e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8"
Jul 23 14:21:49.612788 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:49.612664    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8572b121-8904-4de7-928f-418a70aca39a-istio-envoy\") pod \"e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8\" (UID: \"8572b121-8904-4de7-928f-418a70aca39a\") " pod="openshift-ingress/e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8"
Jul 23 14:21:49.612788 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:49.612705    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8572b121-8904-4de7-928f-418a70aca39a-credential-socket\") pod \"e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8\" (UID: \"8572b121-8904-4de7-928f-418a70aca39a\") " pod="openshift-ingress/e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8"
Jul 23 14:21:49.612788 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:49.612735    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8572b121-8904-4de7-928f-418a70aca39a-workload-socket\") pod \"e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8\" (UID: \"8572b121-8904-4de7-928f-418a70aca39a\") " pod="openshift-ingress/e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8"
Jul 23 14:21:49.612788 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:49.612765    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8572b121-8904-4de7-928f-418a70aca39a-workload-certs\") pod \"e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8\" (UID: \"8572b121-8904-4de7-928f-418a70aca39a\") " pod="openshift-ingress/e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8"
Jul 23 14:21:49.612983 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:49.612819    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8572b121-8904-4de7-928f-418a70aca39a-istio-data\") pod \"e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8\" (UID: \"8572b121-8904-4de7-928f-418a70aca39a\") " pod="openshift-ingress/e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8"
Jul 23 14:21:49.612983 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:49.612863    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxk8p\" (UniqueName: \"kubernetes.io/projected/8572b121-8904-4de7-928f-418a70aca39a-kube-api-access-pxk8p\") pod \"e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8\" (UID: \"8572b121-8904-4de7-928f-418a70aca39a\") " pod="openshift-ingress/e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8"
Jul 23 14:21:49.612983 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:49.612912    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8572b121-8904-4de7-928f-418a70aca39a-istio-podinfo\") pod \"e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8\" (UID: \"8572b121-8904-4de7-928f-418a70aca39a\") " pod="openshift-ingress/e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8"
Jul 23 14:21:49.702395 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:49.702346    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:21:49.713632 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:49.713604    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8572b121-8904-4de7-928f-418a70aca39a-istiod-ca-cert\") pod \"e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8\" (UID: \"8572b121-8904-4de7-928f-418a70aca39a\") " pod="openshift-ingress/e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8"
Jul 23 14:21:49.713794 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:49.713644    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8572b121-8904-4de7-928f-418a70aca39a-istio-envoy\") pod \"e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8\" (UID: \"8572b121-8904-4de7-928f-418a70aca39a\") " pod="openshift-ingress/e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8"
Jul 23 14:21:49.713794 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:49.713671    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8572b121-8904-4de7-928f-418a70aca39a-credential-socket\") pod \"e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8\" (UID: \"8572b121-8904-4de7-928f-418a70aca39a\") " pod="openshift-ingress/e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8"
Jul 23 14:21:49.713794 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:49.713688    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8572b121-8904-4de7-928f-418a70aca39a-workload-socket\") pod \"e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8\" (UID: \"8572b121-8904-4de7-928f-418a70aca39a\") " pod="openshift-ingress/e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8"
Jul 23 14:21:49.713953 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:49.713860    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8572b121-8904-4de7-928f-418a70aca39a-workload-certs\") pod \"e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8\" (UID: \"8572b121-8904-4de7-928f-418a70aca39a\") " pod="openshift-ingress/e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8"
Jul 23 14:21:49.713953 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:49.713936    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8572b121-8904-4de7-928f-418a70aca39a-istio-data\") pod \"e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8\" (UID: \"8572b121-8904-4de7-928f-418a70aca39a\") " pod="openshift-ingress/e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8"
Jul 23 14:21:49.714086 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:49.713968    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxk8p\" (UniqueName: \"kubernetes.io/projected/8572b121-8904-4de7-928f-418a70aca39a-kube-api-access-pxk8p\") pod \"e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8\" (UID: \"8572b121-8904-4de7-928f-418a70aca39a\") " pod="openshift-ingress/e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8"
Jul 23 14:21:49.714142 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:49.714081    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8572b121-8904-4de7-928f-418a70aca39a-credential-socket\") pod \"e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8\" (UID: \"8572b121-8904-4de7-928f-418a70aca39a\") " pod="openshift-ingress/e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8"
Jul 23 14:21:49.714204 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:49.714154    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8572b121-8904-4de7-928f-418a70aca39a-workload-socket\") pod \"e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8\" (UID: \"8572b121-8904-4de7-928f-418a70aca39a\") " pod="openshift-ingress/e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8"
Jul 23 14:21:49.714204 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:49.714165    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8572b121-8904-4de7-928f-418a70aca39a-istio-podinfo\") pod \"e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8\" (UID: \"8572b121-8904-4de7-928f-418a70aca39a\") " pod="openshift-ingress/e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8"
Jul 23 14:21:49.714308 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:49.714237    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8572b121-8904-4de7-928f-418a70aca39a-istio-token\") pod \"e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8\" (UID: \"8572b121-8904-4de7-928f-418a70aca39a\") " pod="openshift-ingress/e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8"
Jul 23 14:21:49.714374 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:49.714355    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8572b121-8904-4de7-928f-418a70aca39a-istio-data\") pod \"e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8\" (UID: \"8572b121-8904-4de7-928f-418a70aca39a\") " pod="openshift-ingress/e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8"
Jul 23 14:21:49.714463 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:49.714442    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8572b121-8904-4de7-928f-418a70aca39a-workload-certs\") pod \"e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8\" (UID: \"8572b121-8904-4de7-928f-418a70aca39a\") " pod="openshift-ingress/e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8"
Jul 23 14:21:49.715064 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:49.714444    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8572b121-8904-4de7-928f-418a70aca39a-istiod-ca-cert\") pod \"e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8\" (UID: \"8572b121-8904-4de7-928f-418a70aca39a\") " pod="openshift-ingress/e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8"
Jul 23 14:21:49.716222 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:49.716198    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8572b121-8904-4de7-928f-418a70aca39a-istio-envoy\") pod \"e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8\" (UID: \"8572b121-8904-4de7-928f-418a70aca39a\") " pod="openshift-ingress/e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8"
Jul 23 14:21:49.716535 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:49.716517    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8572b121-8904-4de7-928f-418a70aca39a-istio-podinfo\") pod \"e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8\" (UID: \"8572b121-8904-4de7-928f-418a70aca39a\") " pod="openshift-ingress/e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8"
Jul 23 14:21:49.722460 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:49.722430    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8572b121-8904-4de7-928f-418a70aca39a-istio-token\") pod \"e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8\" (UID: \"8572b121-8904-4de7-928f-418a70aca39a\") " pod="openshift-ingress/e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8"
Jul 23 14:21:49.722581 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:49.722563    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxk8p\" (UniqueName: \"kubernetes.io/projected/8572b121-8904-4de7-928f-418a70aca39a-kube-api-access-pxk8p\") pod \"e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8\" (UID: \"8572b121-8904-4de7-928f-418a70aca39a\") " pod="openshift-ingress/e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8"
Jul 23 14:21:49.872738 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:49.872648    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8"
Jul 23 14:21:50.020577 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:50.020548    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8"]
Jul 23 14:21:50.021607 ip-10-0-140-103 kubenswrapper[2573]: W0723 14:21:50.021579    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8572b121_8904_4de7_928f_418a70aca39a.slice/crio-3e9d4c45737ea40c57ded4350b6ca51c3e0980687c7da3c12e5ecbe2884a4801 WatchSource:0}: Error finding container 3e9d4c45737ea40c57ded4350b6ca51c3e0980687c7da3c12e5ecbe2884a4801: Status 404 returned error can't find the container with id 3e9d4c45737ea40c57ded4350b6ca51c3e0980687c7da3c12e5ecbe2884a4801
Jul 23 14:21:50.023750 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:50.023717    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 14:21:50.023857 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:50.023779    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 14:21:50.023857 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:50.023808    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 14:21:50.314243 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:50.314205    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8" event={"ID":"8572b121-8904-4de7-928f-418a70aca39a","Type":"ContainerStarted","Data":"3478c337ae91162140ed6dea9036b9c2de303f67f53b66d64b452adfc1a03ee0"}
Jul 23 14:21:50.314435 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:50.314269    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8" event={"ID":"8572b121-8904-4de7-928f-418a70aca39a","Type":"ContainerStarted","Data":"3e9d4c45737ea40c57ded4350b6ca51c3e0980687c7da3c12e5ecbe2884a4801"}
Jul 23 14:21:50.341100 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:50.341048    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8" podStartSLOduration=1.3410313170000001 podStartE2EDuration="1.341031317s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 14:21:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 14:21:50.337432676 +0000 UTC m=+2481.776933591" watchObservedRunningTime="2026-07-23 14:21:50.341031317 +0000 UTC m=+2481.780532235"
Jul 23 14:21:50.873556 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:50.873519    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8"
Jul 23 14:21:51.878943 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:51.878912    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8"
Jul 23 14:21:52.309829 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:52.309794    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:21:52.326070 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:52.326040    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8"
Jul 23 14:21:52.327203 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:52.327180    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8"
Jul 23 14:21:52.459837 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:52.459805    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:21:52.556588 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:52.556539    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:21:52.964937 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:52.964898    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:21:53.065671 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:53.065637    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:21:53.576746 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:53.576712    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:21:53.835512 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:53.835451    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-636249-openshift-default-9bd85997-rlswr"
Jul 23 14:21:53.852242 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:53.852215    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/433b882b-7f32-4b90-95a6-d48af7c2c7fa-credential-socket\") pod \"433b882b-7f32-4b90-95a6-d48af7c2c7fa\" (UID: \"433b882b-7f32-4b90-95a6-d48af7c2c7fa\") "
Jul 23 14:21:53.852371 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:53.852267    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/433b882b-7f32-4b90-95a6-d48af7c2c7fa-istiod-ca-cert\") pod \"433b882b-7f32-4b90-95a6-d48af7c2c7fa\" (UID: \"433b882b-7f32-4b90-95a6-d48af7c2c7fa\") "
Jul 23 14:21:53.852371 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:53.852301    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/433b882b-7f32-4b90-95a6-d48af7c2c7fa-workload-certs\") pod \"433b882b-7f32-4b90-95a6-d48af7c2c7fa\" (UID: \"433b882b-7f32-4b90-95a6-d48af7c2c7fa\") "
Jul 23 14:21:53.852371 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:53.852329    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/433b882b-7f32-4b90-95a6-d48af7c2c7fa-istio-envoy\") pod \"433b882b-7f32-4b90-95a6-d48af7c2c7fa\" (UID: \"433b882b-7f32-4b90-95a6-d48af7c2c7fa\") "
Jul 23 14:21:53.852539 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:53.852380    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/433b882b-7f32-4b90-95a6-d48af7c2c7fa-istio-data\") pod \"433b882b-7f32-4b90-95a6-d48af7c2c7fa\" (UID: \"433b882b-7f32-4b90-95a6-d48af7c2c7fa\") "
Jul 23 14:21:53.852539 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:53.852408    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/433b882b-7f32-4b90-95a6-d48af7c2c7fa-istio-podinfo\") pod \"433b882b-7f32-4b90-95a6-d48af7c2c7fa\" (UID: \"433b882b-7f32-4b90-95a6-d48af7c2c7fa\") "
Jul 23 14:21:53.852539 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:53.852434    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bsc5s\" (UniqueName: \"kubernetes.io/projected/433b882b-7f32-4b90-95a6-d48af7c2c7fa-kube-api-access-bsc5s\") pod \"433b882b-7f32-4b90-95a6-d48af7c2c7fa\" (UID: \"433b882b-7f32-4b90-95a6-d48af7c2c7fa\") "
Jul 23 14:21:53.852539 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:53.852489    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/433b882b-7f32-4b90-95a6-d48af7c2c7fa-workload-socket\") pod \"433b882b-7f32-4b90-95a6-d48af7c2c7fa\" (UID: \"433b882b-7f32-4b90-95a6-d48af7c2c7fa\") "
Jul 23 14:21:53.852539 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:53.852524    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/433b882b-7f32-4b90-95a6-d48af7c2c7fa-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "433b882b-7f32-4b90-95a6-d48af7c2c7fa" (UID: "433b882b-7f32-4b90-95a6-d48af7c2c7fa"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 14:21:53.852769 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:53.852537    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/433b882b-7f32-4b90-95a6-d48af7c2c7fa-istio-token\") pod \"433b882b-7f32-4b90-95a6-d48af7c2c7fa\" (UID: \"433b882b-7f32-4b90-95a6-d48af7c2c7fa\") "
Jul 23 14:21:53.852769 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:53.852653    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/433b882b-7f32-4b90-95a6-d48af7c2c7fa-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "433b882b-7f32-4b90-95a6-d48af7c2c7fa" (UID: "433b882b-7f32-4b90-95a6-d48af7c2c7fa"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 14:21:53.852868 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:53.852843    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/433b882b-7f32-4b90-95a6-d48af7c2c7fa-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "433b882b-7f32-4b90-95a6-d48af7c2c7fa" (UID: "433b882b-7f32-4b90-95a6-d48af7c2c7fa"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 14:21:53.853063 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:53.852975    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/433b882b-7f32-4b90-95a6-d48af7c2c7fa-credential-socket\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:21:53.853063 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:53.852999    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/433b882b-7f32-4b90-95a6-d48af7c2c7fa-workload-certs\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:21:53.853063 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:53.853032    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/433b882b-7f32-4b90-95a6-d48af7c2c7fa-workload-socket\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:21:53.853063 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:53.853029    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/433b882b-7f32-4b90-95a6-d48af7c2c7fa-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "433b882b-7f32-4b90-95a6-d48af7c2c7fa" (UID: "433b882b-7f32-4b90-95a6-d48af7c2c7fa"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 14:21:53.853315 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:53.853233    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/433b882b-7f32-4b90-95a6-d48af7c2c7fa-istio-data" (OuterVolumeSpecName: "istio-data") pod "433b882b-7f32-4b90-95a6-d48af7c2c7fa" (UID: "433b882b-7f32-4b90-95a6-d48af7c2c7fa"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 14:21:53.854757 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:53.854732    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/433b882b-7f32-4b90-95a6-d48af7c2c7fa-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "433b882b-7f32-4b90-95a6-d48af7c2c7fa" (UID: "433b882b-7f32-4b90-95a6-d48af7c2c7fa"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 14:21:53.854845 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:53.854825    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/433b882b-7f32-4b90-95a6-d48af7c2c7fa-kube-api-access-bsc5s" (OuterVolumeSpecName: "kube-api-access-bsc5s") pod "433b882b-7f32-4b90-95a6-d48af7c2c7fa" (UID: "433b882b-7f32-4b90-95a6-d48af7c2c7fa"). InnerVolumeSpecName "kube-api-access-bsc5s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 14:21:53.854999 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:53.854984    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/433b882b-7f32-4b90-95a6-d48af7c2c7fa-istio-token" (OuterVolumeSpecName: "istio-token") pod "433b882b-7f32-4b90-95a6-d48af7c2c7fa" (UID: "433b882b-7f32-4b90-95a6-d48af7c2c7fa"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 14:21:53.855151 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:53.855040    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/433b882b-7f32-4b90-95a6-d48af7c2c7fa-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "433b882b-7f32-4b90-95a6-d48af7c2c7fa" (UID: "433b882b-7f32-4b90-95a6-d48af7c2c7fa"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 14:21:53.954433 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:53.954399    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/433b882b-7f32-4b90-95a6-d48af7c2c7fa-istio-data\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:21:53.954433 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:53.954429    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/433b882b-7f32-4b90-95a6-d48af7c2c7fa-istio-podinfo\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:21:53.954433 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:53.954440    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bsc5s\" (UniqueName: \"kubernetes.io/projected/433b882b-7f32-4b90-95a6-d48af7c2c7fa-kube-api-access-bsc5s\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:21:53.954680 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:53.954448    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/433b882b-7f32-4b90-95a6-d48af7c2c7fa-istio-token\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:21:53.954680 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:53.954458    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/433b882b-7f32-4b90-95a6-d48af7c2c7fa-istiod-ca-cert\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:21:53.954680 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:53.954466    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/433b882b-7f32-4b90-95a6-d48af7c2c7fa-istio-envoy\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:21:54.339663 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:54.339623    2573 generic.go:356] "Generic (PLEG): container finished" podID="433b882b-7f32-4b90-95a6-d48af7c2c7fa" containerID="e4b4bd44c2c4ec28cafc18353976f7a86a30141454ed79627bd4e4528c307f12" exitCode=0
Jul 23 14:21:54.340174 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:54.339697    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-636249-openshift-default-9bd85997-rlswr"
Jul 23 14:21:54.340174 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:54.339710    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-636249-openshift-default-9bd85997-rlswr" event={"ID":"433b882b-7f32-4b90-95a6-d48af7c2c7fa","Type":"ContainerDied","Data":"e4b4bd44c2c4ec28cafc18353976f7a86a30141454ed79627bd4e4528c307f12"}
Jul 23 14:21:54.340174 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:54.339795    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-636249-openshift-default-9bd85997-rlswr" event={"ID":"433b882b-7f32-4b90-95a6-d48af7c2c7fa","Type":"ContainerDied","Data":"6f52350303eac75ffb821bea6f73cb885114bd961ab1d4484ed449463f58b645"}
Jul 23 14:21:54.340174 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:54.339818    2573 scope.go:117] "RemoveContainer" containerID="e4b4bd44c2c4ec28cafc18353976f7a86a30141454ed79627bd4e4528c307f12"
Jul 23 14:21:54.350471 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:54.350451    2573 scope.go:117] "RemoveContainer" containerID="2b4676f7d6837ac006b036b808908047038b0710a8fb89182ca4beaa4f697e28"
Jul 23 14:21:54.359635 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:54.359617    2573 scope.go:117] "RemoveContainer" containerID="e4b4bd44c2c4ec28cafc18353976f7a86a30141454ed79627bd4e4528c307f12"
Jul 23 14:21:54.359913 ip-10-0-140-103 kubenswrapper[2573]: E0723 14:21:54.359893    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4b4bd44c2c4ec28cafc18353976f7a86a30141454ed79627bd4e4528c307f12\": container with ID starting with e4b4bd44c2c4ec28cafc18353976f7a86a30141454ed79627bd4e4528c307f12 not found: ID does not exist" containerID="e4b4bd44c2c4ec28cafc18353976f7a86a30141454ed79627bd4e4528c307f12"
Jul 23 14:21:54.359968 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:54.359921    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4b4bd44c2c4ec28cafc18353976f7a86a30141454ed79627bd4e4528c307f12"} err="failed to get container status \"e4b4bd44c2c4ec28cafc18353976f7a86a30141454ed79627bd4e4528c307f12\": rpc error: code = NotFound desc = could not find container \"e4b4bd44c2c4ec28cafc18353976f7a86a30141454ed79627bd4e4528c307f12\": container with ID starting with e4b4bd44c2c4ec28cafc18353976f7a86a30141454ed79627bd4e4528c307f12 not found: ID does not exist"
Jul 23 14:21:54.359968 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:54.359938    2573 scope.go:117] "RemoveContainer" containerID="2b4676f7d6837ac006b036b808908047038b0710a8fb89182ca4beaa4f697e28"
Jul 23 14:21:54.360202 ip-10-0-140-103 kubenswrapper[2573]: E0723 14:21:54.360187    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b4676f7d6837ac006b036b808908047038b0710a8fb89182ca4beaa4f697e28\": container with ID starting with 2b4676f7d6837ac006b036b808908047038b0710a8fb89182ca4beaa4f697e28 not found: ID does not exist" containerID="2b4676f7d6837ac006b036b808908047038b0710a8fb89182ca4beaa4f697e28"
Jul 23 14:21:54.360244 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:54.360204    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b4676f7d6837ac006b036b808908047038b0710a8fb89182ca4beaa4f697e28"} err="failed to get container status \"2b4676f7d6837ac006b036b808908047038b0710a8fb89182ca4beaa4f697e28\": rpc error: code = NotFound desc = could not find container \"2b4676f7d6837ac006b036b808908047038b0710a8fb89182ca4beaa4f697e28\": container with ID starting with 2b4676f7d6837ac006b036b808908047038b0710a8fb89182ca4beaa4f697e28 not found: ID does not exist"
Jul 23 14:21:54.364354 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:54.364330    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-636249-openshift-default-9bd85997-rlswr"]
Jul 23 14:21:54.367443 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:54.367424    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-636249-openshift-default-9bd85997-rlswr"]
Jul 23 14:21:55.068685 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:55.068647    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="433b882b-7f32-4b90-95a6-d48af7c2c7fa" path="/var/lib/kubelet/pods/433b882b-7f32-4b90-95a6-d48af7c2c7fa/volumes"
Jul 23 14:21:56.815241 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:56.815207    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:21:57.183206 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:57.183100    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:21:57.489322 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:57.489247    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst"]
Jul 23 14:21:57.489667 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:57.489655    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="433b882b-7f32-4b90-95a6-d48af7c2c7fa" containerName="istio-proxy"
Jul 23 14:21:57.489721 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:57.489669    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="433b882b-7f32-4b90-95a6-d48af7c2c7fa" containerName="istio-proxy"
Jul 23 14:21:57.489721 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:57.489689    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="433b882b-7f32-4b90-95a6-d48af7c2c7fa" containerName="istio-proxy"
Jul 23 14:21:57.489721 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:57.489695    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="433b882b-7f32-4b90-95a6-d48af7c2c7fa" containerName="istio-proxy"
Jul 23 14:21:57.489822 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:57.489765    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="433b882b-7f32-4b90-95a6-d48af7c2c7fa" containerName="istio-proxy"
Jul 23 14:21:57.489822 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:57.489774    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="433b882b-7f32-4b90-95a6-d48af7c2c7fa" containerName="istio-proxy"
Jul 23 14:21:57.489822 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:57.489782    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="64d1df78-c7d7-454a-8c45-b73a71e8c8bc" containerName="istio-proxy"
Jul 23 14:21:57.494148 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:57.494130    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst"
Jul 23 14:21:57.496570 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:57.496549    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-52507a-openshift-default-dockercfg-zxxvp\""
Jul 23 14:21:57.507807 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:57.507786    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst"]
Jul 23 14:21:57.528538 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:57.528492    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:21:57.588978 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:57.588946    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/660fa37c-953c-4079-87cd-11cce1697317-istiod-ca-cert\") pod \"e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst\" (UID: \"660fa37c-953c-4079-87cd-11cce1697317\") " pod="openshift-ingress/e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst"
Jul 23 14:21:57.589221 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:57.589041    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/660fa37c-953c-4079-87cd-11cce1697317-istio-token\") pod \"e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst\" (UID: \"660fa37c-953c-4079-87cd-11cce1697317\") " pod="openshift-ingress/e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst"
Jul 23 14:21:57.589221 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:57.589122    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/660fa37c-953c-4079-87cd-11cce1697317-istio-data\") pod \"e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst\" (UID: \"660fa37c-953c-4079-87cd-11cce1697317\") " pod="openshift-ingress/e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst"
Jul 23 14:21:57.589221 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:57.589189    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/660fa37c-953c-4079-87cd-11cce1697317-workload-socket\") pod \"e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst\" (UID: \"660fa37c-953c-4079-87cd-11cce1697317\") " pod="openshift-ingress/e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst"
Jul 23 14:21:57.589384 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:57.589225    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/660fa37c-953c-4079-87cd-11cce1697317-credential-socket\") pod \"e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst\" (UID: \"660fa37c-953c-4079-87cd-11cce1697317\") " pod="openshift-ingress/e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst"
Jul 23 14:21:57.589384 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:57.589250    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/660fa37c-953c-4079-87cd-11cce1697317-istio-envoy\") pod \"e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst\" (UID: \"660fa37c-953c-4079-87cd-11cce1697317\") " pod="openshift-ingress/e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst"
Jul 23 14:21:57.589384 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:57.589369    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-np6jd\" (UniqueName: \"kubernetes.io/projected/660fa37c-953c-4079-87cd-11cce1697317-kube-api-access-np6jd\") pod \"e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst\" (UID: \"660fa37c-953c-4079-87cd-11cce1697317\") " pod="openshift-ingress/e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst"
Jul 23 14:21:57.589508 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:57.589413    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/660fa37c-953c-4079-87cd-11cce1697317-istio-podinfo\") pod \"e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst\" (UID: \"660fa37c-953c-4079-87cd-11cce1697317\") " pod="openshift-ingress/e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst"
Jul 23 14:21:57.589508 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:57.589465    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/660fa37c-953c-4079-87cd-11cce1697317-workload-certs\") pod \"e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst\" (UID: \"660fa37c-953c-4079-87cd-11cce1697317\") " pod="openshift-ingress/e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst"
Jul 23 14:21:57.690547 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:57.690512    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/660fa37c-953c-4079-87cd-11cce1697317-workload-socket\") pod \"e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst\" (UID: \"660fa37c-953c-4079-87cd-11cce1697317\") " pod="openshift-ingress/e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst"
Jul 23 14:21:57.690547 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:57.690552    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/660fa37c-953c-4079-87cd-11cce1697317-credential-socket\") pod \"e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst\" (UID: \"660fa37c-953c-4079-87cd-11cce1697317\") " pod="openshift-ingress/e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst"
Jul 23 14:21:57.690825 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:57.690571    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/660fa37c-953c-4079-87cd-11cce1697317-istio-envoy\") pod \"e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst\" (UID: \"660fa37c-953c-4079-87cd-11cce1697317\") " pod="openshift-ingress/e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst"
Jul 23 14:21:57.690825 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:57.690635    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-np6jd\" (UniqueName: \"kubernetes.io/projected/660fa37c-953c-4079-87cd-11cce1697317-kube-api-access-np6jd\") pod \"e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst\" (UID: \"660fa37c-953c-4079-87cd-11cce1697317\") " pod="openshift-ingress/e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst"
Jul 23 14:21:57.690825 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:57.690667    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/660fa37c-953c-4079-87cd-11cce1697317-istio-podinfo\") pod \"e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst\" (UID: \"660fa37c-953c-4079-87cd-11cce1697317\") " pod="openshift-ingress/e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst"
Jul 23 14:21:57.690825 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:57.690697    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/660fa37c-953c-4079-87cd-11cce1697317-workload-certs\") pod \"e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst\" (UID: \"660fa37c-953c-4079-87cd-11cce1697317\") " pod="openshift-ingress/e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst"
Jul 23 14:21:57.690825 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:57.690729    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/660fa37c-953c-4079-87cd-11cce1697317-istiod-ca-cert\") pod \"e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst\" (UID: \"660fa37c-953c-4079-87cd-11cce1697317\") " pod="openshift-ingress/e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst"
Jul 23 14:21:57.690825 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:57.690778    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/660fa37c-953c-4079-87cd-11cce1697317-istio-token\") pod \"e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst\" (UID: \"660fa37c-953c-4079-87cd-11cce1697317\") " pod="openshift-ingress/e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst"
Jul 23 14:21:57.690825 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:57.690813    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/660fa37c-953c-4079-87cd-11cce1697317-istio-data\") pod \"e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst\" (UID: \"660fa37c-953c-4079-87cd-11cce1697317\") " pod="openshift-ingress/e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst"
Jul 23 14:21:57.691205 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:57.691153    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/660fa37c-953c-4079-87cd-11cce1697317-credential-socket\") pod \"e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst\" (UID: \"660fa37c-953c-4079-87cd-11cce1697317\") " pod="openshift-ingress/e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst"
Jul 23 14:21:57.691205 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:57.691172    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/660fa37c-953c-4079-87cd-11cce1697317-workload-certs\") pod \"e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst\" (UID: \"660fa37c-953c-4079-87cd-11cce1697317\") " pod="openshift-ingress/e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst"
Jul 23 14:21:57.691336 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:57.691313    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/660fa37c-953c-4079-87cd-11cce1697317-workload-socket\") pod \"e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst\" (UID: \"660fa37c-953c-4079-87cd-11cce1697317\") " pod="openshift-ingress/e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst"
Jul 23 14:21:57.691441 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:57.691390    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/660fa37c-953c-4079-87cd-11cce1697317-istio-data\") pod \"e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst\" (UID: \"660fa37c-953c-4079-87cd-11cce1697317\") " pod="openshift-ingress/e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst"
Jul 23 14:21:57.691622 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:57.691604    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/660fa37c-953c-4079-87cd-11cce1697317-istiod-ca-cert\") pod \"e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst\" (UID: \"660fa37c-953c-4079-87cd-11cce1697317\") " pod="openshift-ingress/e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst"
Jul 23 14:21:57.693116 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:57.693090    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/660fa37c-953c-4079-87cd-11cce1697317-istio-envoy\") pod \"e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst\" (UID: \"660fa37c-953c-4079-87cd-11cce1697317\") " pod="openshift-ingress/e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst"
Jul 23 14:21:57.693497 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:57.693478    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/660fa37c-953c-4079-87cd-11cce1697317-istio-podinfo\") pod \"e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst\" (UID: \"660fa37c-953c-4079-87cd-11cce1697317\") " pod="openshift-ingress/e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst"
Jul 23 14:21:57.702174 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:57.702146    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/660fa37c-953c-4079-87cd-11cce1697317-istio-token\") pod \"e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst\" (UID: \"660fa37c-953c-4079-87cd-11cce1697317\") " pod="openshift-ingress/e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst"
Jul 23 14:21:57.702441 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:57.702420    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-np6jd\" (UniqueName: \"kubernetes.io/projected/660fa37c-953c-4079-87cd-11cce1697317-kube-api-access-np6jd\") pod \"e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst\" (UID: \"660fa37c-953c-4079-87cd-11cce1697317\") " pod="openshift-ingress/e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst"
Jul 23 14:21:57.804734 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:57.804691    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst"
Jul 23 14:21:57.957461 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:57.957436    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst"]
Jul 23 14:21:57.960291 ip-10-0-140-103 kubenswrapper[2573]: W0723 14:21:57.960262    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod660fa37c_953c_4079_87cd_11cce1697317.slice/crio-6e85fd012557eeb120d63452e5f12d46aa28b9956d9fe31e77f93350e399f192 WatchSource:0}: Error finding container 6e85fd012557eeb120d63452e5f12d46aa28b9956d9fe31e77f93350e399f192: Status 404 returned error can't find the container with id 6e85fd012557eeb120d63452e5f12d46aa28b9956d9fe31e77f93350e399f192
Jul 23 14:21:57.962449 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:57.962418    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 14:21:57.962517 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:57.962483    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 14:21:57.962517 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:57.962512    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 14:21:58.022504 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:58.022478    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:21:58.372890 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:58.372849    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst" event={"ID":"660fa37c-953c-4079-87cd-11cce1697317","Type":"ContainerStarted","Data":"b05715559982ba3d6f8b3d63647b4cf345b3153a8dda56743aaf8633cf9eb11d"}
Jul 23 14:21:58.373087 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:58.372930    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst" event={"ID":"660fa37c-953c-4079-87cd-11cce1697317","Type":"ContainerStarted","Data":"6e85fd012557eeb120d63452e5f12d46aa28b9956d9fe31e77f93350e399f192"}
Jul 23 14:21:58.399428 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:58.399373    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst" podStartSLOduration=1.399356835 podStartE2EDuration="1.399356835s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 14:21:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 14:21:58.396254758 +0000 UTC m=+2489.835755677" watchObservedRunningTime="2026-07-23 14:21:58.399356835 +0000 UTC m=+2489.838857753"
Jul 23 14:21:58.805091 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:58.805053    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst"
Jul 23 14:21:59.810541 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:21:59.810511    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst"
Jul 23 14:22:00.386286 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:22:00.386248    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst"
Jul 23 14:22:00.387246 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:22:00.387221    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst"
Jul 23 14:22:00.395726 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:22:00.395681    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:22:00.680040 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:22:00.679928    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:22:01.066669 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:22:01.066632    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:22:01.236840 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:22:01.236807    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:22:01.330231 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:22:01.330143    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:22:05.044554 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:22:05.044509    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:22:08.368222 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:22:08.368174    2573 patch_prober.go:28] interesting pod/e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 23 14:22:08.368637 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:22:08.368242    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8" podUID="8572b121-8904-4de7-928f-418a70aca39a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 23 14:22:09.450788 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:22:09.450754    2573 generic.go:356] "Generic (PLEG): container finished" podID="8572b121-8904-4de7-928f-418a70aca39a" containerID="3478c337ae91162140ed6dea9036b9c2de303f67f53b66d64b452adfc1a03ee0" exitCode=0
Jul 23 14:22:09.451395 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:22:09.450815    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8" event={"ID":"8572b121-8904-4de7-928f-418a70aca39a","Type":"ContainerDied","Data":"3478c337ae91162140ed6dea9036b9c2de303f67f53b66d64b452adfc1a03ee0"}
Jul 23 14:22:09.451395 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:22:09.451256    2573 scope.go:117] "RemoveContainer" containerID="3478c337ae91162140ed6dea9036b9c2de303f67f53b66d64b452adfc1a03ee0"
Jul 23 14:22:09.452403 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:22:09.452374    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 14:22:09.452500 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:22:09.452480    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 14:22:09.452539 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:22:09.452528    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 14:22:10.457987 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:22:10.457948    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8" event={"ID":"8572b121-8904-4de7-928f-418a70aca39a","Type":"ContainerStarted","Data":"be6f9528c89c0a57b9996e84147fe20c5e8bb316eb7fd9f65fdcc59045715208"}
Jul 23 14:22:10.872892 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:22:10.872850    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8"
Jul 23 14:22:10.873104 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:22:10.873064    2573 patch_prober.go:28] interesting pod/e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Jul 23 14:22:10.873201 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:22:10.873112    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8" podUID="8572b121-8904-4de7-928f-418a70aca39a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Jul 23 14:22:11.873608 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:22:11.873566    2573 patch_prober.go:28] interesting pod/e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Jul 23 14:22:11.874038 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:22:11.873632    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8" podUID="8572b121-8904-4de7-928f-418a70aca39a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Jul 23 14:22:12.873270 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:22:12.873228    2573 patch_prober.go:28] interesting pod/e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Jul 23 14:22:12.873478 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:22:12.873328    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8" podUID="8572b121-8904-4de7-928f-418a70aca39a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Jul 23 14:22:13.789441 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:22:13.789398    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:22:13.873840 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:22:13.873806    2573 patch_prober.go:28] interesting pod/e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Jul 23 14:22:13.874045 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:22:13.873866    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8" podUID="8572b121-8904-4de7-928f-418a70aca39a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Jul 23 14:22:13.891167 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:22:13.891140    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:22:14.873838 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:22:14.873803    2573 patch_prober.go:28] interesting pod/e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Jul 23 14:22:14.874296 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:22:14.873904    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8" podUID="8572b121-8904-4de7-928f-418a70aca39a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Jul 23 14:22:15.455283 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:22:15.454530    2573 patch_prober.go:28] interesting pod/e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": read tcp 10.132.0.2:55712->10.132.0.84:15021: read: connection reset by peer" start-of-body=
Jul 23 14:22:15.455283 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:22:15.454619    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst" podUID="660fa37c-953c-4079-87cd-11cce1697317" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": read tcp 10.132.0.2:55712->10.132.0.84:15021: read: connection reset by peer"
Jul 23 14:22:15.496907 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:22:15.496881    2573 generic.go:356] "Generic (PLEG): container finished" podID="660fa37c-953c-4079-87cd-11cce1697317" containerID="b05715559982ba3d6f8b3d63647b4cf345b3153a8dda56743aaf8633cf9eb11d" exitCode=0
Jul 23 14:22:15.497063 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:22:15.496955    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst" event={"ID":"660fa37c-953c-4079-87cd-11cce1697317","Type":"ContainerDied","Data":"b05715559982ba3d6f8b3d63647b4cf345b3153a8dda56743aaf8633cf9eb11d"}
Jul 23 14:22:15.497440 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:22:15.497423    2573 scope.go:117] "RemoveContainer" containerID="b05715559982ba3d6f8b3d63647b4cf345b3153a8dda56743aaf8633cf9eb11d"
Jul 23 14:22:15.498480 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:22:15.498455    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 14:22:15.498544 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:22:15.498524    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 14:22:15.498584 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:22:15.498557    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 14:22:15.877168 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:22:15.877127    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8"
Jul 23 14:22:15.877656 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:22:15.877534    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8"
Jul 23 14:22:15.878239 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:22:15.878220    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8"
Jul 23 14:22:16.505883 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:22:16.505848    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst" event={"ID":"660fa37c-953c-4079-87cd-11cce1697317","Type":"ContainerStarted","Data":"9c3d96f7d75981134602e29dab0bf17e7e43025aaf66cae4749a05b701f8d04f"}
Jul 23 14:22:16.805411 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:22:16.805378    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst"
Jul 23 14:22:16.805606 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:22:16.805578    2573 patch_prober.go:28] interesting pod/e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Jul 23 14:22:16.805690 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:22:16.805670    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst" podUID="660fa37c-953c-4079-87cd-11cce1697317" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Jul 23 14:22:17.805524 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:22:17.805484    2573 patch_prober.go:28] interesting pod/e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Jul 23 14:22:17.805926 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:22:17.805542    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst" podUID="660fa37c-953c-4079-87cd-11cce1697317" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Jul 23 14:22:18.805937 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:22:18.805902    2573 patch_prober.go:28] interesting pod/e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Jul 23 14:22:18.806331 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:22:18.805964    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst" podUID="660fa37c-953c-4079-87cd-11cce1697317" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Jul 23 14:22:19.805548 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:22:19.805514    2573 patch_prober.go:28] interesting pod/e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Jul 23 14:22:19.805735 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:22:19.805579    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst" podUID="660fa37c-953c-4079-87cd-11cce1697317" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Jul 23 14:22:20.805763 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:22:20.805723    2573 patch_prober.go:28] interesting pod/e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Jul 23 14:22:20.806195 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:22:20.805796    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst" podUID="660fa37c-953c-4079-87cd-11cce1697317" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Jul 23 14:22:21.809288 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:22:21.809257    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst"
Jul 23 14:22:21.809681 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:22:21.809658    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst"
Jul 23 14:22:21.810282 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:22:21.810257    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst"
Jul 23 14:22:23.122432 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:22:23.122404    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:22:23.221824 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:22:23.221768    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:22:29.640538 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:22:29.640502    2573 scope.go:117] "RemoveContainer" containerID="4a126cc02fa357f1f698593bc5a29310551b2df950e7e2bf074a97bb2f66f33a"
Jul 23 14:22:33.434025 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:22:33.433975    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:22:40.659229 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:22:40.659198    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:22:47.211488 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:22:47.211457    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:22:47.311300 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:22:47.311260    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:22:51.524858 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:22:51.524815    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:22:52.272148 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:22:52.272101    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:23:43.668312 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:23:43.668277    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:23:59.219727 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:23:59.219685    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:25:09.989410 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:25:09.989371    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:25:11.423099 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:25:11.423065    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:25:17.530349 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:25:17.530311    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:25:17.597052 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:25:17.597023    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:25:28.817518 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:25:28.817429    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:25:29.283277 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:25:29.283198    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-vh5dp_2d624703-978f-48c2-b02d-9af8fd337236/console-operator/1.log"
Jul 23 14:25:29.292799 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:25:29.292775    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-vh5dp_2d624703-978f-48c2-b02d-9af8fd337236/console-operator/1.log"
Jul 23 14:25:46.838956 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:25:46.838920    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:26:01.883546 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:26:01.883511    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:26:01.985336 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:26:01.985306    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:26:13.449957 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:26:13.449920    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:26:28.826213 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:26:28.826179    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:26:29.702184 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:26:29.702143    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:26:38.045084 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:26:38.045045    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:26:45.294529 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:26:45.294485    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:26:45.396286 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:26:45.396250    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:27:02.645518 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:02.645474    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:27:14.592193 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:14.592150    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:27:14.692188 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:14.692146    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:27:24.320038 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:24.319987    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:27:24.415251 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:24.415221    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:27:40.091839 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:40.091804    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:27:40.193639 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:40.193610    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:27:44.003008 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:44.002974    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:27:44.871177 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:44.871140    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:27:45.807653 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:45.807609    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7630-140098424793392"]
Jul 23 14:27:45.813796 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:45.813771    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7630-140098424793392"
Jul 23 14:27:45.816779 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:45.816729    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-g7rfd\""
Jul 23 14:27:45.819919 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:45.819876    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7630-140098424793392"]
Jul 23 14:27:45.912904 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:45.912860    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mh62b\" (UniqueName: \"kubernetes.io/projected/f3d47f56-1588-494d-9663-b7aa655b5bee-kube-api-access-mh62b\") pod \"test-curl-7630-140098424793392\" (UID: \"f3d47f56-1588-494d-9663-b7aa655b5bee\") " pod="opendatahub/test-curl-7630-140098424793392"
Jul 23 14:27:46.013896 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:46.013861    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mh62b\" (UniqueName: \"kubernetes.io/projected/f3d47f56-1588-494d-9663-b7aa655b5bee-kube-api-access-mh62b\") pod \"test-curl-7630-140098424793392\" (UID: \"f3d47f56-1588-494d-9663-b7aa655b5bee\") " pod="opendatahub/test-curl-7630-140098424793392"
Jul 23 14:27:46.022920 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:46.022891    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mh62b\" (UniqueName: \"kubernetes.io/projected/f3d47f56-1588-494d-9663-b7aa655b5bee-kube-api-access-mh62b\") pod \"test-curl-7630-140098424793392\" (UID: \"f3d47f56-1588-494d-9663-b7aa655b5bee\") " pod="opendatahub/test-curl-7630-140098424793392"
Jul 23 14:27:46.125573 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:46.125489    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7630-140098424793392"
Jul 23 14:27:46.272981 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:46.272956    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7630-140098424793392"]
Jul 23 14:27:46.274656 ip-10-0-140-103 kubenswrapper[2573]: W0723 14:27:46.274619    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf3d47f56_1588_494d_9663_b7aa655b5bee.slice/crio-e02f6d9f92ba8c42d76d6b7f8b6458ed47a6b825a943c48c1abcb813b0a524e7 WatchSource:0}: Error finding container e02f6d9f92ba8c42d76d6b7f8b6458ed47a6b825a943c48c1abcb813b0a524e7: Status 404 returned error can't find the container with id e02f6d9f92ba8c42d76d6b7f8b6458ed47a6b825a943c48c1abcb813b0a524e7
Jul 23 14:27:46.275958 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:46.275938    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 14:27:46.456027 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:46.455922    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7630-140098424793392" event={"ID":"f3d47f56-1588-494d-9663-b7aa655b5bee","Type":"ContainerStarted","Data":"e02f6d9f92ba8c42d76d6b7f8b6458ed47a6b825a943c48c1abcb813b0a524e7"}
Jul 23 14:27:47.463278 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:47.463244    2573 generic.go:356] "Generic (PLEG): container finished" podID="f3d47f56-1588-494d-9663-b7aa655b5bee" containerID="b0f39b093c42baef69d381f7fa515d787c0782aef589c20f7990da8f8833b9e7" exitCode=0
Jul 23 14:27:47.463654 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:47.463315    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7630-140098424793392" event={"ID":"f3d47f56-1588-494d-9663-b7aa655b5bee","Type":"ContainerDied","Data":"b0f39b093c42baef69d381f7fa515d787c0782aef589c20f7990da8f8833b9e7"}
Jul 23 14:27:48.606517 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:48.606493    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7630-140098424793392"
Jul 23 14:27:48.630534 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:48.630513    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7630-140098424793392_f3d47f56-1588-494d-9663-b7aa655b5bee/test-curl-7630-140098424793392/0.log"
Jul 23 14:27:48.658004 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:48.657971    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7630-140098424793392"]
Jul 23 14:27:48.663259 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:48.663234    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7630-140098424793392"]
Jul 23 14:27:48.738387 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:48.738310    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mh62b\" (UniqueName: \"kubernetes.io/projected/f3d47f56-1588-494d-9663-b7aa655b5bee-kube-api-access-mh62b\") pod \"f3d47f56-1588-494d-9663-b7aa655b5bee\" (UID: \"f3d47f56-1588-494d-9663-b7aa655b5bee\") "
Jul 23 14:27:48.740384 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:48.740350    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3d47f56-1588-494d-9663-b7aa655b5bee-kube-api-access-mh62b" (OuterVolumeSpecName: "kube-api-access-mh62b") pod "f3d47f56-1588-494d-9663-b7aa655b5bee" (UID: "f3d47f56-1588-494d-9663-b7aa655b5bee"). InnerVolumeSpecName "kube-api-access-mh62b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 14:27:48.794182 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:48.794150    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7630-140098424793264"]
Jul 23 14:27:48.794597 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:48.794584    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3d47f56-1588-494d-9663-b7aa655b5bee" containerName="test-curl-7630-140098424793392"
Jul 23 14:27:48.794641 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:48.794598    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3d47f56-1588-494d-9663-b7aa655b5bee" containerName="test-curl-7630-140098424793392"
Jul 23 14:27:48.794687 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:48.794678    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3d47f56-1588-494d-9663-b7aa655b5bee" containerName="test-curl-7630-140098424793392"
Jul 23 14:27:48.797882 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:48.797863    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7630-140098424793264"
Jul 23 14:27:48.804483 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:48.804458    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7630-140098424793264"]
Jul 23 14:27:48.839879 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:48.839839    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mh62b\" (UniqueName: \"kubernetes.io/projected/f3d47f56-1588-494d-9663-b7aa655b5bee-kube-api-access-mh62b\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:27:48.940355 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:48.940325    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpnl5\" (UniqueName: \"kubernetes.io/projected/5edeb0bc-7272-4d8f-a787-a332995cb3e5-kube-api-access-zpnl5\") pod \"test-curl-7630-140098424793264\" (UID: \"5edeb0bc-7272-4d8f-a787-a332995cb3e5\") " pod="opendatahub/test-curl-7630-140098424793264"
Jul 23 14:27:49.041661 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:49.041631    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpnl5\" (UniqueName: \"kubernetes.io/projected/5edeb0bc-7272-4d8f-a787-a332995cb3e5-kube-api-access-zpnl5\") pod \"test-curl-7630-140098424793264\" (UID: \"5edeb0bc-7272-4d8f-a787-a332995cb3e5\") " pod="opendatahub/test-curl-7630-140098424793264"
Jul 23 14:27:49.050817 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:49.050787    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpnl5\" (UniqueName: \"kubernetes.io/projected/5edeb0bc-7272-4d8f-a787-a332995cb3e5-kube-api-access-zpnl5\") pod \"test-curl-7630-140098424793264\" (UID: \"5edeb0bc-7272-4d8f-a787-a332995cb3e5\") " pod="opendatahub/test-curl-7630-140098424793264"
Jul 23 14:27:49.067881 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:49.067850    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3d47f56-1588-494d-9663-b7aa655b5bee" path="/var/lib/kubelet/pods/f3d47f56-1588-494d-9663-b7aa655b5bee/volumes"
Jul 23 14:27:49.109252 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:49.109219    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7630-140098424793264"
Jul 23 14:27:49.247948 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:49.247911    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7630-140098424793264"]
Jul 23 14:27:49.248863 ip-10-0-140-103 kubenswrapper[2573]: W0723 14:27:49.248836    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5edeb0bc_7272_4d8f_a787_a332995cb3e5.slice/crio-d87d2fb5c66ca7da26d81e26f883eb4b19a26197d5fad8b3da28d77bc0e5713c WatchSource:0}: Error finding container d87d2fb5c66ca7da26d81e26f883eb4b19a26197d5fad8b3da28d77bc0e5713c: Status 404 returned error can't find the container with id d87d2fb5c66ca7da26d81e26f883eb4b19a26197d5fad8b3da28d77bc0e5713c
Jul 23 14:27:49.476288 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:49.476206    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7630-140098424793392"
Jul 23 14:27:49.476288 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:49.476221    2573 scope.go:117] "RemoveContainer" containerID="b0f39b093c42baef69d381f7fa515d787c0782aef589c20f7990da8f8833b9e7"
Jul 23 14:27:49.477552 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:49.477511    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7630-140098424793264" event={"ID":"5edeb0bc-7272-4d8f-a787-a332995cb3e5","Type":"ContainerStarted","Data":"d87d2fb5c66ca7da26d81e26f883eb4b19a26197d5fad8b3da28d77bc0e5713c"}
Jul 23 14:27:50.484846 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:50.484810    2573 generic.go:356] "Generic (PLEG): container finished" podID="5edeb0bc-7272-4d8f-a787-a332995cb3e5" containerID="377660cceca2d9d3c0088708769d5ad23aab75288c28d667f1603f2bd46433a4" exitCode=0
Jul 23 14:27:50.485330 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:50.484897    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7630-140098424793264" event={"ID":"5edeb0bc-7272-4d8f-a787-a332995cb3e5","Type":"ContainerDied","Data":"377660cceca2d9d3c0088708769d5ad23aab75288c28d667f1603f2bd46433a4"}
Jul 23 14:27:51.637308 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:51.637279    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7630-140098424793264"
Jul 23 14:27:51.661736 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:51.661710    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7630-140098424793264_5edeb0bc-7272-4d8f-a787-a332995cb3e5/test-curl-7630-140098424793264/0.log"
Jul 23 14:27:51.692984 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:51.692956    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7630-140098424793264"]
Jul 23 14:27:51.701148 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:51.701117    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7630-140098424793264"]
Jul 23 14:27:51.769777 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:51.769705    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zpnl5\" (UniqueName: \"kubernetes.io/projected/5edeb0bc-7272-4d8f-a787-a332995cb3e5-kube-api-access-zpnl5\") pod \"5edeb0bc-7272-4d8f-a787-a332995cb3e5\" (UID: \"5edeb0bc-7272-4d8f-a787-a332995cb3e5\") "
Jul 23 14:27:51.771658 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:51.771622    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5edeb0bc-7272-4d8f-a787-a332995cb3e5-kube-api-access-zpnl5" (OuterVolumeSpecName: "kube-api-access-zpnl5") pod "5edeb0bc-7272-4d8f-a787-a332995cb3e5" (UID: "5edeb0bc-7272-4d8f-a787-a332995cb3e5"). InnerVolumeSpecName "kube-api-access-zpnl5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 14:27:51.870953 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:51.870913    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zpnl5\" (UniqueName: \"kubernetes.io/projected/5edeb0bc-7272-4d8f-a787-a332995cb3e5-kube-api-access-zpnl5\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:27:51.878634 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:51.878610    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7630-140098424681504"]
Jul 23 14:27:51.879061 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:51.879046    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5edeb0bc-7272-4d8f-a787-a332995cb3e5" containerName="test-curl-7630-140098424793264"
Jul 23 14:27:51.879115 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:51.879061    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="5edeb0bc-7272-4d8f-a787-a332995cb3e5" containerName="test-curl-7630-140098424793264"
Jul 23 14:27:51.879151 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:51.879123    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="5edeb0bc-7272-4d8f-a787-a332995cb3e5" containerName="test-curl-7630-140098424793264"
Jul 23 14:27:51.882217 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:51.882202    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7630-140098424681504"
Jul 23 14:27:51.894431 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:51.894407    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7630-140098424681504"]
Jul 23 14:27:51.972272 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:51.972232    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzp89\" (UniqueName: \"kubernetes.io/projected/c17fc34c-c49a-4bc4-b09c-1d0d84621a78-kube-api-access-vzp89\") pod \"test-curl-7630-140098424681504\" (UID: \"c17fc34c-c49a-4bc4-b09c-1d0d84621a78\") " pod="opendatahub/test-curl-7630-140098424681504"
Jul 23 14:27:52.072991 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:52.072954    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzp89\" (UniqueName: \"kubernetes.io/projected/c17fc34c-c49a-4bc4-b09c-1d0d84621a78-kube-api-access-vzp89\") pod \"test-curl-7630-140098424681504\" (UID: \"c17fc34c-c49a-4bc4-b09c-1d0d84621a78\") " pod="opendatahub/test-curl-7630-140098424681504"
Jul 23 14:27:52.082608 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:52.082579    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzp89\" (UniqueName: \"kubernetes.io/projected/c17fc34c-c49a-4bc4-b09c-1d0d84621a78-kube-api-access-vzp89\") pod \"test-curl-7630-140098424681504\" (UID: \"c17fc34c-c49a-4bc4-b09c-1d0d84621a78\") " pod="opendatahub/test-curl-7630-140098424681504"
Jul 23 14:27:52.191170 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:52.191119    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7630-140098424681504"
Jul 23 14:27:52.335113 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:52.335093    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7630-140098424681504"]
Jul 23 14:27:52.337340 ip-10-0-140-103 kubenswrapper[2573]: W0723 14:27:52.337314    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc17fc34c_c49a_4bc4_b09c_1d0d84621a78.slice/crio-d07ce61cf0dbe4e5fdfb1bd890d908e8e95aa9631c39c7e5ced0f1108e89c8b6 WatchSource:0}: Error finding container d07ce61cf0dbe4e5fdfb1bd890d908e8e95aa9631c39c7e5ced0f1108e89c8b6: Status 404 returned error can't find the container with id d07ce61cf0dbe4e5fdfb1bd890d908e8e95aa9631c39c7e5ced0f1108e89c8b6
Jul 23 14:27:52.498248 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:52.498210    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7630-140098424681504" event={"ID":"c17fc34c-c49a-4bc4-b09c-1d0d84621a78","Type":"ContainerStarted","Data":"d07ce61cf0dbe4e5fdfb1bd890d908e8e95aa9631c39c7e5ced0f1108e89c8b6"}
Jul 23 14:27:52.499390 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:52.499369    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d87d2fb5c66ca7da26d81e26f883eb4b19a26197d5fad8b3da28d77bc0e5713c"
Jul 23 14:27:52.499390 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:52.499375    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7630-140098424793264"
Jul 23 14:27:52.510592 ip-10-0-140-103 kubenswrapper[2573]: E0723 14:27:52.510564    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7630-140098424793264\" is forbidden: User \"system:node:ip-10-0-140-103.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-103.ec2.internal' and this object" podUID="5edeb0bc-7272-4d8f-a787-a332995cb3e5" pod="opendatahub/test-curl-7630-140098424793264"
Jul 23 14:27:53.069421 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:53.069389    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5edeb0bc-7272-4d8f-a787-a332995cb3e5" path="/var/lib/kubelet/pods/5edeb0bc-7272-4d8f-a787-a332995cb3e5/volumes"
Jul 23 14:27:53.507406 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:53.507311    2573 generic.go:356] "Generic (PLEG): container finished" podID="c17fc34c-c49a-4bc4-b09c-1d0d84621a78" containerID="3c23549cb9b1937b974909d64e612847e233648181db64098de35622db3ae2c3" exitCode=0
Jul 23 14:27:53.507562 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:53.507393    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7630-140098424681504" event={"ID":"c17fc34c-c49a-4bc4-b09c-1d0d84621a78","Type":"ContainerDied","Data":"3c23549cb9b1937b974909d64e612847e233648181db64098de35622db3ae2c3"}
Jul 23 14:27:54.660455 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:54.660430    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7630-140098424681504"
Jul 23 14:27:54.682480 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:54.682451    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7630-140098424681504_c17fc34c-c49a-4bc4-b09c-1d0d84621a78/test-curl-7630-140098424681504/0.log"
Jul 23 14:27:54.717405 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:54.717358    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7630-140098424681504"]
Jul 23 14:27:54.717666 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:54.717633    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7630-140098424681504"]
Jul 23 14:27:54.798166 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:54.798138    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vzp89\" (UniqueName: \"kubernetes.io/projected/c17fc34c-c49a-4bc4-b09c-1d0d84621a78-kube-api-access-vzp89\") pod \"c17fc34c-c49a-4bc4-b09c-1d0d84621a78\" (UID: \"c17fc34c-c49a-4bc4-b09c-1d0d84621a78\") "
Jul 23 14:27:54.800211 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:54.800185    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c17fc34c-c49a-4bc4-b09c-1d0d84621a78-kube-api-access-vzp89" (OuterVolumeSpecName: "kube-api-access-vzp89") pod "c17fc34c-c49a-4bc4-b09c-1d0d84621a78" (UID: "c17fc34c-c49a-4bc4-b09c-1d0d84621a78"). InnerVolumeSpecName "kube-api-access-vzp89". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 14:27:54.833983 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:54.833946    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7630-140098424681504"]
Jul 23 14:27:54.834450 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:54.834434    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c17fc34c-c49a-4bc4-b09c-1d0d84621a78" containerName="test-curl-7630-140098424681504"
Jul 23 14:27:54.834508 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:54.834452    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c17fc34c-c49a-4bc4-b09c-1d0d84621a78" containerName="test-curl-7630-140098424681504"
Jul 23 14:27:54.834542 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:54.834526    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="c17fc34c-c49a-4bc4-b09c-1d0d84621a78" containerName="test-curl-7630-140098424681504"
Jul 23 14:27:54.837612 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:54.837595    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7630-140098424681504"
Jul 23 14:27:54.846262 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:54.846237    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7630-140098424681504"]
Jul 23 14:27:54.899090 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:54.899056    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vzp89\" (UniqueName: \"kubernetes.io/projected/c17fc34c-c49a-4bc4-b09c-1d0d84621a78-kube-api-access-vzp89\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:27:55.000249 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:55.000212    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvcpg\" (UniqueName: \"kubernetes.io/projected/f334517c-a870-47d0-a397-894c12dbec8b-kube-api-access-lvcpg\") pod \"test-curl-7630-140098424681504\" (UID: \"f334517c-a870-47d0-a397-894c12dbec8b\") " pod="opendatahub/test-curl-7630-140098424681504"
Jul 23 14:27:55.068723 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:55.068646    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c17fc34c-c49a-4bc4-b09c-1d0d84621a78" path="/var/lib/kubelet/pods/c17fc34c-c49a-4bc4-b09c-1d0d84621a78/volumes"
Jul 23 14:27:55.101673 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:55.101629    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvcpg\" (UniqueName: \"kubernetes.io/projected/f334517c-a870-47d0-a397-894c12dbec8b-kube-api-access-lvcpg\") pod \"test-curl-7630-140098424681504\" (UID: \"f334517c-a870-47d0-a397-894c12dbec8b\") " pod="opendatahub/test-curl-7630-140098424681504"
Jul 23 14:27:55.110895 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:55.110869    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvcpg\" (UniqueName: \"kubernetes.io/projected/f334517c-a870-47d0-a397-894c12dbec8b-kube-api-access-lvcpg\") pod \"test-curl-7630-140098424681504\" (UID: \"f334517c-a870-47d0-a397-894c12dbec8b\") " pod="opendatahub/test-curl-7630-140098424681504"
Jul 23 14:27:55.148942 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:55.148911    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7630-140098424681504"
Jul 23 14:27:55.309384 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:55.309357    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7630-140098424681504"]
Jul 23 14:27:55.311130 ip-10-0-140-103 kubenswrapper[2573]: W0723 14:27:55.311091    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf334517c_a870_47d0_a397_894c12dbec8b.slice/crio-5324a0c37ebfb1529f7ed61113822219747052c4adf602a10a49a1c7b0ec63c8 WatchSource:0}: Error finding container 5324a0c37ebfb1529f7ed61113822219747052c4adf602a10a49a1c7b0ec63c8: Status 404 returned error can't find the container with id 5324a0c37ebfb1529f7ed61113822219747052c4adf602a10a49a1c7b0ec63c8
Jul 23 14:27:55.521139 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:55.521105    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7630-140098424681504"
Jul 23 14:27:55.521332 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:55.521146    2573 scope.go:117] "RemoveContainer" containerID="3c23549cb9b1937b974909d64e612847e233648181db64098de35622db3ae2c3"
Jul 23 14:27:55.522533 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:55.522488    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7630-140098424681504" event={"ID":"f334517c-a870-47d0-a397-894c12dbec8b","Type":"ContainerStarted","Data":"5324a0c37ebfb1529f7ed61113822219747052c4adf602a10a49a1c7b0ec63c8"}
Jul 23 14:27:56.530321 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:56.530289    2573 generic.go:356] "Generic (PLEG): container finished" podID="f334517c-a870-47d0-a397-894c12dbec8b" containerID="970d4b2967c1a5860f3d421881494b308edfa3a52e24af02bd5fe6a2999aa995" exitCode=0
Jul 23 14:27:56.530716 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:56.530373    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7630-140098424681504" event={"ID":"f334517c-a870-47d0-a397-894c12dbec8b","Type":"ContainerDied","Data":"970d4b2967c1a5860f3d421881494b308edfa3a52e24af02bd5fe6a2999aa995"}
Jul 23 14:27:57.681306 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:57.681281    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7630-140098424681504"
Jul 23 14:27:57.709587 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:57.709556    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7630-140098424681504_f334517c-a870-47d0-a397-894c12dbec8b/test-curl-7630-140098424681504/0.log"
Jul 23 14:27:57.736938 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:57.736910    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7630-140098424681504"]
Jul 23 14:27:57.741502 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:57.741470    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7630-140098424681504"]
Jul 23 14:27:57.828440 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:57.828408    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lvcpg\" (UniqueName: \"kubernetes.io/projected/f334517c-a870-47d0-a397-894c12dbec8b-kube-api-access-lvcpg\") pod \"f334517c-a870-47d0-a397-894c12dbec8b\" (UID: \"f334517c-a870-47d0-a397-894c12dbec8b\") "
Jul 23 14:27:57.830519 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:57.830493    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f334517c-a870-47d0-a397-894c12dbec8b-kube-api-access-lvcpg" (OuterVolumeSpecName: "kube-api-access-lvcpg") pod "f334517c-a870-47d0-a397-894c12dbec8b" (UID: "f334517c-a870-47d0-a397-894c12dbec8b"). InnerVolumeSpecName "kube-api-access-lvcpg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 14:27:57.872720 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:57.872687    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7630-140098424682512"]
Jul 23 14:27:57.873187 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:57.873171    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f334517c-a870-47d0-a397-894c12dbec8b" containerName="test-curl-7630-140098424681504"
Jul 23 14:27:57.873242 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:57.873188    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="f334517c-a870-47d0-a397-894c12dbec8b" containerName="test-curl-7630-140098424681504"
Jul 23 14:27:57.873303 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:57.873290    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="f334517c-a870-47d0-a397-894c12dbec8b" containerName="test-curl-7630-140098424681504"
Jul 23 14:27:57.876289 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:57.876273    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7630-140098424682512"
Jul 23 14:27:57.885172 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:57.885147    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7630-140098424682512"]
Jul 23 14:27:57.929167 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:57.929140    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lvcpg\" (UniqueName: \"kubernetes.io/projected/f334517c-a870-47d0-a397-894c12dbec8b-kube-api-access-lvcpg\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:27:58.030037 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:58.029974    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghcfb\" (UniqueName: \"kubernetes.io/projected/a4154511-7594-42f0-9a36-95686d59536f-kube-api-access-ghcfb\") pod \"test-curl-7630-140098424682512\" (UID: \"a4154511-7594-42f0-9a36-95686d59536f\") " pod="opendatahub/test-curl-7630-140098424682512"
Jul 23 14:27:58.131599 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:58.131509    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghcfb\" (UniqueName: \"kubernetes.io/projected/a4154511-7594-42f0-9a36-95686d59536f-kube-api-access-ghcfb\") pod \"test-curl-7630-140098424682512\" (UID: \"a4154511-7594-42f0-9a36-95686d59536f\") " pod="opendatahub/test-curl-7630-140098424682512"
Jul 23 14:27:58.139981 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:58.139947    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghcfb\" (UniqueName: \"kubernetes.io/projected/a4154511-7594-42f0-9a36-95686d59536f-kube-api-access-ghcfb\") pod \"test-curl-7630-140098424682512\" (UID: \"a4154511-7594-42f0-9a36-95686d59536f\") " pod="opendatahub/test-curl-7630-140098424682512"
Jul 23 14:27:58.186688 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:58.186661    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7630-140098424682512"
Jul 23 14:27:58.328605 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:58.328574    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7630-140098424682512"]
Jul 23 14:27:58.330424 ip-10-0-140-103 kubenswrapper[2573]: W0723 14:27:58.330394    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda4154511_7594_42f0_9a36_95686d59536f.slice/crio-050b4c147225665f8c07fc1e61466b6f3711e27b6c97682ed1ee284ceda77f49 WatchSource:0}: Error finding container 050b4c147225665f8c07fc1e61466b6f3711e27b6c97682ed1ee284ceda77f49: Status 404 returned error can't find the container with id 050b4c147225665f8c07fc1e61466b6f3711e27b6c97682ed1ee284ceda77f49
Jul 23 14:27:58.543196 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:58.543160    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7630-140098424682512" event={"ID":"a4154511-7594-42f0-9a36-95686d59536f","Type":"ContainerStarted","Data":"050b4c147225665f8c07fc1e61466b6f3711e27b6c97682ed1ee284ceda77f49"}
Jul 23 14:27:58.544394 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:58.544371    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5324a0c37ebfb1529f7ed61113822219747052c4adf602a10a49a1c7b0ec63c8"
Jul 23 14:27:58.544394 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:58.544391    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7630-140098424681504"
Jul 23 14:27:58.555105 ip-10-0-140-103 kubenswrapper[2573]: E0723 14:27:58.555075    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7630-140098424681504\" is forbidden: User \"system:node:ip-10-0-140-103.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-103.ec2.internal' and this object" podUID="f334517c-a870-47d0-a397-894c12dbec8b" pod="opendatahub/test-curl-7630-140098424681504"
Jul 23 14:27:59.067561 ip-10-0-140-103 kubenswrapper[2573]: E0723 14:27:59.067524    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7630-140098424681504\" is forbidden: User \"system:node:ip-10-0-140-103.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-103.ec2.internal' and this object" podUID="f334517c-a870-47d0-a397-894c12dbec8b" pod="opendatahub/test-curl-7630-140098424681504"
Jul 23 14:27:59.069198 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:59.069176    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f334517c-a870-47d0-a397-894c12dbec8b" path="/var/lib/kubelet/pods/f334517c-a870-47d0-a397-894c12dbec8b/volumes"
Jul 23 14:27:59.551705 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:59.551669    2573 generic.go:356] "Generic (PLEG): container finished" podID="a4154511-7594-42f0-9a36-95686d59536f" containerID="745cebcf15d0cde64b91b61b88d2e07ded65c23e8eee52d68528c4825d981be5" exitCode=0
Jul 23 14:27:59.551882 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:27:59.551758    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7630-140098424682512" event={"ID":"a4154511-7594-42f0-9a36-95686d59536f","Type":"ContainerDied","Data":"745cebcf15d0cde64b91b61b88d2e07ded65c23e8eee52d68528c4825d981be5"}
Jul 23 14:28:00.699909 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:00.699884    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7630-140098424682512"
Jul 23 14:28:00.726822 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:00.726790    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7630-140098424682512_a4154511-7594-42f0-9a36-95686d59536f/test-curl-7630-140098424682512/0.log"
Jul 23 14:28:00.756130 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:00.756102    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7630-140098424682512"]
Jul 23 14:28:00.762069 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:00.762043    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7630-140098424682512"]
Jul 23 14:28:00.859398 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:00.859308    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ghcfb\" (UniqueName: \"kubernetes.io/projected/a4154511-7594-42f0-9a36-95686d59536f-kube-api-access-ghcfb\") pod \"a4154511-7594-42f0-9a36-95686d59536f\" (UID: \"a4154511-7594-42f0-9a36-95686d59536f\") "
Jul 23 14:28:00.861413 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:00.861387    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4154511-7594-42f0-9a36-95686d59536f-kube-api-access-ghcfb" (OuterVolumeSpecName: "kube-api-access-ghcfb") pod "a4154511-7594-42f0-9a36-95686d59536f" (UID: "a4154511-7594-42f0-9a36-95686d59536f"). InnerVolumeSpecName "kube-api-access-ghcfb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 14:28:00.960339 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:00.960309    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ghcfb\" (UniqueName: \"kubernetes.io/projected/a4154511-7594-42f0-9a36-95686d59536f-kube-api-access-ghcfb\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:28:01.068320 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:01.068274    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4154511-7594-42f0-9a36-95686d59536f" path="/var/lib/kubelet/pods/a4154511-7594-42f0-9a36-95686d59536f/volumes"
Jul 23 14:28:01.566357 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:01.566327    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7630-140098424682512"
Jul 23 14:28:01.566541 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:01.566385    2573 scope.go:117] "RemoveContainer" containerID="745cebcf15d0cde64b91b61b88d2e07ded65c23e8eee52d68528c4825d981be5"
Jul 23 14:28:04.879926 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:04.879892    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:28:04.980316 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:04.980281    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:28:14.580030 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:14.579979    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:28:19.191228 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:19.191191    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:28:19.609226 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:19.609186    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:28:26.127919 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:26.127832    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:28:26.228510 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:26.228471    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8"]
Jul 23 14:28:26.228742 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:26.228714    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8" podUID="8572b121-8904-4de7-928f-418a70aca39a" containerName="istio-proxy" containerID="cri-o://be6f9528c89c0a57b9996e84147fe20c5e8bb316eb7fd9f65fdcc59045715208" gracePeriod=30
Jul 23 14:28:26.267158 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:26.267125    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:28:26.362086 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:26.362037    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:28:26.495282 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:26.495197    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:28:27.211963 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:27.211932    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:28:27.314113 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:27.314082    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:28:30.879862 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:30.879815    2573 patch_prober.go:28] interesting pod/e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 23 14:28:30.880277 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:30.879913    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8" podUID="8572b121-8904-4de7-928f-418a70aca39a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 23 14:28:31.497723 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:31.497654    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8"
Jul 23 14:28:31.661433 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:31.661396    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8572b121-8904-4de7-928f-418a70aca39a-istio-data\") pod \"8572b121-8904-4de7-928f-418a70aca39a\" (UID: \"8572b121-8904-4de7-928f-418a70aca39a\") "
Jul 23 14:28:31.661635 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:31.661469    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8572b121-8904-4de7-928f-418a70aca39a-istiod-ca-cert\") pod \"8572b121-8904-4de7-928f-418a70aca39a\" (UID: \"8572b121-8904-4de7-928f-418a70aca39a\") "
Jul 23 14:28:31.661635 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:31.661498    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8572b121-8904-4de7-928f-418a70aca39a-istio-podinfo\") pod \"8572b121-8904-4de7-928f-418a70aca39a\" (UID: \"8572b121-8904-4de7-928f-418a70aca39a\") "
Jul 23 14:28:31.661635 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:31.661526    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pxk8p\" (UniqueName: \"kubernetes.io/projected/8572b121-8904-4de7-928f-418a70aca39a-kube-api-access-pxk8p\") pod \"8572b121-8904-4de7-928f-418a70aca39a\" (UID: \"8572b121-8904-4de7-928f-418a70aca39a\") "
Jul 23 14:28:31.661635 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:31.661545    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8572b121-8904-4de7-928f-418a70aca39a-istio-envoy\") pod \"8572b121-8904-4de7-928f-418a70aca39a\" (UID: \"8572b121-8904-4de7-928f-418a70aca39a\") "
Jul 23 14:28:31.661635 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:31.661586    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8572b121-8904-4de7-928f-418a70aca39a-credential-socket\") pod \"8572b121-8904-4de7-928f-418a70aca39a\" (UID: \"8572b121-8904-4de7-928f-418a70aca39a\") "
Jul 23 14:28:31.661635 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:31.661636    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8572b121-8904-4de7-928f-418a70aca39a-workload-socket\") pod \"8572b121-8904-4de7-928f-418a70aca39a\" (UID: \"8572b121-8904-4de7-928f-418a70aca39a\") "
Jul 23 14:28:31.661971 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:31.661661    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8572b121-8904-4de7-928f-418a70aca39a-workload-certs\") pod \"8572b121-8904-4de7-928f-418a70aca39a\" (UID: \"8572b121-8904-4de7-928f-418a70aca39a\") "
Jul 23 14:28:31.661971 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:31.661686    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8572b121-8904-4de7-928f-418a70aca39a-istio-token\") pod \"8572b121-8904-4de7-928f-418a70aca39a\" (UID: \"8572b121-8904-4de7-928f-418a70aca39a\") "
Jul 23 14:28:31.661971 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:31.661933    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8572b121-8904-4de7-928f-418a70aca39a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8572b121-8904-4de7-928f-418a70aca39a" (UID: "8572b121-8904-4de7-928f-418a70aca39a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 14:28:31.662164 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:31.662107    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8572b121-8904-4de7-928f-418a70aca39a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8572b121-8904-4de7-928f-418a70aca39a" (UID: "8572b121-8904-4de7-928f-418a70aca39a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 14:28:31.662222 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:31.662178    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8572b121-8904-4de7-928f-418a70aca39a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8572b121-8904-4de7-928f-418a70aca39a" (UID: "8572b121-8904-4de7-928f-418a70aca39a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 14:28:31.662312 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:31.662274    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8572b121-8904-4de7-928f-418a70aca39a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8572b121-8904-4de7-928f-418a70aca39a" (UID: "8572b121-8904-4de7-928f-418a70aca39a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 14:28:31.662458 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:31.662435    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8572b121-8904-4de7-928f-418a70aca39a-istio-data" (OuterVolumeSpecName: "istio-data") pod "8572b121-8904-4de7-928f-418a70aca39a" (UID: "8572b121-8904-4de7-928f-418a70aca39a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 14:28:31.663858 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:31.663830    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8572b121-8904-4de7-928f-418a70aca39a-kube-api-access-pxk8p" (OuterVolumeSpecName: "kube-api-access-pxk8p") pod "8572b121-8904-4de7-928f-418a70aca39a" (UID: "8572b121-8904-4de7-928f-418a70aca39a"). InnerVolumeSpecName "kube-api-access-pxk8p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 14:28:31.663983 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:31.663873    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8572b121-8904-4de7-928f-418a70aca39a-istio-token" (OuterVolumeSpecName: "istio-token") pod "8572b121-8904-4de7-928f-418a70aca39a" (UID: "8572b121-8904-4de7-928f-418a70aca39a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 14:28:31.664243 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:31.664219    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8572b121-8904-4de7-928f-418a70aca39a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8572b121-8904-4de7-928f-418a70aca39a" (UID: "8572b121-8904-4de7-928f-418a70aca39a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 14:28:31.664324 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:31.664223    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8572b121-8904-4de7-928f-418a70aca39a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8572b121-8904-4de7-928f-418a70aca39a" (UID: "8572b121-8904-4de7-928f-418a70aca39a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 14:28:31.754043 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:31.753932    2573 generic.go:356] "Generic (PLEG): container finished" podID="8572b121-8904-4de7-928f-418a70aca39a" containerID="be6f9528c89c0a57b9996e84147fe20c5e8bb316eb7fd9f65fdcc59045715208" exitCode=0
Jul 23 14:28:31.754043 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:31.753978    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8" event={"ID":"8572b121-8904-4de7-928f-418a70aca39a","Type":"ContainerDied","Data":"be6f9528c89c0a57b9996e84147fe20c5e8bb316eb7fd9f65fdcc59045715208"}
Jul 23 14:28:31.754233 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:31.754065    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8" event={"ID":"8572b121-8904-4de7-928f-418a70aca39a","Type":"ContainerDied","Data":"3e9d4c45737ea40c57ded4350b6ca51c3e0980687c7da3c12e5ecbe2884a4801"}
Jul 23 14:28:31.754233 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:31.753990    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8"
Jul 23 14:28:31.754233 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:31.754094    2573 scope.go:117] "RemoveContainer" containerID="be6f9528c89c0a57b9996e84147fe20c5e8bb316eb7fd9f65fdcc59045715208"
Jul 23 14:28:31.762771 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:31.762747    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8572b121-8904-4de7-928f-418a70aca39a-istiod-ca-cert\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:28:31.762880 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:31.762776    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8572b121-8904-4de7-928f-418a70aca39a-istio-podinfo\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:28:31.762880 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:31.762790    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pxk8p\" (UniqueName: \"kubernetes.io/projected/8572b121-8904-4de7-928f-418a70aca39a-kube-api-access-pxk8p\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:28:31.762880 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:31.762805    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8572b121-8904-4de7-928f-418a70aca39a-istio-envoy\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:28:31.762880 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:31.762819    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8572b121-8904-4de7-928f-418a70aca39a-credential-socket\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:28:31.762880 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:31.762834    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8572b121-8904-4de7-928f-418a70aca39a-workload-socket\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:28:31.762880 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:31.762847    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8572b121-8904-4de7-928f-418a70aca39a-workload-certs\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:28:31.762880 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:31.762859    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8572b121-8904-4de7-928f-418a70aca39a-istio-token\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:28:31.762880 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:31.762870    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8572b121-8904-4de7-928f-418a70aca39a-istio-data\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:28:31.764285 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:31.764266    2573 scope.go:117] "RemoveContainer" containerID="3478c337ae91162140ed6dea9036b9c2de303f67f53b66d64b452adfc1a03ee0"
Jul 23 14:28:31.773383 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:31.773365    2573 scope.go:117] "RemoveContainer" containerID="be6f9528c89c0a57b9996e84147fe20c5e8bb316eb7fd9f65fdcc59045715208"
Jul 23 14:28:31.773633 ip-10-0-140-103 kubenswrapper[2573]: E0723 14:28:31.773615    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be6f9528c89c0a57b9996e84147fe20c5e8bb316eb7fd9f65fdcc59045715208\": container with ID starting with be6f9528c89c0a57b9996e84147fe20c5e8bb316eb7fd9f65fdcc59045715208 not found: ID does not exist" containerID="be6f9528c89c0a57b9996e84147fe20c5e8bb316eb7fd9f65fdcc59045715208"
Jul 23 14:28:31.773673 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:31.773642    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be6f9528c89c0a57b9996e84147fe20c5e8bb316eb7fd9f65fdcc59045715208"} err="failed to get container status \"be6f9528c89c0a57b9996e84147fe20c5e8bb316eb7fd9f65fdcc59045715208\": rpc error: code = NotFound desc = could not find container \"be6f9528c89c0a57b9996e84147fe20c5e8bb316eb7fd9f65fdcc59045715208\": container with ID starting with be6f9528c89c0a57b9996e84147fe20c5e8bb316eb7fd9f65fdcc59045715208 not found: ID does not exist"
Jul 23 14:28:31.773673 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:31.773659    2573 scope.go:117] "RemoveContainer" containerID="3478c337ae91162140ed6dea9036b9c2de303f67f53b66d64b452adfc1a03ee0"
Jul 23 14:28:31.773880 ip-10-0-140-103 kubenswrapper[2573]: E0723 14:28:31.773862    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3478c337ae91162140ed6dea9036b9c2de303f67f53b66d64b452adfc1a03ee0\": container with ID starting with 3478c337ae91162140ed6dea9036b9c2de303f67f53b66d64b452adfc1a03ee0 not found: ID does not exist" containerID="3478c337ae91162140ed6dea9036b9c2de303f67f53b66d64b452adfc1a03ee0"
Jul 23 14:28:31.773928 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:31.773886    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3478c337ae91162140ed6dea9036b9c2de303f67f53b66d64b452adfc1a03ee0"} err="failed to get container status \"3478c337ae91162140ed6dea9036b9c2de303f67f53b66d64b452adfc1a03ee0\": rpc error: code = NotFound desc = could not find container \"3478c337ae91162140ed6dea9036b9c2de303f67f53b66d64b452adfc1a03ee0\": container with ID starting with 3478c337ae91162140ed6dea9036b9c2de303f67f53b66d64b452adfc1a03ee0 not found: ID does not exist"
Jul 23 14:28:31.781260 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:31.781238    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8"]
Jul 23 14:28:31.789989 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:31.789967    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-42e993-openshift-default-6f8ccc444c-89lm8"]
Jul 23 14:28:33.069032 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:33.068992    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8572b121-8904-4de7-928f-418a70aca39a" path="/var/lib/kubelet/pods/8572b121-8904-4de7-928f-418a70aca39a/volumes"
Jul 23 14:28:37.160740 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:37.160707    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:28:42.072374 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:42.072325    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:28:42.172209 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:42.172174    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:28:48.771333 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:48.771296    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:28:48.972193 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:48.972153    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:28:49.079021 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:49.078951    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst"]
Jul 23 14:28:49.079251 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:49.079211    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst" podUID="660fa37c-953c-4079-87cd-11cce1697317" containerName="istio-proxy" containerID="cri-o://9c3d96f7d75981134602e29dab0bf17e7e43025aaf66cae4749a05b701f8d04f" gracePeriod=30
Jul 23 14:28:49.097602 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:49.097574    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:28:49.405227 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:49.405130    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:28:51.812150 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:51.812106    2573 patch_prober.go:28] interesting pod/e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 23 14:28:51.812528 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:51.812182    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst" podUID="660fa37c-953c-4079-87cd-11cce1697317" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 23 14:28:54.350751 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:54.350693    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst"
Jul 23 14:28:54.380437 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:54.380405    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/660fa37c-953c-4079-87cd-11cce1697317-istiod-ca-cert\") pod \"660fa37c-953c-4079-87cd-11cce1697317\" (UID: \"660fa37c-953c-4079-87cd-11cce1697317\") "
Jul 23 14:28:54.380610 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:54.380454    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/660fa37c-953c-4079-87cd-11cce1697317-credential-socket\") pod \"660fa37c-953c-4079-87cd-11cce1697317\" (UID: \"660fa37c-953c-4079-87cd-11cce1697317\") "
Jul 23 14:28:54.380610 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:54.380474    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/660fa37c-953c-4079-87cd-11cce1697317-istio-token\") pod \"660fa37c-953c-4079-87cd-11cce1697317\" (UID: \"660fa37c-953c-4079-87cd-11cce1697317\") "
Jul 23 14:28:54.380610 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:54.380514    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/660fa37c-953c-4079-87cd-11cce1697317-workload-certs\") pod \"660fa37c-953c-4079-87cd-11cce1697317\" (UID: \"660fa37c-953c-4079-87cd-11cce1697317\") "
Jul 23 14:28:54.380610 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:54.380553    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/660fa37c-953c-4079-87cd-11cce1697317-istio-envoy\") pod \"660fa37c-953c-4079-87cd-11cce1697317\" (UID: \"660fa37c-953c-4079-87cd-11cce1697317\") "
Jul 23 14:28:54.380610 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:54.380584    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/660fa37c-953c-4079-87cd-11cce1697317-workload-socket\") pod \"660fa37c-953c-4079-87cd-11cce1697317\" (UID: \"660fa37c-953c-4079-87cd-11cce1697317\") "
Jul 23 14:28:54.380878 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:54.380620    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/660fa37c-953c-4079-87cd-11cce1697317-istio-podinfo\") pod \"660fa37c-953c-4079-87cd-11cce1697317\" (UID: \"660fa37c-953c-4079-87cd-11cce1697317\") "
Jul 23 14:28:54.380878 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:54.380686    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/660fa37c-953c-4079-87cd-11cce1697317-istio-data\") pod \"660fa37c-953c-4079-87cd-11cce1697317\" (UID: \"660fa37c-953c-4079-87cd-11cce1697317\") "
Jul 23 14:28:54.380878 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:54.380709    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-np6jd\" (UniqueName: \"kubernetes.io/projected/660fa37c-953c-4079-87cd-11cce1697317-kube-api-access-np6jd\") pod \"660fa37c-953c-4079-87cd-11cce1697317\" (UID: \"660fa37c-953c-4079-87cd-11cce1697317\") "
Jul 23 14:28:54.380878 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:54.380718    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/660fa37c-953c-4079-87cd-11cce1697317-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "660fa37c-953c-4079-87cd-11cce1697317" (UID: "660fa37c-953c-4079-87cd-11cce1697317"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 14:28:54.380878 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:54.380869    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/660fa37c-953c-4079-87cd-11cce1697317-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "660fa37c-953c-4079-87cd-11cce1697317" (UID: "660fa37c-953c-4079-87cd-11cce1697317"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 14:28:54.381150 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:54.380879    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/660fa37c-953c-4079-87cd-11cce1697317-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "660fa37c-953c-4079-87cd-11cce1697317" (UID: "660fa37c-953c-4079-87cd-11cce1697317"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 14:28:54.381150 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:54.381045    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/660fa37c-953c-4079-87cd-11cce1697317-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "660fa37c-953c-4079-87cd-11cce1697317" (UID: "660fa37c-953c-4079-87cd-11cce1697317"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 14:28:54.381150 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:54.381138    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/660fa37c-953c-4079-87cd-11cce1697317-istiod-ca-cert\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:28:54.381335 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:54.381158    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/660fa37c-953c-4079-87cd-11cce1697317-credential-socket\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:28:54.381335 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:54.381178    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/660fa37c-953c-4079-87cd-11cce1697317-workload-certs\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:28:54.381335 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:54.381207    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/660fa37c-953c-4079-87cd-11cce1697317-workload-socket\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:28:54.381602 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:54.381575    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/660fa37c-953c-4079-87cd-11cce1697317-istio-data" (OuterVolumeSpecName: "istio-data") pod "660fa37c-953c-4079-87cd-11cce1697317" (UID: "660fa37c-953c-4079-87cd-11cce1697317"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 14:28:54.382853 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:54.382820    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/660fa37c-953c-4079-87cd-11cce1697317-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "660fa37c-953c-4079-87cd-11cce1697317" (UID: "660fa37c-953c-4079-87cd-11cce1697317"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 14:28:54.382965 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:54.382873    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/660fa37c-953c-4079-87cd-11cce1697317-istio-token" (OuterVolumeSpecName: "istio-token") pod "660fa37c-953c-4079-87cd-11cce1697317" (UID: "660fa37c-953c-4079-87cd-11cce1697317"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 14:28:54.382965 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:54.382887    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/660fa37c-953c-4079-87cd-11cce1697317-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "660fa37c-953c-4079-87cd-11cce1697317" (UID: "660fa37c-953c-4079-87cd-11cce1697317"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 14:28:54.383098 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:54.382976    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/660fa37c-953c-4079-87cd-11cce1697317-kube-api-access-np6jd" (OuterVolumeSpecName: "kube-api-access-np6jd") pod "660fa37c-953c-4079-87cd-11cce1697317" (UID: "660fa37c-953c-4079-87cd-11cce1697317"). InnerVolumeSpecName "kube-api-access-np6jd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 14:28:54.481986 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:54.481953    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/660fa37c-953c-4079-87cd-11cce1697317-istio-envoy\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:28:54.481986 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:54.481981    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/660fa37c-953c-4079-87cd-11cce1697317-istio-podinfo\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:28:54.481986 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:54.481989    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/660fa37c-953c-4079-87cd-11cce1697317-istio-data\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:28:54.482233 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:54.481998    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-np6jd\" (UniqueName: \"kubernetes.io/projected/660fa37c-953c-4079-87cd-11cce1697317-kube-api-access-np6jd\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:28:54.482233 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:54.482006    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/660fa37c-953c-4079-87cd-11cce1697317-istio-token\") on node \"ip-10-0-140-103.ec2.internal\" DevicePath \"\""
Jul 23 14:28:54.889343 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:54.889306    2573 generic.go:356] "Generic (PLEG): container finished" podID="660fa37c-953c-4079-87cd-11cce1697317" containerID="9c3d96f7d75981134602e29dab0bf17e7e43025aaf66cae4749a05b701f8d04f" exitCode=0
Jul 23 14:28:54.889519 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:54.889365    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst"
Jul 23 14:28:54.889519 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:54.889393    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst" event={"ID":"660fa37c-953c-4079-87cd-11cce1697317","Type":"ContainerDied","Data":"9c3d96f7d75981134602e29dab0bf17e7e43025aaf66cae4749a05b701f8d04f"}
Jul 23 14:28:54.889519 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:54.889452    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst" event={"ID":"660fa37c-953c-4079-87cd-11cce1697317","Type":"ContainerDied","Data":"6e85fd012557eeb120d63452e5f12d46aa28b9956d9fe31e77f93350e399f192"}
Jul 23 14:28:54.889519 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:54.889477    2573 scope.go:117] "RemoveContainer" containerID="9c3d96f7d75981134602e29dab0bf17e7e43025aaf66cae4749a05b701f8d04f"
Jul 23 14:28:54.899311 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:54.899296    2573 scope.go:117] "RemoveContainer" containerID="b05715559982ba3d6f8b3d63647b4cf345b3153a8dda56743aaf8633cf9eb11d"
Jul 23 14:28:54.907960 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:54.907938    2573 scope.go:117] "RemoveContainer" containerID="9c3d96f7d75981134602e29dab0bf17e7e43025aaf66cae4749a05b701f8d04f"
Jul 23 14:28:54.908256 ip-10-0-140-103 kubenswrapper[2573]: E0723 14:28:54.908230    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c3d96f7d75981134602e29dab0bf17e7e43025aaf66cae4749a05b701f8d04f\": container with ID starting with 9c3d96f7d75981134602e29dab0bf17e7e43025aaf66cae4749a05b701f8d04f not found: ID does not exist" containerID="9c3d96f7d75981134602e29dab0bf17e7e43025aaf66cae4749a05b701f8d04f"
Jul 23 14:28:54.908327 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:54.908285    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c3d96f7d75981134602e29dab0bf17e7e43025aaf66cae4749a05b701f8d04f"} err="failed to get container status \"9c3d96f7d75981134602e29dab0bf17e7e43025aaf66cae4749a05b701f8d04f\": rpc error: code = NotFound desc = could not find container \"9c3d96f7d75981134602e29dab0bf17e7e43025aaf66cae4749a05b701f8d04f\": container with ID starting with 9c3d96f7d75981134602e29dab0bf17e7e43025aaf66cae4749a05b701f8d04f not found: ID does not exist"
Jul 23 14:28:54.908327 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:54.908310    2573 scope.go:117] "RemoveContainer" containerID="b05715559982ba3d6f8b3d63647b4cf345b3153a8dda56743aaf8633cf9eb11d"
Jul 23 14:28:54.908555 ip-10-0-140-103 kubenswrapper[2573]: E0723 14:28:54.908535    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b05715559982ba3d6f8b3d63647b4cf345b3153a8dda56743aaf8633cf9eb11d\": container with ID starting with b05715559982ba3d6f8b3d63647b4cf345b3153a8dda56743aaf8633cf9eb11d not found: ID does not exist" containerID="b05715559982ba3d6f8b3d63647b4cf345b3153a8dda56743aaf8633cf9eb11d"
Jul 23 14:28:54.908617 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:54.908564    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b05715559982ba3d6f8b3d63647b4cf345b3153a8dda56743aaf8633cf9eb11d"} err="failed to get container status \"b05715559982ba3d6f8b3d63647b4cf345b3153a8dda56743aaf8633cf9eb11d\": rpc error: code = NotFound desc = could not find container \"b05715559982ba3d6f8b3d63647b4cf345b3153a8dda56743aaf8633cf9eb11d\": container with ID starting with b05715559982ba3d6f8b3d63647b4cf345b3153a8dda56743aaf8633cf9eb11d not found: ID does not exist"
Jul 23 14:28:54.922653 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:54.922632    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst"]
Jul 23 14:28:54.927185 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:54.927162    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-52507a-openshift-default-69bdd7dfbc-hrwst"]
Jul 23 14:28:55.068254 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:55.068222    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="660fa37c-953c-4079-87cd-11cce1697317" path="/var/lib/kubelet/pods/660fa37c-953c-4079-87cd-11cce1697317/volumes"
Jul 23 14:28:56.139841 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:56.139812    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-n2f96_a9d6385e-405f-4573-81e9-bafc4c361c18/manager/0.log"
Jul 23 14:28:56.282305 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:56.282275    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-rtpbg_5985ea7e-336b-45af-b8dc-7d6c9ee81d27/manager/0.log"
Jul 23 14:28:56.443302 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:56.443228    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-c95bb4b5c-dghmv_7d21cdb4-a1e4-4035-a4be-16ea811069f3/manager/0.log"
Jul 23 14:28:56.591287 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:56.591259    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-srv9n_f3b8e722-03e6-4690-b29a-96917c5350fc/server/0.log"
Jul 23 14:28:56.746961 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:56.746885    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-hh52w_cb90ddc6-5b8b-4d8f-af34-c40097c767e1/manager/0.log"
Jul 23 14:28:56.904571 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:56.904541    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c8b88fb69-2kgqt_9458335b-4941-48d6-bcd7-b37005bd9aaf/copy-manifests/0.log"
Jul 23 14:28:56.915578 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:56.915551    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c8b88fb69-2kgqt_9458335b-4941-48d6-bcd7-b37005bd9aaf/manager/0.log"
Jul 23 14:28:57.663362 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:57.663331    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-db66f56d8-tmcvl_c9748a48-0a5a-422a-9dae-63e29e3a6905/maas-api/0.log"
Jul 23 14:28:57.793547 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:57.793518    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29746920-zxkpm_72a8edc4-7ae6-4e55-8cc1-1ab8df448486/cleanup/0.log"
Jul 23 14:28:57.926358 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:57.926279    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29746935-w7lwt_d8a3cab1-591c-4252-8b74-2ca2675a5373/cleanup/0.log"
Jul 23 14:28:58.053393 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:58.053364    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-tnqsr_22f399c2-de75-432b-99b6-258927c812fe/postgres/0.log"
Jul 23 14:28:58.934385 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:58.934357    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599cxcz_1afec109-7eb5-4c05-a752-39482aba94be/util/0.log"
Jul 23 14:28:58.947802 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:58.947769    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599cxcz_1afec109-7eb5-4c05-a752-39482aba94be/pull/0.log"
Jul 23 14:28:58.960748 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:58.960718    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599cxcz_1afec109-7eb5-4c05-a752-39482aba94be/extract/0.log"
Jul 23 14:28:59.087844 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:59.087815    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cphjv_69e3cb8d-a9b0-4113-afa9-b66f5c7015ff/util/0.log"
Jul 23 14:28:59.097662 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:59.097637    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cphjv_69e3cb8d-a9b0-4113-afa9-b66f5c7015ff/pull/0.log"
Jul 23 14:28:59.110133 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:59.110110    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cphjv_69e3cb8d-a9b0-4113-afa9-b66f5c7015ff/extract/0.log"
Jul 23 14:28:59.240912 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:59.240827    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738nr2v_8ddaa08e-a0cb-41fc-9f1a-f351204211c2/pull/0.log"
Jul 23 14:28:59.252646 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:59.252622    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738nr2v_8ddaa08e-a0cb-41fc-9f1a-f351204211c2/extract/0.log"
Jul 23 14:28:59.261231 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:59.261210    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738nr2v_8ddaa08e-a0cb-41fc-9f1a-f351204211c2/util/0.log"
Jul 23 14:28:59.384467 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:59.384437    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hqv2n_d68f5174-b1d8-4981-9ce6-4fbe03bfd166/util/0.log"
Jul 23 14:28:59.395391 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:59.395364    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hqv2n_d68f5174-b1d8-4981-9ce6-4fbe03bfd166/pull/0.log"
Jul 23 14:28:59.404229 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:59.404212    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hqv2n_d68f5174-b1d8-4981-9ce6-4fbe03bfd166/extract/0.log"
Jul 23 14:28:59.685606 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:28:59.685576    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-5ll4q_d406dd9b-f3d9-40cf-b62c-fb81351ad874/manager/0.log"
Jul 23 14:29:00.100532 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:00.100505    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-h622p_0023f842-0d3e-4134-8db2-643313868d95/registry-server/0.log"
Jul 23 14:29:00.520730 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:00.520656    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-lx4ls_cd507235-42bf-4368-b5f5-0b61242ba155/manager/0.log"
Jul 23 14:29:00.932345 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:00.932315    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4qvc6t_f6fce891-07cf-4dc5-b579-ab9564cdc19c/istio-proxy/0.log"
Jul 23 14:29:01.237879 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:01.237801    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-d57cbb598-7crbl_5ecf33e2-d370-4307-9095-5b3d946eb74a/kube-auth-proxy/0.log"
Jul 23 14:29:01.498690 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:01.498614    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-zd65t_384f08a3-63c6-4f6e-8848-247f6f59c6b9/istio-proxy/1.log"
Jul 23 14:29:01.631477 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:01.631448    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-4nzgg_9c594df9-fd3a-4a5f-8e48-e72e60dc73ea/payload-pre-processing/0.log"
Jul 23 14:29:01.911485 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:01.911450    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-66578b4c86-6vhrf_0e22af39-dd90-473a-9802-abfb83870e38/router/0.log"
Jul 23 14:29:02.303761 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:02.303735    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-f29pl_df8bedc7-9980-4096-8939-65e5c331a1c8/main/0.log"
Jul 23 14:29:02.432555 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:02.432527    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-7pmgb_98a8aaee-f477-422d-82d3-a7bcd0a5543d/main/0.log"
Jul 23 14:29:06.807756 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:06.807723    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:29:09.253935 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:09.253889    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jrxnq/must-gather-7fm8w"]
Jul 23 14:29:09.254374 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:09.254359    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8572b121-8904-4de7-928f-418a70aca39a" containerName="istio-proxy"
Jul 23 14:29:09.254418 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:09.254376    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="8572b121-8904-4de7-928f-418a70aca39a" containerName="istio-proxy"
Jul 23 14:29:09.254418 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:09.254396    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8572b121-8904-4de7-928f-418a70aca39a" containerName="istio-proxy"
Jul 23 14:29:09.254418 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:09.254402    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="8572b121-8904-4de7-928f-418a70aca39a" containerName="istio-proxy"
Jul 23 14:29:09.254418 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:09.254415    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="660fa37c-953c-4079-87cd-11cce1697317" containerName="istio-proxy"
Jul 23 14:29:09.254541 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:09.254421    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="660fa37c-953c-4079-87cd-11cce1697317" containerName="istio-proxy"
Jul 23 14:29:09.254541 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:09.254431    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="660fa37c-953c-4079-87cd-11cce1697317" containerName="istio-proxy"
Jul 23 14:29:09.254541 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:09.254437    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="660fa37c-953c-4079-87cd-11cce1697317" containerName="istio-proxy"
Jul 23 14:29:09.254541 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:09.254444    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4154511-7594-42f0-9a36-95686d59536f" containerName="test-curl-7630-140098424682512"
Jul 23 14:29:09.254541 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:09.254450    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4154511-7594-42f0-9a36-95686d59536f" containerName="test-curl-7630-140098424682512"
Jul 23 14:29:09.254541 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:09.254512    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="660fa37c-953c-4079-87cd-11cce1697317" containerName="istio-proxy"
Jul 23 14:29:09.254541 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:09.254520    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="8572b121-8904-4de7-928f-418a70aca39a" containerName="istio-proxy"
Jul 23 14:29:09.254541 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:09.254527    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4154511-7594-42f0-9a36-95686d59536f" containerName="test-curl-7630-140098424682512"
Jul 23 14:29:09.254776 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:09.254646    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="8572b121-8904-4de7-928f-418a70aca39a" containerName="istio-proxy"
Jul 23 14:29:09.254776 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:09.254655    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="660fa37c-953c-4079-87cd-11cce1697317" containerName="istio-proxy"
Jul 23 14:29:09.257641 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:09.257625    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jrxnq/must-gather-7fm8w"
Jul 23 14:29:09.260313 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:09.260287    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-jrxnq\"/\"default-dockercfg-7h9v2\""
Jul 23 14:29:09.260718 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:09.260701    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jrxnq\"/\"openshift-service-ca.crt\""
Jul 23 14:29:09.260956 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:09.260918    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jrxnq\"/\"kube-root-ca.crt\""
Jul 23 14:29:09.278738 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:09.278713    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jrxnq/must-gather-7fm8w"]
Jul 23 14:29:09.295153 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:09.295119    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:29:09.318157 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:09.318117    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlzn7\" (UniqueName: \"kubernetes.io/projected/02bacee7-13d8-47fd-b01b-8d66692a160b-kube-api-access-nlzn7\") pod \"must-gather-7fm8w\" (UID: \"02bacee7-13d8-47fd-b01b-8d66692a160b\") " pod="openshift-must-gather-jrxnq/must-gather-7fm8w"
Jul 23 14:29:09.318319 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:09.318163    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/02bacee7-13d8-47fd-b01b-8d66692a160b-must-gather-output\") pod \"must-gather-7fm8w\" (UID: \"02bacee7-13d8-47fd-b01b-8d66692a160b\") " pod="openshift-must-gather-jrxnq/must-gather-7fm8w"
Jul 23 14:29:09.419042 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:09.418976    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlzn7\" (UniqueName: \"kubernetes.io/projected/02bacee7-13d8-47fd-b01b-8d66692a160b-kube-api-access-nlzn7\") pod \"must-gather-7fm8w\" (UID: \"02bacee7-13d8-47fd-b01b-8d66692a160b\") " pod="openshift-must-gather-jrxnq/must-gather-7fm8w"
Jul 23 14:29:09.419257 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:09.419055    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/02bacee7-13d8-47fd-b01b-8d66692a160b-must-gather-output\") pod \"must-gather-7fm8w\" (UID: \"02bacee7-13d8-47fd-b01b-8d66692a160b\") " pod="openshift-must-gather-jrxnq/must-gather-7fm8w"
Jul 23 14:29:09.419387 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:09.419370    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/02bacee7-13d8-47fd-b01b-8d66692a160b-must-gather-output\") pod \"must-gather-7fm8w\" (UID: \"02bacee7-13d8-47fd-b01b-8d66692a160b\") " pod="openshift-must-gather-jrxnq/must-gather-7fm8w"
Jul 23 14:29:09.431765 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:09.431733    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlzn7\" (UniqueName: \"kubernetes.io/projected/02bacee7-13d8-47fd-b01b-8d66692a160b-kube-api-access-nlzn7\") pod \"must-gather-7fm8w\" (UID: \"02bacee7-13d8-47fd-b01b-8d66692a160b\") " pod="openshift-must-gather-jrxnq/must-gather-7fm8w"
Jul 23 14:29:09.446317 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:09.446288    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log" limit=1024
Jul 23 14:29:09.567397 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:09.567356    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jrxnq/must-gather-7fm8w"
Jul 23 14:29:09.728921 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:09.728891    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jrxnq/must-gather-7fm8w"]
Jul 23 14:29:09.730144 ip-10-0-140-103 kubenswrapper[2573]: W0723 14:29:09.730108    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod02bacee7_13d8_47fd_b01b_8d66692a160b.slice/crio-94150943626cd628f25aa5731f8a6697a5a8162211a0975e88b970f560a2f3c2 WatchSource:0}: Error finding container 94150943626cd628f25aa5731f8a6697a5a8162211a0975e88b970f560a2f3c2: Status 404 returned error can't find the container with id 94150943626cd628f25aa5731f8a6697a5a8162211a0975e88b970f560a2f3c2
Jul 23 14:29:09.976451 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:09.976366    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jrxnq/must-gather-7fm8w" event={"ID":"02bacee7-13d8-47fd-b01b-8d66692a160b","Type":"ContainerStarted","Data":"94150943626cd628f25aa5731f8a6697a5a8162211a0975e88b970f560a2f3c2"}
Jul 23 14:29:10.989097 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:10.986320    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jrxnq/must-gather-7fm8w" event={"ID":"02bacee7-13d8-47fd-b01b-8d66692a160b","Type":"ContainerStarted","Data":"33c576a5679e72a397ffc43258b63ba4e7093b6ffbe680dba6573dbdf2338e4b"}
Jul 23 14:29:10.989097 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:10.986372    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jrxnq/must-gather-7fm8w" event={"ID":"02bacee7-13d8-47fd-b01b-8d66692a160b","Type":"ContainerStarted","Data":"2cae03972dd1a4124dc49ce84d0978c2f592ee84444236f4b4d4c355853fe8c7"}
Jul 23 14:29:11.019556 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:11.019501    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jrxnq/must-gather-7fm8w" podStartSLOduration=1.010476175 podStartE2EDuration="2.019484123s" totalImagesPullingTime="1.009007948s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 14:29:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 14:29:11.018041879 +0000 UTC m=+2922.457542799" watchObservedRunningTime="2026-07-23 14:29:11.019484123 +0000 UTC m=+2922.458985082"
Jul 23 14:29:13.064836 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:13.064808    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-wx249_ebc1dbc1-a42e-4498-8678-0f6a33a11f5f/global-pull-secret-syncer/0.log"
Jul 23 14:29:13.167467 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:13.167437    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-2p6xl_119f8d52-ffb3-43c7-922e-e0bc75740bd2/konnectivity-agent/0.log"
Jul 23 14:29:13.481587 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:13.481518    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-103.ec2.internal_60c2af9a1aa3e406170805fd92ab7b78/haproxy/0.log"
Jul 23 14:29:17.515122 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:17.515056    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599cxcz_1afec109-7eb5-4c05-a752-39482aba94be/extract/0.log"
Jul 23 14:29:17.545450 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:17.545415    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599cxcz_1afec109-7eb5-4c05-a752-39482aba94be/util/0.log"
Jul 23 14:29:17.572225 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:17.572192    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599cxcz_1afec109-7eb5-4c05-a752-39482aba94be/pull/0.log"
Jul 23 14:29:17.617639 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:17.617603    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cphjv_69e3cb8d-a9b0-4113-afa9-b66f5c7015ff/extract/0.log"
Jul 23 14:29:17.653495 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:17.653456    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cphjv_69e3cb8d-a9b0-4113-afa9-b66f5c7015ff/util/0.log"
Jul 23 14:29:17.680634 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:17.680600    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cphjv_69e3cb8d-a9b0-4113-afa9-b66f5c7015ff/pull/0.log"
Jul 23 14:29:17.718501 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:17.718452    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738nr2v_8ddaa08e-a0cb-41fc-9f1a-f351204211c2/extract/0.log"
Jul 23 14:29:17.752072 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:17.752039    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738nr2v_8ddaa08e-a0cb-41fc-9f1a-f351204211c2/util/0.log"
Jul 23 14:29:17.813870 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:17.813830    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738nr2v_8ddaa08e-a0cb-41fc-9f1a-f351204211c2/pull/0.log"
Jul 23 14:29:17.892224 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:17.892189    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hqv2n_d68f5174-b1d8-4981-9ce6-4fbe03bfd166/extract/0.log"
Jul 23 14:29:17.929270 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:17.929236    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hqv2n_d68f5174-b1d8-4981-9ce6-4fbe03bfd166/util/0.log"
Jul 23 14:29:17.964932 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:17.964899    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hqv2n_d68f5174-b1d8-4981-9ce6-4fbe03bfd166/pull/0.log"
Jul 23 14:29:18.544125 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:18.544089    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-5ll4q_d406dd9b-f3d9-40cf-b62c-fb81351ad874/manager/0.log"
Jul 23 14:29:18.695841 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:18.695809    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-h622p_0023f842-0d3e-4134-8db2-643313868d95/registry-server/0.log"
Jul 23 14:29:19.025218 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:19.024978    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-lx4ls_cd507235-42bf-4368-b5f5-0b61242ba155/manager/0.log"
Jul 23 14:29:21.051653 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:21.051610    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-76cf8966f8-jxgw7_96de4e50-4208-4f42-ab50-0a702232ff33/cluster-monitoring-operator/0.log"
Jul 23 14:29:21.350312 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:21.350224    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vch6s_13911ca8-4762-4532-8c6d-780f80f39478/node-exporter/0.log"
Jul 23 14:29:21.376193 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:21.376165    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vch6s_13911ca8-4762-4532-8c6d-780f80f39478/kube-rbac-proxy/0.log"
Jul 23 14:29:21.408592 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:21.408559    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vch6s_13911ca8-4762-4532-8c6d-780f80f39478/init-textfile/0.log"
Jul 23 14:29:22.664823 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:22.664791    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jrxnq/perf-node-gather-daemonset-vfl6b"]
Jul 23 14:29:22.672539 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:22.672510    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jrxnq/perf-node-gather-daemonset-vfl6b"
Jul 23 14:29:22.704443 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:22.704412    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jrxnq/perf-node-gather-daemonset-vfl6b"]
Jul 23 14:29:22.767164 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:22.767129    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6e16e5ad-4c7b-4fac-90e6-4c90194f02ca-podres\") pod \"perf-node-gather-daemonset-vfl6b\" (UID: \"6e16e5ad-4c7b-4fac-90e6-4c90194f02ca\") " pod="openshift-must-gather-jrxnq/perf-node-gather-daemonset-vfl6b"
Jul 23 14:29:22.767352 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:22.767178    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8d5l\" (UniqueName: \"kubernetes.io/projected/6e16e5ad-4c7b-4fac-90e6-4c90194f02ca-kube-api-access-w8d5l\") pod \"perf-node-gather-daemonset-vfl6b\" (UID: \"6e16e5ad-4c7b-4fac-90e6-4c90194f02ca\") " pod="openshift-must-gather-jrxnq/perf-node-gather-daemonset-vfl6b"
Jul 23 14:29:22.767352 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:22.767218    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6e16e5ad-4c7b-4fac-90e6-4c90194f02ca-lib-modules\") pod \"perf-node-gather-daemonset-vfl6b\" (UID: \"6e16e5ad-4c7b-4fac-90e6-4c90194f02ca\") " pod="openshift-must-gather-jrxnq/perf-node-gather-daemonset-vfl6b"
Jul 23 14:29:22.767352 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:22.767249    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6e16e5ad-4c7b-4fac-90e6-4c90194f02ca-sys\") pod \"perf-node-gather-daemonset-vfl6b\" (UID: \"6e16e5ad-4c7b-4fac-90e6-4c90194f02ca\") " pod="openshift-must-gather-jrxnq/perf-node-gather-daemonset-vfl6b"
Jul 23 14:29:22.767487 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:22.767374    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6e16e5ad-4c7b-4fac-90e6-4c90194f02ca-proc\") pod \"perf-node-gather-daemonset-vfl6b\" (UID: \"6e16e5ad-4c7b-4fac-90e6-4c90194f02ca\") " pod="openshift-must-gather-jrxnq/perf-node-gather-daemonset-vfl6b"
Jul 23 14:29:22.868818 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:22.868770    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6e16e5ad-4c7b-4fac-90e6-4c90194f02ca-proc\") pod \"perf-node-gather-daemonset-vfl6b\" (UID: \"6e16e5ad-4c7b-4fac-90e6-4c90194f02ca\") " pod="openshift-must-gather-jrxnq/perf-node-gather-daemonset-vfl6b"
Jul 23 14:29:22.869053 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:22.868837    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6e16e5ad-4c7b-4fac-90e6-4c90194f02ca-podres\") pod \"perf-node-gather-daemonset-vfl6b\" (UID: \"6e16e5ad-4c7b-4fac-90e6-4c90194f02ca\") " pod="openshift-must-gather-jrxnq/perf-node-gather-daemonset-vfl6b"
Jul 23 14:29:22.869053 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:22.868864    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8d5l\" (UniqueName: \"kubernetes.io/projected/6e16e5ad-4c7b-4fac-90e6-4c90194f02ca-kube-api-access-w8d5l\") pod \"perf-node-gather-daemonset-vfl6b\" (UID: \"6e16e5ad-4c7b-4fac-90e6-4c90194f02ca\") " pod="openshift-must-gather-jrxnq/perf-node-gather-daemonset-vfl6b"
Jul 23 14:29:22.869053 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:22.868889    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6e16e5ad-4c7b-4fac-90e6-4c90194f02ca-lib-modules\") pod \"perf-node-gather-daemonset-vfl6b\" (UID: \"6e16e5ad-4c7b-4fac-90e6-4c90194f02ca\") " pod="openshift-must-gather-jrxnq/perf-node-gather-daemonset-vfl6b"
Jul 23 14:29:22.869053 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:22.868910    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6e16e5ad-4c7b-4fac-90e6-4c90194f02ca-proc\") pod \"perf-node-gather-daemonset-vfl6b\" (UID: \"6e16e5ad-4c7b-4fac-90e6-4c90194f02ca\") " pod="openshift-must-gather-jrxnq/perf-node-gather-daemonset-vfl6b"
Jul 23 14:29:22.869053 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:22.868922    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6e16e5ad-4c7b-4fac-90e6-4c90194f02ca-sys\") pod \"perf-node-gather-daemonset-vfl6b\" (UID: \"6e16e5ad-4c7b-4fac-90e6-4c90194f02ca\") " pod="openshift-must-gather-jrxnq/perf-node-gather-daemonset-vfl6b"
Jul 23 14:29:22.869053 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:22.868984    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6e16e5ad-4c7b-4fac-90e6-4c90194f02ca-sys\") pod \"perf-node-gather-daemonset-vfl6b\" (UID: \"6e16e5ad-4c7b-4fac-90e6-4c90194f02ca\") " pod="openshift-must-gather-jrxnq/perf-node-gather-daemonset-vfl6b"
Jul 23 14:29:22.869292 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:22.869057    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6e16e5ad-4c7b-4fac-90e6-4c90194f02ca-podres\") pod \"perf-node-gather-daemonset-vfl6b\" (UID: \"6e16e5ad-4c7b-4fac-90e6-4c90194f02ca\") " pod="openshift-must-gather-jrxnq/perf-node-gather-daemonset-vfl6b"
Jul 23 14:29:22.869292 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:22.869080    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6e16e5ad-4c7b-4fac-90e6-4c90194f02ca-lib-modules\") pod \"perf-node-gather-daemonset-vfl6b\" (UID: \"6e16e5ad-4c7b-4fac-90e6-4c90194f02ca\") " pod="openshift-must-gather-jrxnq/perf-node-gather-daemonset-vfl6b"
Jul 23 14:29:22.888140 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:22.888100    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8d5l\" (UniqueName: \"kubernetes.io/projected/6e16e5ad-4c7b-4fac-90e6-4c90194f02ca-kube-api-access-w8d5l\") pod \"perf-node-gather-daemonset-vfl6b\" (UID: \"6e16e5ad-4c7b-4fac-90e6-4c90194f02ca\") " pod="openshift-must-gather-jrxnq/perf-node-gather-daemonset-vfl6b"
Jul 23 14:29:22.983450 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:22.983154    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jrxnq/perf-node-gather-daemonset-vfl6b"
Jul 23 14:29:23.185627 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:23.185589    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jrxnq/perf-node-gather-daemonset-vfl6b"]
Jul 23 14:29:23.675309 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:23.675278    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-4ndvj_7611ad79-3d20-4ba5-85ef-ed2724212082/networking-console-plugin/0.log"
Jul 23 14:29:24.108415 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:24.108370    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jrxnq/perf-node-gather-daemonset-vfl6b" event={"ID":"6e16e5ad-4c7b-4fac-90e6-4c90194f02ca","Type":"ContainerStarted","Data":"afc162e2597d03263d9ae91daaa9cb21b29dac927cea08469710f2fc6ceabf38"}
Jul 23 14:29:24.108617 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:24.108441    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-jrxnq/perf-node-gather-daemonset-vfl6b"
Jul 23 14:29:24.108617 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:24.108485    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jrxnq/perf-node-gather-daemonset-vfl6b" event={"ID":"6e16e5ad-4c7b-4fac-90e6-4c90194f02ca","Type":"ContainerStarted","Data":"e8d7d7de257d953c3ff734d6b3a3da85513c7b67f78dd252ef09e24d489ca11b"}
Jul 23 14:29:24.132107 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:24.132055    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jrxnq/perf-node-gather-daemonset-vfl6b" podStartSLOduration=2.132036943 podStartE2EDuration="2.132036943s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 14:29:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 14:29:24.128833864 +0000 UTC m=+2935.568334784" watchObservedRunningTime="2026-07-23 14:29:24.132036943 +0000 UTC m=+2935.571537852"
Jul 23 14:29:24.299149 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:24.299116    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-vh5dp_2d624703-978f-48c2-b02d-9af8fd337236/console-operator/1.log"
Jul 23 14:29:24.305056 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:24.304992    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-vh5dp_2d624703-978f-48c2-b02d-9af8fd337236/console-operator/2.log"
Jul 23 14:29:24.820612 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:24.820562    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-bgxjf_2b17e1f0-a160-4024-9a5d-3e9ed3cedf88/download-server/0.log"
Jul 23 14:29:25.518001 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:25.517972    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78cf4c6f6-7rvsv_001764b2-a882-42f4-9ef6-2ea7066febd7/volume-data-source-validator/0.log"
Jul 23 14:29:26.640352 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:26.640324    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-v878n_62b09fb2-689e-433b-8621-d6ee876b59a6/dns/0.log"
Jul 23 14:29:26.673191 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:26.673156    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-v878n_62b09fb2-689e-433b-8621-d6ee876b59a6/kube-rbac-proxy/0.log"
Jul 23 14:29:26.868066 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:26.868038    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-h5h9z_382c782e-058b-4863-bd13-2e88a5f465bf/dns-node-resolver/0.log"
Jul 23 14:29:27.481273 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:27.481232    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5gxsc_d846e487-3440-4729-89d1-57211afe3328/node-ca/0.log"
Jul 23 14:29:28.476505 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:28.476475    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4qvc6t_f6fce891-07cf-4dc5-b579-ab9564cdc19c/istio-proxy/0.log"
Jul 23 14:29:28.792406 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:28.792357    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-d57cbb598-7crbl_5ecf33e2-d370-4307-9095-5b3d946eb74a/kube-auth-proxy/0.log"
Jul 23 14:29:28.846135 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:28.846100    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-zd65t_384f08a3-63c6-4f6e-8848-247f6f59c6b9/istio-proxy/0.log"
Jul 23 14:29:28.882225 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:28.882198    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-zd65t_384f08a3-63c6-4f6e-8848-247f6f59c6b9/istio-proxy/1.log"
Jul 23 14:29:28.916072 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:28.916041    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-4nzgg_9c594df9-fd3a-4a5f-8e48-e72e60dc73ea/payload-pre-processing/0.log"
Jul 23 14:29:28.991032 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:28.990985    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-66578b4c86-6vhrf_0e22af39-dd90-473a-9802-abfb83870e38/router/0.log"
Jul 23 14:29:29.708506 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:29.708477    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-98w4s_5d49627b-4f13-46b6-a3a2-da958eb12319/serve-healthcheck-canary/0.log"
Jul 23 14:29:30.128533 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:30.127444    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-jrxnq/perf-node-gather-daemonset-vfl6b"
Jul 23 14:29:30.245328 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:30.245287    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-25jdb_b13a7207-47ba-4e8e-a62b-97546e957cdd/insights-operator/0.log"
Jul 23 14:29:30.246255 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:30.246234    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-25jdb_b13a7207-47ba-4e8e-a62b-97546e957cdd/insights-operator/1.log"
Jul 23 14:29:30.335264 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:30.335232    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cjpfp_361da523-6b42-450e-ba3d-0b52b7865320/kube-rbac-proxy/0.log"
Jul 23 14:29:30.359723 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:30.359690    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cjpfp_361da523-6b42-450e-ba3d-0b52b7865320/exporter/0.log"
Jul 23 14:29:30.383843 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:30.383776    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cjpfp_361da523-6b42-450e-ba3d-0b52b7865320/extractor/0.log"
Jul 23 14:29:33.091134 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:33.091108    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-n2f96_a9d6385e-405f-4573-81e9-bafc4c361c18/manager/0.log"
Jul 23 14:29:33.117139 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:33.117090    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4qvc6t_f6fce891-07cf-4dc5-b579-ab9564cdc19c/istio-proxy/0.log"
Jul 23 14:29:33.303567 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:33.303536    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-rtpbg_5985ea7e-336b-45af-b8dc-7d6c9ee81d27/manager/0.log"
Jul 23 14:29:33.349347 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:33.349318    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-d57cbb598-7crbl_5ecf33e2-d370-4307-9095-5b3d946eb74a/kube-auth-proxy/0.log"
Jul 23 14:29:33.396126 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:33.396091    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-zd65t_384f08a3-63c6-4f6e-8848-247f6f59c6b9/istio-proxy/0.log"
Jul 23 14:29:33.442317 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:33.442290    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-zd65t_384f08a3-63c6-4f6e-8848-247f6f59c6b9/istio-proxy/1.log"
Jul 23 14:29:33.476666 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:33.476625    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-4nzgg_9c594df9-fd3a-4a5f-8e48-e72e60dc73ea/payload-pre-processing/0.log"
Jul 23 14:29:33.479284 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:33.479257    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-c95bb4b5c-dghmv_7d21cdb4-a1e4-4035-a4be-16ea811069f3/manager/0.log"
Jul 23 14:29:33.507844 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:33.507818    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-srv9n_f3b8e722-03e6-4690-b29a-96917c5350fc/server/0.log"
Jul 23 14:29:33.523195 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:33.523171    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-66578b4c86-6vhrf_0e22af39-dd90-473a-9802-abfb83870e38/router/0.log"
Jul 23 14:29:33.604646 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:33.604563    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-hh52w_cb90ddc6-5b8b-4d8f-af34-c40097c767e1/manager/0.log"
Jul 23 14:29:33.638305 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:33.638270    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c8b88fb69-2kgqt_9458335b-4941-48d6-bcd7-b37005bd9aaf/manager/0.log"
Jul 23 14:29:33.669867 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:33.669836    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c8b88fb69-2kgqt_9458335b-4941-48d6-bcd7-b37005bd9aaf/copy-manifests/0.log"
Jul 23 14:29:34.819006 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:34.818972    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4qvc6t_f6fce891-07cf-4dc5-b579-ab9564cdc19c/istio-proxy/0.log"
Jul 23 14:29:35.183504 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:35.183431    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-d57cbb598-7crbl_5ecf33e2-d370-4307-9095-5b3d946eb74a/kube-auth-proxy/0.log"
Jul 23 14:29:35.230571 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:35.230537    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-zd65t_384f08a3-63c6-4f6e-8848-247f6f59c6b9/istio-proxy/0.log"
Jul 23 14:29:35.260263 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:35.260231    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-zd65t_384f08a3-63c6-4f6e-8848-247f6f59c6b9/istio-proxy/1.log"
Jul 23 14:29:35.293036 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:35.292983    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-4nzgg_9c594df9-fd3a-4a5f-8e48-e72e60dc73ea/payload-pre-processing/0.log"
Jul 23 14:29:35.357197 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:35.357161    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-ww6jh_6d2af49d-0c41-47c6-91e3-779f3c8441ac/openshift-lws-operator/0.log"
Jul 23 14:29:35.362718 ip-10-0-140-103 kubenswrapper[2573]: I0723 14:29:35.362697    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-66578b4c86-6vhrf_0e22af39-dd90-473a-9802-abfb83870e38/router/0.log"